Posted on 2012-12-21
Our company has been using an Intranet ASP.NET 1.1 application (in house) for the last 8 years. It queries a SQL Server 2000 installation with the actual DB being only 5 GB Max. The Intranet application will only work correctly with IE 6 and they have been running on old Dell Poweredge 700 series servers running 4GB RAM (32 bit) on Server 2003. These two servers have been our bread and butter and have made our company alot of money. This application and SQL server is called on by only 30 employees at any given time so the resource footprint has never been that big.
During the last year (before me and the other admin got here) our developer convinced our owners that going "virtual" will revolutionize our speed and availability. and this "virtual environment will make our CSR's more efficient.
So after many round tables with dell the company decided upon the consultation of our developer to purchase 3 - R710 Servers with 96GB of RAM running VSphere, 2- Force 10 Switches and an Equalogic SAN (4TB) all coming to a cost of $140,000 (yes that's right ONE HUNDRED FORTY THOUSAND DOLLARS)
Now the app RAN fine for 8 years with the the two $200 Poweredge 700's. so as soon as he deployed his .NET 1.1 application to the 64BIT Server 2008R2 "Virtual" Environment he begin to get 500 Errors.
The SQL Server Portion has been ok and the ASP.NET server is hosting the following:
IIS 7 With 4 Application Pools
Print Services for 40 Printers
This virtual server has been allocated 16 GB of RAM and he locked in the server with 60GB
of hard drive space out of 4TB of SAN space unused.
The 500 errors wont stop and when I look in event viewer I am seeing a consistent 5077 error about ASP.NET and WAS
"A worker process with process id of '%1' serving application pool ASP.NET1.1 has requested a recycle because it reached its virtual memory limit."
This warning is happening every minute and I'm thinking that maybe this is his "work around" to make the .net1.1 play nice with the 64 bit?
This DEV will not use newer .NET framework and refuses to upgrade to a newer webrowser. I think its not playing well with the X64 environment but thats just me.
Now at one time I noticed that he was using 54 GB of the 60 GB and when I brought in to his attention he didn't like that too much. He has since deleted some files because there's 16gb of free space now.
So basically now he's blaming myself and another administrator that our DC's are causing the problem but we didn't build the two DC's until 2 1/2 months AFTER his 500 errors began.
Me and the other Admin basically told them (the owners) yesterday that they spent about $130,000 too much and the whole virtual environment has to be re-engineered because we cannot change the size of the 60GB partition (we tried already) and his virtual environment is sharing all three physical servers so our production would be affected.
We told them that the whole virtual thing has been misrepresented
The developer even put "Now loading virtual environment" on the login page of the app. for a psychological suggestion to the owners.
When the app was first deployed the Owner told the Dev "I thought this was supposed to be faster?" and "They are getting errors"
Me and the other admin told them that this whole "VIRTUAL" word that has been thrown around as the savior was mis-sold because Virtual is great for companies who need many servers for less hardware such has hosting companies which require a smaller fiscal footprint when buying thousands of servers.
Now the latest thing this DEV is doing now is blaming our TeamViewer Hosts for slowing down our network. He's flatout lying and using the owners lack of knowledge to attack our technical credibility. We service 80 users and we install the lightweight teamviewer hosts on the machine for desktop support.
We've only been here for 6 months and he's been here for 8 years and is the "guru" so they believe him.
What do you guys suggest?
Thank you in advance.