Hyper-V Exchange and Outlook

This is a tricky one to explain.
Old system setup.
Stand alone Exchange 2010 on Server 08 R2 16GB ram dual core
Outlook 2010 on all workstations.
Everything was fine.

New setup.
Exchange as a VM on server 2012 R2 Hyper-V 32 GB Ram with 3 processors.

Ever since moving Exchange to the Hyper-V server all Outlook clients have random sporadic moments when all of Outlook freezes. I mean everything, minimize, close, all buttons, hotkeys everything. Then after about 5 to 10 seconds to all comes back fine. I cannot believe that this has anything to do with Exchange server... but it started the Monday after moving Exchange to the VM. I have raised the amount of processors and RAM, I have disabled all other VM's on Hyper-V. On the times when it happens to my workstation, I look at the resources of the Hype-V server and the VM and they are not anywhere near maxing out the available resources. I have tried changing outlook from cache mode to non cache mode. I have removed my profile from system completely and re-added it..I have created new users with no email.. I see no errors in the elogs on either the workstation or server.
It seems that no matter what I do this does not go away. Has anyone else experienced this issue?  

Thanks
Richard