Microsoft CRM 2011 client crashes when opened as new window in Outlook 2007

Pretty much as the title says, running 32bit Outlook 2007 32bit  Windows XP Pro with the Outlook client Rollup 6.

On multple machines (all of which have had the CRM4 client previously installed) if you right click on a CRM folder and attempt to open it as a new window, Outlook crashes fairly instantly.

I have tried an unconfigure, remove the microsoft\mscrm\client folder and reconfiguring CRM but does not appear to make any difference.

Sometimes, we get the crash if we try an open CRM in the primary Outlook window.