asked on

Disable Data Execution Protection in installshield

Hello,

In my software I am using a third party activex component which is using some kind of encryption to protect itself. In windows server 2003 this component does not properly register, and my application will not properly execute. When Windows Data Execution Protection (DEP) is disabled, it is working fine.

So I want to disable DEP for the 2 executables in question. Is it possible to do this automatically from the installshield script? (I am using Installshield Developer 8). An alternative would be opening the dialog (Control Panel-System-Advanced-(Performance) Settings-Data Execution Protection, and instruct the user to add two exceptions there.

ASKER CERTIFIED SOLUTION

jkr

membership

This solution is only available to members.

To access this solution, you must be a member of Experts Exchange.

Start Free Trial

cwwkie

ASKER

> I am afraid that there probably won't be any programmatic way that does not require a reboot, since that kinda would defeat the purpose of DEP.

I was afraid of that. But then it would be better to pause the installation process and instruct the user to add the exceptions, and continue after the user confirms the exceptions are added. I can get the advanced tab with (something equivalent to) "rundll32 shell32.dll,Control_RunDLL sysdm.cpl,,3", but the other steps must be done manually.

But I leave this question open for some days in case someone else knows a better way.

jkr

You could use RegMon (http://www.sysinternals.com/Utilities/Regmon.html) to see where these changes are stored in the registry (if so) in order to do these steps programmatically.