Want to protect your cyber security and still get fast solutions? Ask a secure question today.Go Premium

x
  • Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 1526
  • Last Modified:

Disable Data Execution Protection in installshield

Hello,

In my software I am using a third party activex component which is using some kind of encryption to protect itself. In windows server 2003 this component does not properly register, and my application will not properly execute. When Windows Data Execution Protection (DEP) is disabled, it is working fine.

So I want to disable DEP for the 2 executables in question. Is it possible to do this automatically from the installshield script? (I am using Installshield Developer 8). An alternative would be opening the dialog (Control Panel-System-Advanced-(Performance) Settings-Data Execution Protection, and instruct the user to add two exceptions there.
0
cwwkie
Asked:
cwwkie
  • 2
1 Solution
 
jkrCommented:
See http://www.microsoft.com/technet/security/prodtech/windowsxp/depcnfxp.mspx#EQD ("How to Configure Memory Protection in Windows XP SP2"), where you should be able to specify a list of exceptions for DEP. This should be the same for W2k3. http://support.microsoft.com/kb/875351/en-us ("You receive a "Data Execution Prevention" error message in Windows XP Service Pack 2 or in Windows XP Tablet PC Edition 2005") also describes this method. I am afraid that there probably won't be any programmatic way that does not require a reboot, since that kinda would defeat the purpose of DEP.
0
 
cwwkieAuthor Commented:
> I am afraid that there probably won't be any programmatic way that does not require a reboot, since that kinda would defeat the purpose of DEP.

I was afraid of that. But then it would be better to pause the installation process and instruct the user to add the exceptions, and continue after the user confirms the exceptions are added. I can get the advanced tab with (something equivalent to) "rundll32 shell32.dll,Control_RunDLL sysdm.cpl,,3", but the other steps must be done manually.

But I leave this question open for some days in case someone else knows a better way.
0
 
jkrCommented:
You could use RegMon (http://www.sysinternals.com/Utilities/Regmon.html) to see where these changes are stored in the registry (if so) in order to do these steps programmatically.
0

Featured Post

Free Tool: Site Down Detector

Helpful to verify reports of your own downtime, or to double check a downed website you are trying to access.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

  • 2
Tackle projects and never again get stuck behind a technical roadblock.
Join Now