Microsoft Small Business Server 2011 Indexing Issues

I've noticed on SBS 2011 when I go to control panel, Indexing Options, every share is selected as well as a few other local folders from the logged in Server user.  This is over 400,00 files.  It is killing the speed of the SBS 2011 and network.  If I go into "Modify" button and uncheck folders then go into "Advanced" button and "Rebuild" it rebuilds with what I have only selected but if I come back to Indexing Options 20 minutes later it automatically adds all the shared folders/files and I'm back up to 400,000 files in an hour or two.

I've already gone to the folder properties in File Explorer, until the "General" tab, "Advanced" button, and unchecked everything - even the "Allow files in this folder to have contents indexed in addition to file properties".  I've been so irritated by this I even this that on the root of the C drive!

On 2012, 2012R2, or 2016 Servers this process I explained above works and I see zero difference in searches and massive performance in everything else but it doesn't work on SBS 2011.

Regards,
Torrey