Avatar of Systemadministration
Systemadministration
 asked on

Windows server 2016 Deduplication and robocopy

Hi experts,

I think this is quite a simple question.
Following scenrio:

I set up a new Windows Server 2016
I initially robocopied (/E /V /L /COPY:DAT /TEE /R:1 /log:) a file share from my old fileserver (without dedup) to a new one when dedup was not yet activated on the target.
After that I activated dedup (59% rate) and I have an optimzed state of the share on my new server.
I would now like to sync the old share (which is still in production) with the new one.

At the moment I am trying the same robocopy command again (as dryrun) and in the robocopy logfile I see entries with "equal" and some with "optimized".

Would the sync work in that scenario? (Target optimized, source unoptimized)
I`m definitely only copying a folder, not the whole volume what did make problems with dedup for others, how I read.

Many thanks in advance!
Roland
Windows OSWindows 10AzureWindows Server 2016* Robocopy

Avatar of undefined
Last Comment
Pber

8/22/2022 - Mon
Jeremy Weisinger

Dedupe is local to the volume. The source of the files makes no difference where you copy them from. The dedupe process runs periodically on the server (depending on the settings) and will optimize the files over time. I think the default setting is to optimize files 5 days old and older on the volume.
Systemadministration

ASKER
Yes correct.
The policy is "files older 3 days"
My question is, whether robocopy is able to recognize if I file in the target is equal/different from the source, even while deduplication is activated on the target.
Jeremy Weisinger

No, robocopy won't do that. The groveler service needs to make that determination and process all files.

Note also that the dedupe in Windows is not file based but block based so it can dedupe portions of files that are the same.
Experts Exchange is like having an extremely knowledgeable team sitting and waiting for your call. Couldn't do my job half as well as I do without it!
James Murphy
Systemadministration

ASKER
What exactly would that mean?
Can I use robocopy after activating deduplication and then sync the directories? Or would I have to wait for dedup activation until I have all date copied to the target?
ASKER CERTIFIED SOLUTION
Jeremy Weisinger

THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
See Pricing Options
Start Free Trial
GET A PERSONALIZED SOLUTION
Ask your own question & get feedback from real experts
Find out why thousands trust the EE community with their toughest problems.
Pber

No comment has been added to this question in more than 21 days, so it is now classified as abandoned.

I have recommended this question be closed as follows:

Accept: Jeremy Weisinger (https:#a42366290)

If you feel this question should be closed differently, post an objection and the moderators will review all objections and close it as they feel fit. If no one objects, this question will be closed automatically the way described above.

Pber
Experts-Exchange Cleanup Volunteer