Windows server 2016 Deduplication and robocopy

Hi experts,

I think this is quite a simple question.
Following scenrio:

I set up a new Windows Server 2016
I initially robocopied (/E /V /L /COPY:DAT /TEE /R:1 /log:) a file share from my old fileserver (without dedup) to a new one when dedup was not yet activated on the target.
After that I activated dedup (59% rate) and I have an optimzed state of the share on my new server.
I would now like to sync the old share (which is still in production) with the new one.

At the moment I am trying the same robocopy command again (as dryrun) and in the robocopy logfile I see entries with "equal" and some with "optimized".

Would the sync work in that scenario? (Target optimized, source unoptimized)
I`m definitely only copying a folder, not the whole volume what did make problems with dedup for others, how I read.

Many thanks in advance!
Roland
SystemadministrationAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Jeremy WeisingerSenior Network Consultant / EngineerCommented:
Dedupe is local to the volume. The source of the files makes no difference where you copy them from. The dedupe process runs periodically on the server (depending on the settings) and will optimize the files over time. I think the default setting is to optimize files 5 days old and older on the volume.
0
SystemadministrationAuthor Commented:
Yes correct.
The policy is "files older 3 days"
My question is, whether robocopy is able to recognize if I file in the target is equal/different from the source, even while deduplication is activated on the target.
0
Jeremy WeisingerSenior Network Consultant / EngineerCommented:
No, robocopy won't do that. The groveler service needs to make that determination and process all files.

Note also that the dedupe in Windows is not file based but block based so it can dedupe portions of files that are the same.
0
IT Pros Agree: AI and Machine Learning Key

We’d all like to think our company’s data is well protected, but when you ask IT professionals they admit the data probably is not as safe as it could be.

SystemadministrationAuthor Commented:
What exactly would that mean?
Can I use robocopy after activating deduplication and then sync the directories? Or would I have to wait for dedup activation until I have all date copied to the target?
0
Jeremy WeisingerSenior Network Consultant / EngineerCommented:
What exactly would that mean?
Are you referring to the block level vs file level? If so, block level means that a whole file doesn't need to be duplicated to see a savings. By doing it at the block level it means that any blocks on the disk that are identical can be deduped regardless of the file its associated with. The advantage is that the file format and data types are irrelevant and so matching blocks can be found among disparate data.

Can I use robocopy after activating deduplication and then sync the directories? Or would I have to wait for dedup activation until I have all date copied to the target?
You can turn on dedupe right away. Robocopy and deduplication are completely separate and don't have any bearing on each other.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
PberSolutions ArchitectCommented:
No comment has been added to this question in more than 21 days, so it is now classified as abandoned.

I have recommended this question be closed as follows:

Accept: Jeremy Weisinger (https:#a42366290)

If you feel this question should be closed differently, post an objection and the moderators will review all objections and close it as they feel fit. If no one objects, this question will be closed automatically the way described above.

Pber
Experts-Exchange Cleanup Volunteer
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Windows Server 2016

From novice to tech pro — start learning today.