Link to home
Start Free TrialLog in
Avatar of curiouswebster
curiouswebsterFlag for United States of America

asked on

EF6, threading and large data sets

I need to write an EF6 app that reads from Oracle and enables multiple instances of my app each to process a chunk of records, in parallel.  This is because I assume it's faster to have perhaps 20 instances of my app running with each thread assigned perhaps 500K records rather than a single process handling 10 million records.

Please give me some insight into what EF6 can do for me.

Thanks!
ASKER CERTIFIED SOLUTION
Avatar of Bob Learned
Bob Learned
Flag of United States of America image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
Avatar of curiouswebster

ASKER

How would you have multiple processes without making it multi-threaded?

Currently, I am porting SQL Server scripts to Oracle which simulate multi-threading,  using several data tables which get created for this legacy port. It partitions the database into 500K record chunks by assigning them a unique process ID, and tracking the current status for each row.

How could this work in EF6? I hoped to replace this whole complexity with EF6, but need to find how to use EF6 to help partition the large table so over a dozen instances can do the job in parallel.

Thanks.
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
thanks!