I have 2 CSV files each containing more than 50,000 records. I need to join them on a primary key and populate the output - a 3rd CSV file with fields from both the input CSV files. How do I -
1) Perform lookup on the primary key present in both the input files
2) Speed up the search, read and write to the target CSV file?
3) The input CSV files are delimited by ',' but also contain the ',' character as part of the field value. So a sample of the input file looks like this -
Identifier, Name, Currency, Quantity
"ABC","A random example, Inc.","USD","405"
"DEF"."Another randow example, Inc.","EUR".765"