I have a revenue archive application that pulls in data from a flat file and converts it. There are several steps in the process:
1) The flat csv data file is saved as an Excel file that is linked to the application. All the values in this file are text fields.
2) The Excel data is imported into a working file inside the database.
3) The data in the working file is tested against 6 "standing tables" that contain the desired revenue tags and their key fields. Any new items are appended to these tables and assigned new numeric keys.
4) Once there is a relational key record for every value in the import file, the records in the import file are distilled down from their text values to their relational keys and stored in the master archive file.
Each of these steps takes a while and I would like to use a progress bar to give the user an idea of where we are in the process. But step 2, for example, is just an append query that is running on 20-30,000 records. So I can't figure out how to measure the progress of that query's execution so I can assign it a value for use in advancing the progress bar.