We have a vb.net tool that opens up 70+ workbooks and stores the contents into a sql database every month.
To give ya'll an idea, we're talking about 400 Excel columns for each Excel row (right now there are 2000 rows) for each month. Most of these are columns are numeric (about 30 are strings less than 255 characters).
Our problem is that the size of the database grows very rapidly. With about 60 months stored we're at 67,937,984 kb. My questions:
1. Given the amount of data we are storing, does this seem like reasonable growth?
2. Is there something I'm doing wrong with the config/setup of database? I periodically shrink the database and it does help a little but the significant growth each month is still there?
3. Should I consider splitting the data files into multiple physical files ..... what are the benefits?
I know .... loaded questions and I am just starting to try and tackle this - any insight would be appreciated.