Solved

MS Access CrossTab Query / Size Limit Problem

Posted on 2007-03-19
9
846 Views
Last Modified: 2012-06-27
Access 2000 with XP: (Will be getting Vista and Office 2007 soon)

I have an Access database with 3 tables that are joined in a query.  Each table at this time has bunches of records and lots will be added everyday.  When linked together to run a Crosstab Query, it seems to go past the 2 GB size that Access allows and will not open.

My question is which application is the next step up that can do Crosstab Querys from another query with about 100,000,000,000,000 records and is there a size limit OR can code be written in Access that will let me get the Top 100 Results from the Crosstab query without it taking forever and 2 days?

How to do this will come in later questions.
This will be awarded to the first to repsond.

Thanks
Nate
0
Comment
Question by:WonHop
  • 5
  • 4
9 Comments
 
LVL 57
ID: 18750955
Nate,

  100 Trillion records?

JimD
0
 
LVL 2

Author Comment

by:WonHop
ID: 18751311
Hello Jim.  It has been a while.  You answered some of my questions in the past.
I may have gotten a little happy with the zeros (10,000,000,000) ,but,
Yes, pretty much.  It is a permuation based on data from the last 10 years he has been in business and it will grow daily with each days input and a permution on that day along with all 13 years of data.  He needs to analyze it.
So it is going to be big.

The main thing is, Access cannot handle it.   When I opened 1 days worth of data in a query, the database size blew up to 1.66 GB.  The data is Proprietary. That is why for right now,  I am just trying to find out if there is another way to view the date in a Crosstab Query format.  From there, I will see if he wants to invest in that and me taking the time to learn it.

Nate  :0)
0
 
LVL 2

Author Comment

by:WonHop
ID: 18751343
Ignore the 13 years part.  That was something else I was thinking about.  :0)

Hello Jim.  It has been a while.  You answered some of my questions in the past.
I may have gotten a little happy with the zeros (10,000,000,000) ,but,
Yes, pretty much.  It is a permuation based on data from the last 10 years he has been in business and it will grow daily with each days input.  He needs to analyze it.
So it is going to be big.

The main thing is, Access cannot handle it.   When I opened 1 days worth of data in a query, the database size blew up to 1.66 GB.  The data is Proprietary. That is why for right now,  I am just trying to find out if there is another way to view the date in a Crosstab Query format.  From there, I will see if he wants to invest in that and me taking the time to learn it

Thanks
Nate
0
DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

 
LVL 57
ID: 18751837

  There is nothing you can do with Access to work around this.  You'll need something heavy duty like SQL Server.

JimD
0
 
LVL 2

Author Comment

by:WonHop
ID: 18751896
That is what I thought.  
Will Visual Basic work?
Will a new machine be needed to use SQL Server?
Is SQL Server hard to learn?

Thanks
Nate
0
 
LVL 57

Accepted Solution

by:
Jim Dettman (Microsoft MVP/ EE MVE) earned 500 total points
ID: 18751999
<<That is what I thought.  
Will Visual Basic work?>>

   Yes, so would Access.  SQL Server (or Oracle, MySQL, etc) would do the work and just pass the results. VB or Access would just display/report them.

<<Will a new machine be needed to use SQL Server?>>

  Possibly.  It's very hard to say.  Generally, you run SQL Server on it's own box with a couple gigs of RAM to even begin to handle something that size.

<<Is SQL Server hard to learn?>>

  Not overly so no, but it's SQL dialect is different then that of Access.   There is a service that SQL Server offers  called OLAP (Online Analitical Processing) which you might use to do this.  Hard to say without knowing a lot more.

JimD.

 
0
 
LVL 2

Author Comment

by:WonHop
ID: 18752100
Thanks Jim.
One more question.  Can tables and querys be built in those programs just like you can in Access. The GUI thingy.  You know....New Table...Add Field Names...Add data just like in Access.
0
 
LVL 57
ID: 18752885
<<One more question.  Can tables and querys be built in those programs just like you can in Access. The GUI thingy.  You know....New Table...Add Field Names...Add data just like in Access.>>

 Yup.

JimD.
0
 
LVL 2

Author Comment

by:WonHop
ID: 18756706
Thanks Jim
0

Featured Post

DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Introduction Hopefully the following mnemonic and, ultimately, the acronym it represents is common place to all those reading: Please Excuse My Dear Aunt Sally (PEMDAS). Briefly, though, PEMDAS is used to signify the order of operations (http://en.…
Composite queries are used to retrieve the results from joining multiple queries after applying any filters. UNION, INTERSECT, MINUS, and UNION ALL are some of the operators used to get certain desired results.​
This Micro Tutorial demonstrates using Microsoft Excel pivot tables, how to reverse engineer competitors' marketing strategies through backlinks.
Microsoft Active Directory, the widely used IT infrastructure, is known for its high risk of credential theft. The best way to test your Active Directory’s vulnerabilities to pass-the-ticket, pass-the-hash, privilege escalation, and malware attacks …

810 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question