Solved

MS Access CrossTab Query / Size Limit Problem

Posted on 2007-03-19
9
838 Views
Last Modified: 2012-06-27
Access 2000 with XP: (Will be getting Vista and Office 2007 soon)

I have an Access database with 3 tables that are joined in a query.  Each table at this time has bunches of records and lots will be added everyday.  When linked together to run a Crosstab Query, it seems to go past the 2 GB size that Access allows and will not open.

My question is which application is the next step up that can do Crosstab Querys from another query with about 100,000,000,000,000 records and is there a size limit OR can code be written in Access that will let me get the Top 100 Results from the Crosstab query without it taking forever and 2 days?

How to do this will come in later questions.
This will be awarded to the first to repsond.

Thanks
Nate
0
Comment
Question by:WonHop
  • 5
  • 4
9 Comments
 
LVL 57
ID: 18750955
Nate,

  100 Trillion records?

JimD
0
 
LVL 2

Author Comment

by:WonHop
ID: 18751311
Hello Jim.  It has been a while.  You answered some of my questions in the past.
I may have gotten a little happy with the zeros (10,000,000,000) ,but,
Yes, pretty much.  It is a permuation based on data from the last 10 years he has been in business and it will grow daily with each days input and a permution on that day along with all 13 years of data.  He needs to analyze it.
So it is going to be big.

The main thing is, Access cannot handle it.   When I opened 1 days worth of data in a query, the database size blew up to 1.66 GB.  The data is Proprietary. That is why for right now,  I am just trying to find out if there is another way to view the date in a Crosstab Query format.  From there, I will see if he wants to invest in that and me taking the time to learn it.

Nate  :0)
0
 
LVL 2

Author Comment

by:WonHop
ID: 18751343
Ignore the 13 years part.  That was something else I was thinking about.  :0)

Hello Jim.  It has been a while.  You answered some of my questions in the past.
I may have gotten a little happy with the zeros (10,000,000,000) ,but,
Yes, pretty much.  It is a permuation based on data from the last 10 years he has been in business and it will grow daily with each days input.  He needs to analyze it.
So it is going to be big.

The main thing is, Access cannot handle it.   When I opened 1 days worth of data in a query, the database size blew up to 1.66 GB.  The data is Proprietary. That is why for right now,  I am just trying to find out if there is another way to view the date in a Crosstab Query format.  From there, I will see if he wants to invest in that and me taking the time to learn it

Thanks
Nate
0
 
LVL 57
ID: 18751837

  There is nothing you can do with Access to work around this.  You'll need something heavy duty like SQL Server.

JimD
0
DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

 
LVL 2

Author Comment

by:WonHop
ID: 18751896
That is what I thought.  
Will Visual Basic work?
Will a new machine be needed to use SQL Server?
Is SQL Server hard to learn?

Thanks
Nate
0
 
LVL 57

Accepted Solution

by:
Jim Dettman (Microsoft MVP/ EE MVE) earned 500 total points
ID: 18751999
<<That is what I thought.  
Will Visual Basic work?>>

   Yes, so would Access.  SQL Server (or Oracle, MySQL, etc) would do the work and just pass the results. VB or Access would just display/report them.

<<Will a new machine be needed to use SQL Server?>>

  Possibly.  It's very hard to say.  Generally, you run SQL Server on it's own box with a couple gigs of RAM to even begin to handle something that size.

<<Is SQL Server hard to learn?>>

  Not overly so no, but it's SQL dialect is different then that of Access.   There is a service that SQL Server offers  called OLAP (Online Analitical Processing) which you might use to do this.  Hard to say without knowing a lot more.

JimD.

 
0
 
LVL 2

Author Comment

by:WonHop
ID: 18752100
Thanks Jim.
One more question.  Can tables and querys be built in those programs just like you can in Access. The GUI thingy.  You know....New Table...Add Field Names...Add data just like in Access.
0
 
LVL 57
ID: 18752885
<<One more question.  Can tables and querys be built in those programs just like you can in Access. The GUI thingy.  You know....New Table...Add Field Names...Add data just like in Access.>>

 Yup.

JimD.
0
 
LVL 2

Author Comment

by:WonHop
ID: 18756706
Thanks Jim
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

If you find yourself in this situation “I have used SELECT DISTINCT but I’m getting duplicates” then I'm sorry to say you are using the wrong SQL technique as it only does one thing which is: produces whole rows that are unique. If the results you a…
Occasionally there is a need to clean table columns, especially if you have inherited legacy data. There are obviously many ways to accomplish that, including elaborate UPDATE queries with anywhere from one to numerous REPLACE functions (even within…
This Micro Tutorial will teach you how to censor certain areas of your screen. The example in this video will show a little boy's face being blurred. This will be demonstrated using Adobe Premiere Pro CS6.
With the power of JIRA, there's an unlimited number of ways you can customize it, use it and benefit from it. With that in mind, there's bound to be things that I wasn't able to cover in this course. With this summary we'll look at some places to go…

895 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

18 Experts available now in Live!

Get 1:1 Help Now