Solved

MS Access CrossTab Query / Size Limit Problem

Posted on 2007-03-19
9
827 Views
Last Modified: 2012-06-27
Access 2000 with XP: (Will be getting Vista and Office 2007 soon)

I have an Access database with 3 tables that are joined in a query.  Each table at this time has bunches of records and lots will be added everyday.  When linked together to run a Crosstab Query, it seems to go past the 2 GB size that Access allows and will not open.

My question is which application is the next step up that can do Crosstab Querys from another query with about 100,000,000,000,000 records and is there a size limit OR can code be written in Access that will let me get the Top 100 Results from the Crosstab query without it taking forever and 2 days?

How to do this will come in later questions.
This will be awarded to the first to repsond.

Thanks
Nate
0
Comment
Question by:WonHop
  • 5
  • 4
9 Comments
 
LVL 57

Expert Comment

by:Jim Dettman (Microsoft MVP/ EE MVE)
Comment Utility
Nate,

  100 Trillion records?

JimD
0
 
LVL 2

Author Comment

by:WonHop
Comment Utility
Hello Jim.  It has been a while.  You answered some of my questions in the past.
I may have gotten a little happy with the zeros (10,000,000,000) ,but,
Yes, pretty much.  It is a permuation based on data from the last 10 years he has been in business and it will grow daily with each days input and a permution on that day along with all 13 years of data.  He needs to analyze it.
So it is going to be big.

The main thing is, Access cannot handle it.   When I opened 1 days worth of data in a query, the database size blew up to 1.66 GB.  The data is Proprietary. That is why for right now,  I am just trying to find out if there is another way to view the date in a Crosstab Query format.  From there, I will see if he wants to invest in that and me taking the time to learn it.

Nate  :0)
0
 
LVL 2

Author Comment

by:WonHop
Comment Utility
Ignore the 13 years part.  That was something else I was thinking about.  :0)

Hello Jim.  It has been a while.  You answered some of my questions in the past.
I may have gotten a little happy with the zeros (10,000,000,000) ,but,
Yes, pretty much.  It is a permuation based on data from the last 10 years he has been in business and it will grow daily with each days input.  He needs to analyze it.
So it is going to be big.

The main thing is, Access cannot handle it.   When I opened 1 days worth of data in a query, the database size blew up to 1.66 GB.  The data is Proprietary. That is why for right now,  I am just trying to find out if there is another way to view the date in a Crosstab Query format.  From there, I will see if he wants to invest in that and me taking the time to learn it

Thanks
Nate
0
 
LVL 57

Expert Comment

by:Jim Dettman (Microsoft MVP/ EE MVE)
Comment Utility

  There is nothing you can do with Access to work around this.  You'll need something heavy duty like SQL Server.

JimD
0
How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

 
LVL 2

Author Comment

by:WonHop
Comment Utility
That is what I thought.  
Will Visual Basic work?
Will a new machine be needed to use SQL Server?
Is SQL Server hard to learn?

Thanks
Nate
0
 
LVL 57

Accepted Solution

by:
Jim Dettman (Microsoft MVP/ EE MVE) earned 500 total points
Comment Utility
<<That is what I thought.  
Will Visual Basic work?>>

   Yes, so would Access.  SQL Server (or Oracle, MySQL, etc) would do the work and just pass the results. VB or Access would just display/report them.

<<Will a new machine be needed to use SQL Server?>>

  Possibly.  It's very hard to say.  Generally, you run SQL Server on it's own box with a couple gigs of RAM to even begin to handle something that size.

<<Is SQL Server hard to learn?>>

  Not overly so no, but it's SQL dialect is different then that of Access.   There is a service that SQL Server offers  called OLAP (Online Analitical Processing) which you might use to do this.  Hard to say without knowing a lot more.

JimD.

 
0
 
LVL 2

Author Comment

by:WonHop
Comment Utility
Thanks Jim.
One more question.  Can tables and querys be built in those programs just like you can in Access. The GUI thingy.  You know....New Table...Add Field Names...Add data just like in Access.
0
 
LVL 57

Expert Comment

by:Jim Dettman (Microsoft MVP/ EE MVE)
Comment Utility
<<One more question.  Can tables and querys be built in those programs just like you can in Access. The GUI thingy.  You know....New Table...Add Field Names...Add data just like in Access.>>

 Yup.

JimD.
0
 
LVL 2

Author Comment

by:WonHop
Comment Utility
Thanks Jim
0

Featured Post

What Security Threats Are You Missing?

Enhance your security with threat intelligence from the web. Get trending threat insights on hackers, exploits, and suspicious IP addresses delivered to your inbox with our free Cyber Daily.

Join & Write a Comment

In database programming, custom sort order seems to be necessary quite often, at least in my experience and time here at EE. Within the realm of custom sorting is the sorting of numbers and text independently (i.e., treating the numbers as number…
Occasionally there is a need to clean table columns, especially if you have inherited legacy data. There are obviously many ways to accomplish that, including elaborate UPDATE queries with anywhere from one to numerous REPLACE functions (even within…
In this seventh video of the Xpdf series, we discuss and demonstrate the PDFfonts utility, which lists all the fonts used in a PDF file. It does this via a command line interface, making it suitable for use in programs, scripts, batch files — any pl…
Here's a very brief overview of the methods PRTG Network Monitor (https://www.paessler.com/prtg) offers for monitoring bandwidth, to help you decide which methods you´d like to investigate in more detail.  The methods are covered in more detail in o…

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

9 Experts available now in Live!

Get 1:1 Help Now