Solved

MySql server Win7 32, ODBC connector causing large tables to crash ODBC connector

Posted on 2012-12-25
21
882 Views
Last Modified: 2013-04-22
Say, MySQL server, version: 5.5.29 is running on Win7 32 Bit OS.
Connecting from MSAccess using current 32 bit ODBC driver mysql-connector-odbc-5.2.2-win32
On small tables works fine, but on large ones,the ODBC  driver crashes. It is on an append query.
Pls help!
0
Comment
Question by:shaunwingin
  • 11
  • 6
  • 4
21 Comments
 
LVL 142

Expert Comment

by:Guy Hengel [angelIII / a3]
ID: 38720197
does the table have a primary key field?
especially for append operations this should work fine, at least I could work just fine even on large tables (10 million rows) ...

now, what do you call "large" tables?
what type of tables? MyISAM, InnoDB, something else?
0
 

Author Comment

by:shaunwingin
ID: 38720240
The Source table doesn't have a primary key but the destination table does. Its the autonum.
If we append a table of say 3000 records it works fine. A table of say 70,000 records causes the ODBC to crash.
They are linked ODBC tables  using the above odbc driver and created in MS Access 2000
As for MyISAM, InnoDB
Please explain the difference. I just created the tables in MSACCESS, exported the to MySQL and linked them back, as it was easier to use the graphical interface in MSAccess
0
 
LVL 25

Assisted Solution

by:Tomas Helgi Johannsson
Tomas Helgi Johannsson earned 334 total points
ID: 38720241
Hi!

If you are querying very large tables or inserting/updating large records  you will have to either
limit your result set to some smaller result using some good column values or the limit keyword
http://dev.mysql.com/doc/refman/5.5/en/select.html
http://dev.mysql.com/doc/refman/5.5/en/limit-optimization.html

or change the size of the client/server packet size (max_allowed_packet) to a suitable size.
http://dev.mysql.com/doc/refman/5.5/en/packet-too-large.html
http://dev.mysql.com/doc/refman/5.5/en/server-system-variables.html#sysvar_max_allowed_packet

In your case I would go for the max_allowed_packet. :)

Regards,
     Tomas Helgi
0
 

Author Comment

by:shaunwingin
ID: 38720257
Pls reply to my post too
0
 
LVL 142

Expert Comment

by:Guy Hengel [angelIII / a3]
ID: 38720262
>As for MyISAM, InnoDB
>Please explain the difference.
it's the table storage engines:
http://dev.mysql.com/doc/refman/5.1/en/storage-engines.html
it may impact the performance ...
0
 

Author Comment

by:shaunwingin
ID: 38720386
tables stored as MYISAM
Set max_allowed_packet to 16M and same error...
0
 
LVL 25

Expert Comment

by:Tomas Helgi Johannsson
ID: 38720390
Try increasing it to 32M or 64M.
Also you have to set max_allowed_packet into the my.cnf file and restart the database.
Can you post the error you are getting?

Regards,
   Tomas Helgi
0
 

Author Comment

by:shaunwingin
ID: 38720394
and 32M
max_allowed_packet = 32M
The size of the table being appended is a 2Meg Text file imported to a table  and the table to which it is appended is about 800Meg
0
 

Author Comment

by:shaunwingin
ID: 38721174
Unfortunately access just returns a general error with inserting table - no specific error no.
A clue to solution. When I was using the older version 3 ODBC driver and had the database stored in a Linux MySql server this problem did not exist.
Is there a way I can run the query from within MySql & call it from MSaccess? I will have to pass a single parameter to the query. I need a simple insert query.
0
 
LVL 142

Assisted Solution

by:Guy Hengel [angelIII / a3]
Guy Hengel [angelIII / a3] earned 166 total points
ID: 38721423
you might want to check out toad for MySQL ...
I use that often, and it's quite nice to run sql directly on MySQL.
note the same GUI as ms accesss, but still very useful and powerful
http://www.toadworld.com/Downloads/ToadforMySQLFreeware/tabid/561/Default.aspx
0
Comprehensive Backup Solutions for Microsoft

Acronis protects the complete Microsoft technology stack: Windows Server, Windows PC, laptop and Surface data; Microsoft business applications; Microsoft Hyper-V; Azure VMs; Microsoft Windows Server 2016; Microsoft Exchange 2016 and SQL Server 2016.

 

Author Comment

by:shaunwingin
ID: 38722183
I need an automated system for MSAccess to process the queries ...
0
 
LVL 142

Expert Comment

by:Guy Hengel [angelIII / a3]
ID: 38722798
to automate SQL queries, you don't need ms access.
you can scheduled SQL scripts with MySQL easily also:
http://dev.mysql.com/doc/refman/5.1/en/events-overview.html

and if it's based on human input (button click), you could code it all inside a stored procedure, and just run that one ...
0
 

Author Comment

by:shaunwingin
ID: 38732603
But how would I call the MYSQL query from within Access VB
0
 
LVL 25

Expert Comment

by:Tomas Helgi Johannsson
ID: 38732622
Hi!

If you are inserting into a MySQL table  from Access you will need to first create a Linked Table through the MySQL ODBC driver and then you can use the ADO Insert method in the VB.
Same goes for  any other database table.

Regards,
     Tomas Helgi
0
 
LVL 142

Expert Comment

by:Guy Hengel [angelIII / a3]
ID: 38732693
0
 

Author Comment

by:shaunwingin
ID: 38732702
I want to call a stored Query from Access
0
 
LVL 142

Expert Comment

by:Guy Hengel [angelIII / a3]
ID: 38732749
what kind of stored query?
you can translate them into the mysql corresponding code, which will then run on the mysql server, running better...
0
 

Author Comment

by:shaunwingin
ID: 38733226
Want to sort out queries failing for large tables....
Btw, tried
max_allowed_packet. of 128M
Same error
0
 

Author Comment

by:shaunwingin
ID: 38733286
Exact error in Access: 3155 ODBC -- insert on linked table 'name' failed
0
 
LVL 25

Accepted Solution

by:
Tomas Helgi Johannsson earned 334 total points
ID: 38733575
The error can be one of these
http://office.microsoft.com/en-us/access-help/HV080760716.aspx
http://blog.nkadesign.com/2009/access-run-time-error-3155-odbc-insert-on-a-linked-table-failed/
http://stackoverflow.com/questions/11315678/error-3155-odbc-insert-on-a-linked-table-sample-failed

Does your user that open a connect to the linked table have sufficient rights to the database and all the  tables involved ?

Regards,
     Tomas Helgi
0
 

Author Comment

by:shaunwingin
ID: 38733591
Yes, It only fails on big tables- see above please
0

Featured Post

Microsoft Certification Exam 74-409

Veeam® is happy to provide the Microsoft community with a study guide prepared by MVP and MCT, Orin Thomas. This guide will take you through each of the exam objectives, helping you to prepare for and pass the examination.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

The first two articles in this short series — Using a Criteria Form to Filter Records (http://www.experts-exchange.com/A_6069.html) and Building a Custom Filter (http://www.experts-exchange.com/A_6070.html) — discuss in some detail how a form can be…
Load balancing is the method of dividing the total amount of work performed by one computer between two or more computers. Its aim is to get more work done in the same amount of time, ensuring that all the users get served faster.
Basics of query design. Shows you how to construct a simple query by adding tables, perform joins, defining output columns, perform sorting, and apply criteria.
With Microsoft Access, learn how to specify relationships between tables and set various options on the relationship. Add the tables: Create the relationship: Decide if you’re going to set referential integrity: Decide if you want cascade upda…

867 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

14 Experts available now in Live!

Get 1:1 Help Now