开发者

Python MySQLdb LOAD LOCAL INFILE problems

开发者 https://www.devze.com 2023-01-01 11:35 出处:网络
The problem is a simple one. When I execute the following I开发者_JAVA技巧 get different results depending on whether I run it from the MySQL console and from inside a Python Script using MySQLdb:

The problem is a simple one. When I execute the following I开发者_JAVA技巧 get different results depending on whether I run it from the MySQL console and from inside a Python Script using MySQLdb:

LOAD DATA LOCAL INFILE '/tmp/source.csv' INTO TABLE test 
FIELDS TERMINATED BY '|' 
IGNORE 1 LINES;

Console gives the following results:

  • Records: 35002 Deleted: 0 Skipped: 0 Warnings: 0

Python (via .info()) returns the following:

  • Records: 34977 Deleted: 0 Skipped: 0 Warnings: 8

So in summary, same source file, same SQL request, different results.

From the console I can 'SHOW WARNINGS' an get a better handle on which records are causing the problems and why but from Python I can't idenitify how to do this or more importantly what the cause of the problem could be.

Any suggestions?

  • MySQL Server '5.1.41-3ubuntu12.1'
  • Python '2.6.5'
  • Tables are MyISAM


After loading the data, execute

SELECT @@warning_count;

check if greater than 0. If it is than execute

SHOW WARNINGS;

and dump the result (returns 3 columns: Level, Code, Message) or throw an exception. You can execute both statements exactly like every other select * from ... query.

0

精彩评论

暂无评论...
验证码 换一张
取 消