How to load large files safely into InnoDB with LOAD DATA INFILE

Recently I had a customer ask me about loading two huge files into InnoDB with LOAD DATA INFILE. The goal was to load this data on many servers without putting it into the binary log. While this is generally a fast way to load data (especially if you disable unique key checks and foreign key checks), I recommended against this. There are several problems with the very large transaction caused by t

[Hash]

high performance mysqlのひと

[masa_matya]

InnoDBで大容量のファイルをLOADする時、UNDOログの生成などによりI/O性能が劣化。大容量を一度にCOMMTせずに小さく分けたファイルで大量のCOMMITをすることでそれを回避

[ono_matope]

ファイルを分割せずにLOAD DATA INFILEのトランザクションを細分化する方法。FIFOを使う。っていうかMaakitスクリプトってこのブログの人のだったのか…