MySQL 5.7 增强的离线分析工具innochecksum-白红宇

最近正准备写个工具来分析ibd文件中的数据分布，刚扫了下MySQL5.7的代码，发现这个功能已经在5.7.2版本中完成了；在新版本中增强了innochecksum的一些分析功能，完全可以满足我的需求

文档见：

相关代码见：

http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/5912

http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/5841

http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/5684

唯一的缺点就是：文件不可以打开！换句话说，可能需要关闭实例才能使用如下功能！！！

以下列出了几个感兴趣的命令，具体的可以参考文档！

输出ibd中总的page数：

$sudo ./innochecksum --count ../data/sbtest/sbtest1.ibdNumber of pages:8192

可以指定checksum的算法(crc32/innodb/none)：

$sudo ./innochecksum  --page=20 --strict-check=crc32  ../data/sbtest/sbtest1.ibd      Fail: page 20 invalidExceeded the maximum allowed checksum mismatch count::0

指定–no-check –write 重写无效的page checksum值，也可以为–write指定值innodb/crc32/none 来写入page中指定的值（这应该属于危险操作）

使用–page-type-summary输出各种page类型的个数：

$sudo ./innochecksum  --page-type-summary  ../data/sbtest/sbtest1.ibd File::../data/sbtest/sbtest1.ibd================PAGE TYPE SUMMARY==============#PAGE_COUNT     PAGE_TYPE===============================================    7383        Index page       0        Undo log page       1        Inode page       0        Insert buffer free list page     806        Freshly allocated page       1        Insert buffer bitmap       0        System page       0        Transaction system page       1        File Space Header       0        Extent descriptor page       0        BLOB page       0        Compressed BLOB page       0        Other type of page===============================================Additional information:Undo page type: 0 insert, 0 update, 0 otherUndo page state: 0 active, 0 cached, 0 to_free, 0 to_purge, 0 prepared, 0 other$sudo ./innochecksum  --page-type-summary  ../data/ibdata1           File::../data/ibdata1================PAGE TYPE SUMMARY==============#PAGE_COUNT     PAGE_TYPE===============================================    1028        Index page     408        Undo log page       5        Inode page     468        Insert buffer free list page  325655        Freshly allocated page       1        Insert buffer bitmap     112        System page       2        Transaction system page       1        File Space Header       0        Extent descriptor page       0        BLOB page       0        Compressed BLOB page       0        Other type of page===============================================Additional information:Undo page type: 102 insert, 306 update, 0 otherUndo page state: 0 active, 150 cached, 0 to_free, 199 to_purge, 0 prepared, 59 other

指定 –page-type-dump则将每个page的detail都输出到指定文件中

$sudo ./innochecksum --page-type-dump=a.log  ../data/sbtest/sbtest1.ibd$head -n 20 a.log Filename::../data/sbtest/sbtest1.ibd==============================================================================        PAGE_NO         |               PAGE_TYPE                       |       EXTRA INFO==============================================================================#::       0             |               File Space Header               |       -#::       1             |               Insert Buffer Bitmap            |       -#::       2             |               Inode page                      |       -#::       3             |               Index page                      |       index id=65, page level=2, No. of records=7, garbage=0, -#::       4             |               Index page                      |       index id=66, page level=1, No. of records=518, garbage=102, -#::       5             |               Index page                      |       index id=65, page level=0, No. of records=36, garbage=7696, -#::       6             |               Index page                      |       index id=65, page level=0, No. of records=73, garbage=0, -#::       7             |               Index page                      |       index id=65, page level=0, No. of records=73, garbage=0, -#::       8             |               Index page                      |       index id=65, page level=0, No. of records=73, garbage=0, -#::       9             |               Index page                      |       index id=65, page level=0, No. of records=73, garbage=0, -#::      10             |               Index page                      |       index id=65, page level=0, No. of records=73, garbage=0, -#::      11             |               Index page                      |       index id=65, page level=0, No. of records=73, garbage=0, -#::      12             |               Index page                      |       index id=65, page level=0, No. of records=73, garbage=0, -#::      13             |               Index page                      |       index id=65, page level=0, No. of records=73, garbage=0, -

指定–log输出每个page的checksum值

$sudo ./innochecksum --log=b.log  ../data/sbtest/sbtest1.ibd$head -n 10 b.log  InnoDB File Checksum Utility.Filename = ../data/sbtest/sbtest1.ibdInnochecksum: checking pages in range 0 to 8191page::0; log sequence number:first = 260537423; second = 260537423page::0; old style : calculated = 3962072366; recorded = 3962072366page::0; new style: calculated = 1038926020; crc32 = 1327342271; recorded = 1038926020page::1; log sequence number:first = 261782093; second = 261782093page::1; old style : calculated = 3860212858; recorded = 3860212858page::1; new style: calculated = 1118813775; crc32 = 142105317; recorded = 1118813775page::2; log sequence number:first = 92384856; second = 92384856

另外之前一直无法支持的压缩表checksum的问题也得到了解决，和正常的ibd文件一样解析