ERROR 1297 (HY000): Got temporary error 4010 'Node failure caused abort of transaction' from NDBCLUSTER (1 reply)

Hi. I want to delete about 200.000 rows and got this errors:

mysql> delete FROM sent WHERE data < now() - interval '60' day;
ERROR 1297 (HY000): Got temporary error 4010 'Node failure caused abort of transaction' from NDBCLUSTER

mysql> show warnings
-> ;
+-------+------+-------------------------------------------------------------------------------------+
| Level | Code | Message |
+-------+------+-------------------------------------------------------------------------------------+
| Error | 1297 | Got temporary error 4010 'Node failure caused abort of transaction' from NDB |
| Error | 1297 | Got temporary error 4010 'Node failure caused abort of transaction' from NDBCLUSTER |
| Error | 1180 | Got error 4010 during COMMIT |
+-------+------+-------------------------------------------------------------------------------------+
3 rows in set (0.00 sec)

mysql>

Also nodes crashes and all cluster goes away.

What can we do to delete about 200.000 rows without node crashes?

Also all data goes away. What can we do to restore all data?

ndb_mgm> all report memory;
Node 2: Data usage is 0%(22 32K pages of total 32000)
Node 2: Index usage is 0%(16 8K pages of total 38432)
Node 3: Data usage is 0%(22 32K pages of total 32000)
Node 3: Index usage is 0%(16 8K pages of total 38432)
[root@s4 ndb_3_fs]# ls
AUTOEXTEND_SIZE D1 D10 D11 D2 D8 D9 data_tr_free_1.dat data_tr_free_2.dat data_tr_free_3.dat LCP undo_tr_free_1.dat undo_tr_free_2.dat undo_tr_free_3.dat
[root@s4 ndb_3_fs]# du -hs .
13G .
[root@s4 ndb_3_fs]#

In Mysql error log we get this:

100930 18:27:01 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:01 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:01 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:01 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:01 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:01 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:01 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:02 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:02 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:03 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:03 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'
100930 18:27:03 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './db_name/table_name.frm'


Can we recover data? Thanks.