dear all:
My Cluster data node can't startup. It will be terminated after about 1
min.
I don't know what happened and what i can do.
pls help me and give me some suggestion.
thanks very much.
the version is below:
ndb_mgm> show
Cluster Configuration
---------------------
[ndbd(NDB)] 2 node(s)
id=3 @127.0.0.1 (mysql-5.5.25 ndb-7.2.7, starting, Nodegroup: 0)
id=4 (not connected, accepting connect from localhost)
[ndb_mgmd(MGM)] 1 node(s)
id=1 @127.0.0.1 (mysql-5.5.25 ndb-7.2.7)
[mysqld(API)] 1 node(s)
id=50 (not connected, accepting connect from any host)
here is the log:
2012-09-05 15:13:34 [MgmtSrvr] INFO -- Nodeid 3 allocated for NDB at 127.0.0.1
2012-09-05 15:13:34 [MgmtSrvr] INFO -- Node 1: Node 3 Connected
2012-09-05 15:13:37 [MgmtSrvr] INFO -- Node 3: Start phase 0 completed
2012-09-05 15:13:37 [MgmtSrvr] INFO -- Node 3: Communication to Node 4 opened
2012-09-05 15:13:37 [MgmtSrvr] INFO -- Node 3: Waiting 30 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:39 [MgmtSrvr] INFO -- Node 3: Waiting 28 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:42 [MgmtSrvr] INFO -- Node 3: Waiting 25 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:45 [MgmtSrvr] INFO -- Node 3: Waiting 22 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:48 [MgmtSrvr] INFO -- Node 3: Waiting 19 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:51 [MgmtSrvr] INFO -- Node 3: Waiting 16 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:54 [MgmtSrvr] INFO -- Node 3: Waiting 13 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:57 [MgmtSrvr] INFO -- Node 3: Waiting 10 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:14:00 [MgmtSrvr] INFO -- Node 3: Waiting 7 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:14:03 [MgmtSrvr] INFO -- Node 3: Waiting 4 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:14:06 [MgmtSrvr] INFO -- Node 3: Waiting 1 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:14:09 [MgmtSrvr] INFO -- Node 3: Waiting 58 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:12 [MgmtSrvr] INFO -- Node 3: Waiting 55 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:15 [MgmtSrvr] INFO -- Node 3: Waiting 52 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:18 [MgmtSrvr] INFO -- Node 3: Waiting 49 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:21 [MgmtSrvr] INFO -- Node 3: Waiting 46 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:24 [MgmtSrvr] INFO -- Node 3: Waiting 43 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:27 [MgmtSrvr] INFO -- Node 3: Waiting 40 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:30 [MgmtSrvr] INFO -- Node 3: Waiting 37 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:33 [MgmtSrvr] INFO -- Node 3: Waiting 34 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:36 [MgmtSrvr] INFO -- Node 3: Waiting 31 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:39 [MgmtSrvr] INFO -- Node 3: Waiting 28 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:42 [MgmtSrvr] INFO -- Node 3: Waiting 25 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:45 [MgmtSrvr] INFO -- Node 3: Waiting 22 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:48 [MgmtSrvr] INFO -- Node 3: Waiting 19 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:51 [MgmtSrvr] INFO -- Node 3: Waiting 16 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:54 [MgmtSrvr] INFO -- Node 3: Waiting 13 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:57 [MgmtSrvr] INFO -- Node 3: Waiting 10 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:15:00 [MgmtSrvr] INFO -- Node 3: Waiting 7 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:15:03 [MgmtSrvr] INFO -- Node 3: Waiting 4 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:15:06 [MgmtSrvr] INFO -- Node 3: Waiting 1 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start potentially partitioned with nodes 3 [ missing: 4 no-wait: ]
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: CM_REGCONF president = 3, own Node = 3, our dynamic id = 0/1
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start phase 1 completed
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start phase 2 completed (system restart)
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start phase 3 completed (system restart)
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Restarting cluster to GCI: 262
2012-09-05 15:15:10 [MgmtSrvr] INFO -- Node 3: Starting to restore schema
2012-09-05 15:15:10 [MgmtSrvr] ALERT -- Node 3: Forced node shutdown completed. Occured during startphase 4. Caused by error 2355: 'Failure to restore schema(Resource configuration error). Permanent error, external action needed'.
2012-09-05 15:15:10 [MgmtSrvr] ALERT -- Node 1: Node 3 Disconnected
config.ini
[ndb_mgmd]
hostname=localhost
datadir=/state/partition1/cluster_data/ndb_data
NodeId=1
[ndbd default]
noofreplicas=2
datadir=/state/partition1/cluster_data/ndb_data
DataMemory: 4000M
IndexMemory: 500M
MaxNoOfConcurrentTransactions:4096
MaxNoOfConcurrentOperations:500000
MaxNoOfLocalOperations:550000
MaxNoOfAttributes: 10000
MaxNoOfTables: 3000
MaxNoOfOrderedIndexes: 3000
MaxNoOfUniqueHashIndexes: 3000
MaxNoOfTriggers: 500
TransactionDeadlockDetectionTimeout: 60000
[ndbd]
hostname=localhost
NodeId=3
[ndbd]
hostname=localhost
NodeId=4
[mysqld]
NodeId=50
My Cluster data node can't startup. It will be terminated after about 1
min.
I don't know what happened and what i can do.
pls help me and give me some suggestion.
thanks very much.
the version is below:
ndb_mgm> show
Cluster Configuration
---------------------
[ndbd(NDB)] 2 node(s)
id=3 @127.0.0.1 (mysql-5.5.25 ndb-7.2.7, starting, Nodegroup: 0)
id=4 (not connected, accepting connect from localhost)
[ndb_mgmd(MGM)] 1 node(s)
id=1 @127.0.0.1 (mysql-5.5.25 ndb-7.2.7)
[mysqld(API)] 1 node(s)
id=50 (not connected, accepting connect from any host)
here is the log:
2012-09-05 15:13:34 [MgmtSrvr] INFO -- Nodeid 3 allocated for NDB at 127.0.0.1
2012-09-05 15:13:34 [MgmtSrvr] INFO -- Node 1: Node 3 Connected
2012-09-05 15:13:37 [MgmtSrvr] INFO -- Node 3: Start phase 0 completed
2012-09-05 15:13:37 [MgmtSrvr] INFO -- Node 3: Communication to Node 4 opened
2012-09-05 15:13:37 [MgmtSrvr] INFO -- Node 3: Waiting 30 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:39 [MgmtSrvr] INFO -- Node 3: Waiting 28 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:42 [MgmtSrvr] INFO -- Node 3: Waiting 25 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:45 [MgmtSrvr] INFO -- Node 3: Waiting 22 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:48 [MgmtSrvr] INFO -- Node 3: Waiting 19 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:51 [MgmtSrvr] INFO -- Node 3: Waiting 16 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:54 [MgmtSrvr] INFO -- Node 3: Waiting 13 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:13:57 [MgmtSrvr] INFO -- Node 3: Waiting 10 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:14:00 [MgmtSrvr] INFO -- Node 3: Waiting 7 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:14:03 [MgmtSrvr] INFO -- Node 3: Waiting 4 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:14:06 [MgmtSrvr] INFO -- Node 3: Waiting 1 sec for nodes 4 to connect, nodes [ all: 3 and 4 connected: 3 no-wait: ]
2012-09-05 15:14:09 [MgmtSrvr] INFO -- Node 3: Waiting 58 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:12 [MgmtSrvr] INFO -- Node 3: Waiting 55 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:15 [MgmtSrvr] INFO -- Node 3: Waiting 52 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:18 [MgmtSrvr] INFO -- Node 3: Waiting 49 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:21 [MgmtSrvr] INFO -- Node 3: Waiting 46 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:24 [MgmtSrvr] INFO -- Node 3: Waiting 43 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:27 [MgmtSrvr] INFO -- Node 3: Waiting 40 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:30 [MgmtSrvr] INFO -- Node 3: Waiting 37 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:33 [MgmtSrvr] INFO -- Node 3: Waiting 34 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:36 [MgmtSrvr] INFO -- Node 3: Waiting 31 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:39 [MgmtSrvr] INFO -- Node 3: Waiting 28 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:42 [MgmtSrvr] INFO -- Node 3: Waiting 25 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:45 [MgmtSrvr] INFO -- Node 3: Waiting 22 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:48 [MgmtSrvr] INFO -- Node 3: Waiting 19 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:51 [MgmtSrvr] INFO -- Node 3: Waiting 16 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:54 [MgmtSrvr] INFO -- Node 3: Waiting 13 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:14:57 [MgmtSrvr] INFO -- Node 3: Waiting 10 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:15:00 [MgmtSrvr] INFO -- Node 3: Waiting 7 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:15:03 [MgmtSrvr] INFO -- Node 3: Waiting 4 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:15:06 [MgmtSrvr] INFO -- Node 3: Waiting 1 sec for non partitioned start, nodes [ all: 3 and 4 connected: 3 missing: 4 no-wait: ]
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start potentially partitioned with nodes 3 [ missing: 4 no-wait: ]
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: CM_REGCONF president = 3, own Node = 3, our dynamic id = 0/1
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start phase 1 completed
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start phase 2 completed (system restart)
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Start phase 3 completed (system restart)
2012-09-05 15:15:09 [MgmtSrvr] INFO -- Node 3: Restarting cluster to GCI: 262
2012-09-05 15:15:10 [MgmtSrvr] INFO -- Node 3: Starting to restore schema
2012-09-05 15:15:10 [MgmtSrvr] ALERT -- Node 3: Forced node shutdown completed. Occured during startphase 4. Caused by error 2355: 'Failure to restore schema(Resource configuration error). Permanent error, external action needed'.
2012-09-05 15:15:10 [MgmtSrvr] ALERT -- Node 1: Node 3 Disconnected
config.ini
[ndb_mgmd]
hostname=localhost
datadir=/state/partition1/cluster_data/ndb_data
NodeId=1
[ndbd default]
noofreplicas=2
datadir=/state/partition1/cluster_data/ndb_data
DataMemory: 4000M
IndexMemory: 500M
MaxNoOfConcurrentTransactions:4096
MaxNoOfConcurrentOperations:500000
MaxNoOfLocalOperations:550000
MaxNoOfAttributes: 10000
MaxNoOfTables: 3000
MaxNoOfOrderedIndexes: 3000
MaxNoOfUniqueHashIndexes: 3000
MaxNoOfTriggers: 500
TransactionDeadlockDetectionTimeout: 60000
[ndbd]
hostname=localhost
NodeId=3
[ndbd]
hostname=localhost
NodeId=4
[mysqld]
NodeId=50