We're testing the performance of our following MySQL Cluster setup with apache benchmark:
1 management node (12gb ram, i7 quadcore 2.88ghz each core, 2x 1500gb hdd)
4 mysql nodes (12gb ram, i7 quadcore 2.88ghz each core, 2x 1500gb hdd)
6 data nodes (24gb ram, i7 quadcore 2.88ghz each core, 3x 1500gb hdd)
From the config side we tested with different settings like max connection pool, max threads and max connections. The bandwidth of each server is 1 gbit/s. We tested our cluster with a php script doing simple inserts with concurrent inserts=2 and could now just archieve the best value of about 15000 concurrent inserts. I'm very curious about finding the bottleneck, but neither the cpu usage (under 10%), nor the memory (about 5gb on data nodes), disk IO and network usage was high. So, does anyone have any ideas about where the bottlenecks could be? When we tested the same thing with a mysql replication master slave setup (with MyISAM on it) we could archieve already 10000 concurrent inserts on just 1 db server! Also the bottleneck should not be on the php side as we tried to ab with several web servers with nginx setup and the mysql cluster always had a extremly increased latency.
1 management node (12gb ram, i7 quadcore 2.88ghz each core, 2x 1500gb hdd)
4 mysql nodes (12gb ram, i7 quadcore 2.88ghz each core, 2x 1500gb hdd)
6 data nodes (24gb ram, i7 quadcore 2.88ghz each core, 3x 1500gb hdd)
From the config side we tested with different settings like max connection pool, max threads and max connections. The bandwidth of each server is 1 gbit/s. We tested our cluster with a php script doing simple inserts with concurrent inserts=2 and could now just archieve the best value of about 15000 concurrent inserts. I'm very curious about finding the bottleneck, but neither the cpu usage (under 10%), nor the memory (about 5gb on data nodes), disk IO and network usage was high. So, does anyone have any ideas about where the bottlenecks could be? When we tested the same thing with a mysql replication master slave setup (with MyISAM on it) we could archieve already 10000 concurrent inserts on just 1 db server! Also the bottleneck should not be on the php side as we tried to ab with several web servers with nginx setup and the mysql cluster always had a extremly increased latency.