Re: [druid-user] Re: Batch injestion with multiple subtasks is failing on random nodes

I see some closed socket connection messages. found some ref that they are normal but some say the zookeeper is heavily loaded.

2021-10-01T15:56:46,347 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] org.apache.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /172.29.45.120:33358
2021-10-01T15:56:46,349 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] org.apache.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /172.29.45.120:33358
2021-10-01T15:56:46,350 INFO [SyncThread:0] org.apache.zookeeper.server.ZooKeeperServer - Established session 0x100530b55900361 with negotiated timeout 30000 for client /172.29.45.120:33358
2021-10-01T15:57:55,366 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] org.apache.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /172.29.44.99:39036
2021-10-01T15:57:55,368 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] org.apache.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /172.29.44.99:39036
2021-10-01T15:57:55,369 INFO [SyncThread:0] org.apache.zookeeper.server.ZooKeeperServer - Established session 0x100530b55900362 with negotiated timeout 30000 for client /172.29.44.99:39036
2021-10-01T15:58:39,552 INFO [ProcessThread(sid:0 cport:2181):] org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x100530b5590035e
2021-10-01T15:58:39,552 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /172.29.45.127:38768 which had sessionid 0x100530b5590035e
2021-10-01T15:59:01,630 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] org.apache.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /172.29.45.127:39330
2021-10-01T15:59:01,632 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] org.apache.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /172.29.45.127:39330
2021-10-01T15:59:01,633 INFO [SyncThread:0] org.apache.zookeeper.server.ZooKeeperServer - Established session 0x100530b55900363 with negotiated timeout 30000 for client /172.29.45.127:39330
2021-10-01T15:59:41,789 INFO [PurgeTask] org.apache.zookeeper.server.DatadirCleanupManager - Purge task started.
2021-10-01T15:59:41,790 INFO [PurgeTask] org.apache.zookeeper.server.DatadirCleanupManager - Purge task completed.
2021-10-01T16:14:09,525 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] org.apache.zookeeper.server.NIOServerCnxnFactory - Accepted socket connection from /172.29.45.126:40702
2021-10-01T16:14:09,527 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] org.apache.zookeeper.server.ZooKeeperServer - Client attempting to establish new session at /172.29.45.126:40702
2021-10-01T16:14:09,528 INFO [SyncThread:0] org.apache.zookeeper.server.ZooKeeperServer - Established session 0x100530b55900364 with negotiated timeout 30000 for client /172.29.45.126:40702
2021-10-01T16:16:02,044 INFO [ProcessThread(sid:0 cport:2181):] org.apache.zookeeper.server.PrepRequestProcessor - Processed session termination for sessionid: 0x100530b55900363
2021-10-01T16:16:02,045 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181] org.apache.zookeeper.server.NIOServerCnxn - Closed socket connection for client /172.29.45.127:39330 which had sessionid 0x100530b55900363