Now we have a proplem in our system, we have multiple task per datasource, and have 125 datasources, now we found that if we rolling up log every day(just like 11-06-12:00, the log will rolling up), there are multiple task, whichmeans multiple progresses to write log, and I can’t lock the log in conf in log4j, for example:
we have 2 task which means 2 progresses to write log, now the time is 2016-11-07-00:00, before this time the 2 tasks are all write log named middmanager.log
a) observed the rolling time, rename middmanager.log to middmanager-2016-11-06.log
b) generate new log named middmanager.log.
a) observed the rolling time, find that middmanager-2016-11-06.log exists, delete the middmanager-2016-11-06.log(so we lost all the log in 2016-11-06), rename middmanager.log to middmanager-2016-11-06.log. generate new log named middmanager.log.
b) now because Task A has the new middmanager-2016-11-06.log’s file handle, so it will write to middmanager-2016-11-06.log util this task finish, so we found that the history log only has one task’s life cycle time.
Can some help us? if we can solve this problem through change conf?
if this is the issue in druid, we can change the source code and propose a pull request.
Thanks all, hope your reply.