Logging supervisor's child process logs

[donny-wong]

Description:

We want to have logging for supervisor's child process logs for both stderr and stdout. These logs will be stored under the folder supervisor_child_log. I have set the log file rotation to a file size of 1MB with 10 backups. e.g.:

stdout_logfile_maxbytes=1MB
stdout_logfile_backups=10
stderr_logfile_maxbytes=1MB
stderr_logfile_backups=10

Here is a screenshot of how it looks like on my local server's workspace docker volume in regards to the generated log files:

[david-yz-liu]

@donny-wong you're on the right track, but you need to make this a configurable option rather than a hard-coded path.

In development, you should store this in the server's workspace docker volume. This means the log files won't appear locally, but they will appear inside the docker container.

[donny-wong]

@donny-wong you're on the right track, but you need to make this a configurable option rather than a hard-coded path.

In development, you should store this in the server's workspace docker volume. This means the log files won't appear locally, but they will appear inside the docker container.

Thank you @david-yz-liu, will do.

[david-yz-liu]

Hi @donny-wong, okay this is good. Two overall comments:

1. When adding a new setting, it should also be documented in the README
2. Please change the name "supervisor child log" to the more precise worker_log_dir. This makes it clear that these are logs for the workers (the name we use elsewhere in the application), and that it is a directory rather than a single file.