Task #2971: enable celery workers to log at levels below WARN - Pulp

Send by e-mail

Task #2971

enable celery workers to log at levels below WARN

Added by mhrivnak almost 3 years ago. Updated about 1 year ago.

Status:

CLOSED - WONTFIX

Priority:

Normal

Assignee:

Category:

Sprint/Milestone:

3.0.0

Start date:

Due date:

% Done:

Platform Release:

Blocks Release:

Backwards Incompatible:

Groomed:

Sprint Candidate:

Tags:

QA Contact:

Complexity:

Smash Test:

Verified:

Verification Required:

Sprint:

Description

Celery workers set their own log level somehow. You can supply one via a celery setting, either on the command line or as an environment variable.

http://docs.celeryproject.org/en/v4.1.0/reference/celery.bin.worker.html#cmdoption-celery-worker-l

It defaults to WARN. I was able to get the workers to log at info by adding "--loglevel=INFO" to the worker unit file. That is probably not the best approach though. It is desirable to have a setting that can enable DEBUG logging across all of Pulp or not.

I think in Pulp 2 there was a mechanism for overriding whatever log level celery set, but I'm not entirely sure. This task is to figure out a reasonable approach for setting the log level across pulp and to make it happen.

Hide closed

Checklist

Figure out a reasonable way to set the log level across Pulp services.
Make it so.
Set the default level to INFO.

Related issues

History

#1 Updated by bizhang almost 3 years ago

There is a celery setting to stop it from hijacking the root logger: http://docs.celeryproject.org/en/master/userguide/configuration.html#worker-hijack-root-logger

#2 Updated by bizhang almost 3 years ago

Another issue is that celery does no use the provided formatter when it hijacks logging.
Because of this I would recommend we stop celery from hijacking the root logger instead of re-configuring celery logging with the correct formatter in addition to the correct log level.