Fix images being marked as failed after Celery restart [#5608].

Following the video transcoding work included in v0.10.0, uploading an image and
restarting Celery resulted in the image being marked as failed, even after it
had been initially successfully processed.

The issue was that the initial processing task was not being acknowledged by the task queue following the introduction of the
`CELERY_ACKS_LATE` setting. It's not clear why this is the case, but reverting
the setting fixes this issue and doesn't negatively impact video processing.
This commit is contained in:
Ben Sturmfels 2021-08-23 12:26:44 +10:00
parent 5d2eec67af
commit cfe50e6400
No known key found for this signature in database
GPG Key ID: 023C05E2C9C068F0
2 changed files with 4 additions and 1 deletions

View File

@ -49,6 +49,7 @@ This chapter has important information about our current and previous releases.
- Fix test suite on Debian 11 (Ben Sturmfels)
- Remove reference to jsonschema.compat no longer available upstream (Marco Pessotto)
- Fix images being marked as failed after Celery restart [#5608] (Ben Sturmfels)
0.11.0

View File

@ -169,7 +169,6 @@ CELERY_EAGER_PROPAGATES_EXCEPTIONS = boolean()
CELERY_IGNORE_RESULT = boolean()
CELERY_TRACK_STARTED = boolean()
CELERY_DISABLE_RATE_LIMITS = boolean()
CELERY_ACKS_LATE = boolean(default=True)
CELERY_STORE_ERRORS_EVEN_IF_IGNORED = boolean()
CELERY_SEND_TASK_ERROR_EMAILS = boolean()
CELERY_SEND_EVENTS = boolean()
@ -179,6 +178,9 @@ CELERY_REDIRECT_STDOUTS = boolean()
# known ints
CELERYD_CONCURRENCY = integer(default=1)
# Forces workes to only take one task at a time, rather than the default of
# four. This means that long-running processing tasks like videos will be
# completed sooner if you have multiple workers.
CELERYD_PREFETCH_MULTIPLIER = integer(default=1)
CELERY_AMQP_TASK_RESULT_EXPIRES = integer()
CELERY_AMQP_TASK_RESULT_CONNECTION_MAX = integer()