Project

Profile

Help

Story #3176

As a user, reserved work is not blocked by non-reserved work

Added by bmbouter almost 2 years ago. Updated 6 months ago.

Status:
NEW
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
% Done:

0%

Platform Release:
Blocks Release:
Backwards Incompatible:
No
Groomed:
Yes
Sprint Candidate:
No
Tags:
QA Contact:
Complexity:
Smash Test:
Verified:
No
Verification Required:
No
Sprint:

Description

Problem

Say you have 4 workers and sync 10 things. 4 sync's start and 6 are still in the resource manager waiting for a worker to become free. Then the user submits a non-reserved task like orphan cleanup. This task immediately flows through the celery queue and is handed to one of the 4 workers who will work on it after handling the current sync. Then the resource manager assigns more work to free workers and one or more sync tasks could be stuck behind the orphan cleanup task.

Idea

Have all work flow through the resource_manager queue and have nothing flow through the celery queue. In fact have the workers stop consuming from the celery queue.

Design

Have tasks that current don't get a reservation, get a reservation that locks on a random uuid. This will cause the resource manager to not assign more work to a worker handling a task like an orphan cleanup.

Also get the workers to stop listening to the celery queue. There should be no ability to send work to the workers outside of the dedicated queues.

History

#1 Updated by dkliban@redhat.com almost 2 years ago

  • Groomed changed from No to Yes

#2 Updated by daviddavis almost 2 years ago

  • Sprint/Milestone set to 52

#3 Updated by rchan almost 2 years ago

  • Sprint/Milestone changed from 52 to 53

#4 Updated by jortel@redhat.com over 1 year ago

  • Sprint/Milestone changed from 53 to 54

#5 Updated by jortel@redhat.com over 1 year ago

  • Sprint/Milestone deleted (54)

#6 Updated by bmbouter over 1 year ago

  • Sprint Candidate changed from Yes to No

This is a good idea, but for time and priority reasons relative to other beta work, I'm not nominating it for a sprint anymore.

#7 Updated by bmbouter 6 months ago

  • Tags deleted (Pulp 3)

Please register to edit this issue

Also available in: Atom PDF