Project

Profile

Help

Issue #3043

Race condition during orphan cleanup

Added by ttereshc about 2 years ago. Updated 6 months ago.

Status:
NEW
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Severity:
1. Low
Version:
2.8.7
Platform Release:
Blocks Release:
OS:
Backwards Incompatible:
No
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
QA Contact:
Complexity:
Smash Test:
Verified:
No
Verification Required:
No
Sprint:

Description

If you do two orphan deletes at the same time, you may hit an issue where orphan delete #1 and #2 both attempt to delete the same files. One will work, but the other will not.

Task pulp.server.managers.content.orphan.delete_all_orphans[27786f75-0b80-4b99-b705-f81686fd7a44] raised unexpected: OSError(2, 'No such file or directory')
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 473, in __call__
    return super(Task, self).__call__(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 103, in __call__
    return super(PulpTask, self).__call__(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__
    return self.run(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/pulp/server/managers/content/orphan.py", line 170, in delete_all_orphans
    OrphanManager.delete_orphans_by_type(content_type_id)
  File "/usr/lib/python2.7/site-packages/pulp/server/managers/content/orphan.py", line 241, in delete_orphans_by_type
    OrphanManager.delete_orphaned_file(storage_path)
  File "/usr/lib/python2.7/site-packages/pulp/server/managers/content/orphan.py", line 333, in delete_orphaned_file
    contents = os.listdir(path)
OSError: [Errno 2] No such file or directory: '/var/lib/pulp/content/units/rpm/c4/8c33f82219cec8781bdff6b941805a11064b5f1a68dc61f5ba4925dee153f7'

Related issues

Related to Pulp - Issue #3045: Running orphan cleanup tasks simultaniously leads to high mongod cpu usage NEW Actions

History

#1 Updated by ttereshc about 2 years ago

  • Description updated (diff)

#2 Updated by ttereshc about 2 years ago

  • Related to Issue #3045: Running orphan cleanup tasks simultaniously leads to high mongod cpu usage added

#3 Updated by amacdona@redhat.com about 2 years ago

  • Severity changed from 2. Medium to 1. Low
  • Triaged changed from No to Yes

#4 Updated by pthomas@redhat.com about 2 years ago

  • Smash Test set to 783

#5 Updated by bmbouter 6 months ago

  • Tags Pulp 2 added

Please register to edit this issue

Also available in: Atom PDF