Project

Profile

Help

Story #106

closed

As a user, I can provide dedicated temporary storage for pulp_rpm tasks

Added by dkliban@redhat.com almost 8 years ago. Updated over 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Sprint/Milestone:
-
Start date:
Due date:
% Done:

100%

Estimated time:
Platform Release:
2.7.0
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

The platform should be able to provide a temporary directory, for similar use as the current plugin-specific working directories, in which any task can write and read transient files. The goal is that this can be host-specific, yielding much greater IO performance than a shared filesystem.

Consider naming the temporary directory with the ID of the current running task. That would make cleanup convenient, even if the standard graceful cleanup at the end of a task fails for some reason.

The path to this storage should probably be specified in our config file.

The setting for a working directory should be global (/etc/pulp/server.conf)

This story is for the updates needed to support this in the platform and ensuring that the pulp_rpm tasks are using it.

Actions #1

Updated by rbarlow almost 8 years ago

  • Project changed from Pulp to RPM Support
Actions #2

Updated by dkliban@redhat.com almost 8 years ago

  • Status changed from ASSIGNED to MODIFIED
  • % Done changed from 80 to 100
Actions #3

Updated by dkliban@redhat.com over 7 years ago

  • Platform Release set to 2.7.0
Actions #4

Updated by dkliban@redhat.com over 7 years ago

  • Status changed from MODIFIED to 5
Actions #5

Updated by dkliban@redhat.com over 7 years ago

  • Groomed set to No
  • Sprint Candidate set to No

This story has a few steps that need to be taken to verify.

1. Stop pulp_workers and pulp_resource_manager
2. run

ls -la /var/cache/pulp/

and confirm that this directory is empty.
3. Start pulp_workers and pulp_resource_manager. Run the above command again and confirm that a directory has been created for each worker and resource manager.
4. Then stop pulp_workers again.
5. Start only one worker by running

sudo systemctl start pulp_worker-0

6. run ls command for that worker's working directory. You will need to substitute proper directory name as it appears on your machine.

ls -la /var/cache/pulp/reserved_resource_worker-0@dev/

This directory should be empty.
7. In a screen session or some other terminal you can run the following watch command to monitor the changes in the workers working directory

watch -d ls -la /var/cache/pulp/reserved_resource_worker-0@dev/

8. Start a sync of a repository and watch the output of the command from step above. A directory should be created and then removed when the sync finishes.

Actions #6

Updated by pthomas@redhat.com over 7 years ago

  • Status changed from 5 to 6

verified

followed the verification steps from above

Actions #7

Updated by rbarlow almost 7 years ago

  • Status changed from 6 to CLOSED - CURRENTRELEASE
Actions #9

Updated by bmbouter over 3 years ago

  • Tags Pulp 2 added

Also available in: Atom PDF