Project

Profile

Help

Story #6749

closed

As a core or plugin developer, i want to be able to share temporary files between the viewset and triggered tasks

Added by mdellweg almost 4 years ago. Updated over 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Category:
-
Sprint/Milestone:
Start date:
Due date:
% Done:

100%

Estimated time:
Platform Release:
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:

Description

Current Problems

  1. Deleting the temporary Artifact can cause a race condition where the second fails or no deletes occur
  2. FK exception when the Artifact being deleted already exists and is associated with other content
  3. Backups would incorrectly include both long-term Artifacts and short-term files.
  4. Security concern that these temporary files are exposed to users as Artifacts and can be associated to Content, etc

Background

Sometimes, files must be brought forward from the viewset to the executing task, that are not meant to end up being artifacts in the end. On the other hand, different pulp services are not guaranteed to share a common filesystem (like /usr/share/pulp).

Proposal

The design is to have a service that allows to create files with the same storage technology that the artifacts use, where unique names are generated, and the task to use the file has the duty to remove it again from the storage. It is necessary, that those files do neither collide with any artifact that happens to be identical, nor another such file created for a different task.

The Plan

  1. Create a new model called PulpTemporaryFile that has a pulp_id and a file.
  2. Files should be saved based on pulp_id (eg MEDIA_ROOT/tmp/files/29/beb7f3-1a70-40da-86fc-5f9006670baa)
  3. Add PulpTemporaryFile to the plugin api and add documentation

Related issues

Related to Ansible Plugin - Task #6718: Stop using artifacts when importing collectionsCLOSED - CURRENTRELEASEfao89

Actions
Related to Ansible Plugin - Issue #5666: Failed imports leave orphaned artifacts blocking subsequent attemptsCLOSED - DUPLICATEActions
Related to Pulp - Refactor #7270: NoArtifactContentUploadViewSet should use PulpTemporaryFile instead of Artifact to store temporary dataCLOSED - CURRENTRELEASElmjachky

Actions

Also available in: Atom PDF