Project

Profile

Help

Task #1601

closed

Migrate /var/lib/pulp/content to new 2.8 storage paths.

Added by jortel@redhat.com about 8 years ago. Updated about 5 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
% Done:

100%

Estimated time:
(Total: 0:00 h)
Platform Release:
2.8.3
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Sprint 1
Quarter:

Description

See: https://pulp.plan.io/issues/1600

To make /var/lib/pulp/content/ consistent, we need to write some a migration.

The migration needs to:

  • update the _storage_path on content units to use the new 2.8 directory structure.
  • move the file to the new location.
  • update symlinks to point to the new file location.

Sub-issues 5 (0 open5 closed)

Task #1815: Create a common 2.8 storage path migration to be used by pluginsCLOSED - CURRENTRELEASEjortel@redhat.com

Actions
RPM Support - Task #1816: Add migration - content units to standard storage path.CLOSED - CURRENTRELEASEjortel@redhat.com

Actions
Puppet Support - Task #1817: Add migration - content units to standard storage path.CLOSED - CURRENTRELEASEjortel@redhat.com

Actions
Docker Support - Task #1818: Add migration - content units to standard storage path.CLOSED - CURRENTRELEASEjortel@redhat.com

Actions
Python Support - Task #1819: Add migration - content units to standard storage path.CLOSED - CURRENTRELEASEjortel@redhat.com

Actions

Related issues

Blocks RPM Support - Story #236: Don't re-download rpms if they exist on diskCLOSED - CURRENTRELEASEmhrivnak

Actions
Actions #1

Updated by bmbouter about 8 years ago

  • Blocks Story #236: Don't re-download rpms if they exist on disk added
Actions #2

Updated by jortel@redhat.com about 8 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to jortel@redhat.com
Actions #3

Updated by semyers about 8 years ago

  • Platform Release changed from 2.8.1 to 2.8.2
Actions #4

Updated by mhrivnak about 8 years ago

  • Sprint/Milestone set to 19
Actions #5

Updated by semyers about 8 years ago

  • Platform Release changed from 2.8.2 to 2.8.3
Actions #6

Updated by mhrivnak about 8 years ago

  • Status changed from ASSIGNED to POST
Actions #7

Updated by jortel@redhat.com about 8 years ago

  • Status changed from POST to MODIFIED
Actions #8

Updated by pthomas@redhat.com about 8 years ago

Jeff,

Could you please update this task to itemize what we should do to make sure we test this as much as possible.

Thanks
Preethi

Actions #9

Updated by jortel@redhat.com almost 8 years ago

Testing Notes

The migration(s) affects:

  • RPM
  • DRPM
  • SRPM
  • YUM_METADATA
  • DISTRIBUTION
  • ISO
  • PYTHON
  • DOCKER
  • PUPPET

OSTree not impacted.

The migration(s) do:

  • Calculates a new storage path for all unit types that stores files.
  • Moves the files content/.
  • Updates the symlinks under published/
  • Updates the unit in the DB

Using 2.7

For each content type listed above - create and sync and publish a repository.

Upgrade 2.8.3

Validate migrations run successfully.

Spot check paths in /var/lib/pulp/content have the format:

/units/<type>/12/3456789.../<file>

Where the 123456789... is a SHA256 of the unit key. The <file> will not be there for DISTRIBUTION. Mainly check the format.

Make sure none of the symlinks are broken and that all the content types can be consumed as published.

Then, repeat the test with RPMs set to deferred (Lazy) downloading.

Basically a massive regression test.

Actions #10

Updated by semyers almost 8 years ago

  • Status changed from MODIFIED to 5
Actions #11

Updated by semyers almost 8 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE
Actions #12

Updated by bmbouter about 6 years ago

  • Sprint set to Sprint 1
Actions #13

Updated by bmbouter about 6 years ago

  • Sprint/Milestone deleted (19)
Actions #14

Updated by bmbouter about 5 years ago

  • Tags Pulp 2 added

Also available in: Atom PDF