Project

Profile

Help

Task #1601

Migrate /var/lib/pulp/content to new 2.8 storage paths.

Added by jortel@redhat.com over 4 years ago. Updated over 1 year ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Category:
-
Start date:
Due date:
% Done:

100%

Estimated time:
(Total: 0:00 h)
Platform Release:
2.8.3
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Sprint 1

Description

See: https://pulp.plan.io/issues/1600

To make /var/lib/pulp/content/ consistent, we need to write some a migration.

The migration needs to:

  • update the _storage_path on content units to use the new 2.8 directory structure.
  • move the file to the new location.
  • update symlinks to point to the new file location.

Subtasks

Task #1815: Create a common 2.8 storage path migration to be used by pluginsCLOSED - CURRENTRELEASEjortel@redhat.com

Actions
RPM Support - Task #1816: Add migration - content units to standard storage path.CLOSED - CURRENTRELEASEjortel@redhat.com

Actions
Puppet Support - Task #1817: Add migration - content units to standard storage path.CLOSED - CURRENTRELEASEjortel@redhat.com

Actions
Docker Support - Task #1818: Add migration - content units to standard storage path.CLOSED - CURRENTRELEASEjortel@redhat.com

Actions
Python Support - Task #1819: Add migration - content units to standard storage path.CLOSED - CURRENTRELEASEjortel@redhat.com

Actions

Related issues

Blocks RPM Support - Story #236: Don't re-download rpms if they exist on diskCLOSED - CURRENTRELEASE

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

History

#1 Updated by bmbouter over 4 years ago

  • Blocks Story #236: Don't re-download rpms if they exist on disk added

#2 Updated by jortel@redhat.com over 4 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to jortel@redhat.com

#3 Updated by semyers over 4 years ago

  • Platform Release changed from 2.8.1 to 2.8.2

#4 Updated by mhrivnak over 4 years ago

  • Sprint/Milestone set to 19

#5 Updated by semyers over 4 years ago

  • Platform Release changed from 2.8.2 to 2.8.3

#6 Updated by mhrivnak over 4 years ago

  • Status changed from ASSIGNED to POST

#7 Updated by jortel@redhat.com over 4 years ago

  • Status changed from POST to MODIFIED

#8 Updated by pthomas@redhat.com over 4 years ago

Jeff,

Could you please update this task to itemize what we should do to make sure we test this as much as possible.

Thanks
Preethi

#9 Updated by jortel@redhat.com over 4 years ago

Testing Notes

The migration(s) affects:

  • RPM
  • DRPM
  • SRPM
  • YUM_METADATA
  • DISTRIBUTION
  • ISO
  • PYTHON
  • DOCKER
  • PUPPET

OSTree not impacted.

The migration(s) do:

  • Calculates a new storage path for all unit types that stores files.
  • Moves the files content/.
  • Updates the symlinks under published/
  • Updates the unit in the DB

Using 2.7

For each content type listed above - create and sync and publish a repository.

Upgrade 2.8.3

Validate migrations run successfully.

Spot check paths in /var/lib/pulp/content have the format:

/units/<type>/12/3456789.../<file>

Where the 123456789... is a SHA256 of the unit key. The <file> will not be there for DISTRIBUTION. Mainly check the format.

Make sure none of the symlinks are broken and that all the content types can be consumed as published.

Then, repeat the test with RPMs set to deferred (Lazy) downloading.

Basically a massive regression test.

#10 Updated by semyers over 4 years ago

  • Status changed from MODIFIED to 5

#11 Updated by semyers about 4 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE

#12 Updated by bmbouter over 2 years ago

  • Sprint set to Sprint 1

#13 Updated by bmbouter over 2 years ago

  • Sprint/Milestone deleted (19)

#14 Updated by bmbouter over 1 year ago

  • Tags Pulp 2 added

Please register to edit this issue

Also available in: Atom PDF