Project

Profile

Help

Story #3810

closed

Story #3821: As a user, I can migrate from Pulp 2 to Pulp 3

Story #3822: As a user, I can migrate all content units of a specific type from Pulp 2 to Pulp 3

As a user, I can migrate ISO content units from Pulp 2 into Pulp 3 as File Content

Added by ttereshc over 4 years ago. Updated over 2 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Sprint/Milestone:
Start date:
Due date:
% Done:

100%

Estimated time:
Platform Release:
Groomed:
Yes
Sprint Candidate:
Yes
Tags:
Katello
Sprint:
Sprint 57
Quarter:

Description

Desired workflow for migrating ISO content

1. Create a migration plan by POSTing to /pulp/api/v3/migration-plans/ the following JSON.
{  
    "plugins": [ 
       {
         "type": "iso",
       }
    ]
}
2. Run the migration plan

POST request to /pulp/api/v3/migration-plans/asdf-2345-ghjk-4567-adc/run/

Implementation details

The migrate_from_pulp2 task[0] needs to be updated to do the following:

1. Query the Pulp2Content model for: type='iso', pulp3content=None
2. Dispatch 36 'migrate_content' coroutines with 1 parameter: content_queryset - a slice of the queryset from step 1.
3. For each unit discovered, the coroutine will do the following:

  • create a hard link in /var/lib/pulp/artifacts/ directory
  • create Artifact in the Pulp3 database
  • create FileContent in the Pulp3 database
  • update the Pulp2Content model with a reference to the FileContent

[0] https://github.com/pulp/pulp-2to3-migrate/blob/master/pulp_2to3_migrate/app/tasks/migrate.py#L3

Actions #1

Updated by jsherril@redhat.com over 4 years ago

  • Tags Katello-P1 added
  • Tags deleted (Pulp 3)
Actions #2

Updated by jsherril@redhat.com over 4 years ago

  • Tags Pulp 3 added
Actions #3

Updated by ttereshc about 4 years ago

  • Related to Story #3822: As a user, I can migrate all content units of a specific type from Pulp 2 to Pulp 3 added
Actions #4

Updated by amacdona@redhat.com about 4 years ago

  • Parent task set to #3821
Actions #5

Updated by ttereshc almost 4 years ago

  • Parent task changed from #3821 to #3822
Actions #6

Updated by bmbouter almost 4 years ago

  • Tags deleted (Pulp 3)
Actions #7

Updated by ttereshc over 3 years ago

  • Description updated (diff)
Actions #8

Updated by ttereshc over 3 years ago

  • Sprint Candidate changed from No to Yes
Actions #9

Updated by dkliban@redhat.com over 3 years ago

  • Groomed changed from No to Yes
Actions #10

Updated by CodeHeeler over 3 years ago

  • Sprint set to Sprint 53
Actions #11

Updated by amacdona@redhat.com over 3 years ago

  • Sprint changed from Sprint 53 to Sprint 54
Actions #12

Updated by ttereshc over 3 years ago

  • Sprint changed from Sprint 54 to Sprint 55
Actions #13

Updated by jsherril@redhat.com over 3 years ago

  • Tags Katello-P2 added
  • Tags deleted (Katello-P1)
Actions #14

Updated by dkliban@redhat.com over 3 years ago

  • Sprint changed from Sprint 55 to Sprint 56
Actions #15

Updated by dkliban@redhat.com over 3 years ago

  • Description updated (diff)
Actions #16

Updated by dkliban@redhat.com over 3 years ago

  • Description updated (diff)

Since this code is going to be run as coroutines, I am roving all information about sharding. If we decide to dispatch this work through the tasking system we can add the sharding of the content.

Actions #17

Updated by ttereshc over 3 years ago

  • Description updated (diff)
Actions #18

Updated by ttereshc over 3 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to ttereshc
Actions #19

Updated by ttereshc over 3 years ago

  • Description updated (diff)
Actions #20

Updated by rchan over 3 years ago

  • Sprint changed from Sprint 56 to Sprint 57
Actions #21

Updated by ttereshc over 3 years ago

  • Status changed from ASSIGNED to POST

Added by ttereshc over 3 years ago

Revision c0680580

Allow artfacts to be pre-stored in the Pulp 3 storage

re #3810 https://pulp.plan.io/issues/3810

Added by ttereshc over 3 years ago

Revision 56ea0ed7

Migrate Pulp 2 ISO content into Pulp 3

Create hard links (of copy if not possible) and create Artifacts, ContentArtifacts and Content in pulp 3.

closes #3810 https://pulp.plan.io/issues/3810

Required PR: https://github.com/pulp/pulpcore/pull/254/

Added by ttereshc over 3 years ago

Revision 56ea0ed7

Migrate Pulp 2 ISO content into Pulp 3

Create hard links (of copy if not possible) and create Artifacts, ContentArtifacts and Content in pulp 3.

closes #3810 https://pulp.plan.io/issues/3810

Required PR: https://github.com/pulp/pulpcore/pull/254/

Added by ttereshc over 3 years ago

Revision 56ea0ed7

Migrate Pulp 2 ISO content into Pulp 3

Create hard links (of copy if not possible) and create Artifacts, ContentArtifacts and Content in pulp 3.

closes #3810 https://pulp.plan.io/issues/3810

Required PR: https://github.com/pulp/pulpcore/pull/254/

Actions #22

Updated by ttereshc over 3 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100

Applied in changeset commit:pulp-2to3-migrate|56ea0ed75e34da968e15e9299e3cb7360ac9dfd1.

Actions #23

Updated by bmbouter about 3 years ago

  • Sprint/Milestone set to 3.0.0
Actions #24

Updated by bmbouter about 3 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE
Actions #25

Updated by ttereshc about 3 years ago

  • Status changed from CLOSED - CURRENTRELEASE to MODIFIED
Actions #26

Updated by ttereshc almost 3 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE
  • Sprint/Milestone set to 0.1.0
Actions #27

Updated by ggainey over 2 years ago

  • Tags Katello added
  • Tags deleted (Katello-P2)

Also available in: Atom PDF