Project

Profile

Help

Issue #7280

closed

Publications and Distributions are re-created on migration re-run for repos that contain mutable content.

Added by ipanova@redhat.com over 3 years ago. Updated over 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Sprint/Milestone:
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Platform Release:
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Sprint 81
Quarter:

Description

$ pulp-admin rpm repo list
+----------------------------------------------------------------------+
                            RPM Repositories
+----------------------------------------------------------------------+

Id:                  kickstart-repo
Display Name:        None
Description:         None
Content Unit Counts: 
  Distribution: 1

Id:                  distribution-repo2
Display Name:        None
Description:         None
Content Unit Counts: 
  Erratum: 4
  Rpm:     35

Id:                  distribution-repo1
Display Name:        None
Description:         None
Content Unit Counts: 
  Erratum: 4
  Rpm:     35

Id:                  test
Display Name:        None
Description:         None
Content Unit Counts: 
  Package Group: 1

Id:                  rhel
Display Name:        None
Description:         None
Content Unit Counts: 

Id:                  rpm_unsigned
Display Name:        None
Description:         None
Content Unit Counts: 

Id:                  lala1
Display Name:        None
Description:         None
Content Unit Counts: 
  Erratum:           4
  Package Category:  1
  Package Group:     2
  Package Langpacks: 1
  Rpm:               35

Id:                  lala2
Display Name:        None
Description:         None
Content Unit Counts: 
  Erratum:           4
  Package Category:  1
  Package Group:     2
  Package Langpacks: 1
  Rpm:               35

Id:                  lala3
Display Name:        None
Description:         None
Content Unit Counts: 

Id:                  lala4
Display Name:        None
Description:         None
Content Unit Counts: 
  Distribution:      1
  Erratum:           4
  Package Category:  1
  Package Group:     2
  Package Langpacks: 1
  Rpm:               35

$ http GET $BASE_ADDR/pulp/api/v3/tasks/4357cd08-d518-4324-b493-207acf2ae65f/
HTTP/1.1 200 OK
Allow: GET, PATCH, DELETE, HEAD, OPTIONS
Connection: close
Content-Length: 7964
Content-Type: application/json
Date: Wed, 05 Aug 2020 14:30:18 GMT
Server: gunicorn/20.0.4
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN

{
    "child_tasks": [],
    "created_resources": [
        "/pulp/api/v3/task-groups/a8e12c8c-fca1-4058-b88e-f25650bdb68c/",
        "/pulp/api/v3/repositories/rpm/rpm/9c23e06d-dd1e-40ff-81ed-8c6d9a508ca6/versions/1/",
        "/pulp/api/v3/repositories/rpm/rpm/d2f34b8f-d09b-4a03-acca-ee64f13f49e2/versions/1/",
        "/pulp/api/v3/repositories/rpm/rpm/751c0212-cb51-440f-bda8-f6e15d0cf1fb/versions/1/",
        "/pulp/api/v3/repositories/rpm/rpm/80b1706f-7933-417f-bf42-945248d050f4/versions/1/",
        "/pulp/api/v3/repositories/rpm/rpm/33d056b9-2308-4ad0-ab43-c940ddd5c596/versions/1/",
        "/pulp/api/v3/repositories/rpm/rpm/22d96cb9-0770-45fa-a5d2-9f435e9edb8b/versions/1/",
        "/pulp/api/v3/repositories/rpm/rpm/0a795d33-0aa5-4c06-9002-5844fc471cc9/versions/1/",
        "/pulp/api/v3/publications/rpm/rpm/e063cba1-f81d-4a6a-bcab-2caccf07bc41/",
        "/pulp/api/v3/distributions/rpm/rpm/9188d0cc-1982-400b-a076-9d98105018f9/",
        "/pulp/api/v3/publications/rpm/rpm/c2b3092d-70d9-4d7f-9a7e-d5ac94231600/",
        "/pulp/api/v3/distributions/rpm/rpm/10986078-2620-46ff-843d-c122441a0323/",
        "/pulp/api/v3/publications/rpm/rpm/91d2df3c-a767-4d76-97ac-5d27971d8fe8/",
        "/pulp/api/v3/distributions/rpm/rpm/fdc1cbf0-cd33-47cd-b22c-ef645e86a031/",
        "/pulp/api/v3/publications/rpm/rpm/5a634fbf-73b6-4db3-9dd1-6a1324cdfd6c/",
        "/pulp/api/v3/distributions/rpm/rpm/7450241e-ca02-42ec-8b8a-8782764b216a/",
        "/pulp/api/v3/publications/rpm/rpm/4e860b11-1966-41a2-a835-ea3ede78e5da/",
        "/pulp/api/v3/distributions/rpm/rpm/b9217961-6197-43b3-aeb4-a337d8473804/",
        "/pulp/api/v3/publications/rpm/rpm/d9e724ce-8a61-4f47-9b1e-ed8c9bb92f1b/",
        "/pulp/api/v3/distributions/rpm/rpm/9606091f-ee7c-4998-87b9-d0692f46492b/",
        "/pulp/api/v3/publications/rpm/rpm/cf8f8cf4-8765-4baa-b78b-811ea34c350b/",
        "/pulp/api/v3/distributions/rpm/rpm/e3ec1fbd-aa65-4301-8ecd-766565cfce15/"
    ],

Re-run, without any changes to the repos/content

$ http GET $BASE_ADDR/pulp/api/v3/tasks/08576559-db72-4249-98c0-b984c4554e4f/
HTTP/1.1 200 OK
Allow: GET, PATCH, DELETE, HEAD, OPTIONS
Connection: close
Content-Length: 7065
Content-Type: application/json
Date: Wed, 05 Aug 2020 14:30:58 GMT
Server: gunicorn/20.0.4
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN

{
    "child_tasks": [],
    "created_resources": [
        "/pulp/api/v3/task-groups/44480d34-7a68-4577-a4c2-6bff1f1507d7/",
        "/pulp/api/v3/publications/rpm/rpm/015589cb-9707-48bf-8b92-8b431cc67d5d/",
        "/pulp/api/v3/distributions/rpm/rpm/2b33e586-8544-4858-ab5a-1d57593b4f74/",
        "/pulp/api/v3/publications/rpm/rpm/c4770657-c9c9-4895-bc90-e5eef5180896/",
        "/pulp/api/v3/distributions/rpm/rpm/98be3a5a-3c4e-4351-b863-6976bd330bba/",
        "/pulp/api/v3/publications/rpm/rpm/3c667f24-ac33-485d-9958-d38d86a7d3a7/",
        "/pulp/api/v3/distributions/rpm/rpm/f18b8ee6-0c53-4b98-9097-72582002a9bc/",
        "/pulp/api/v3/publications/rpm/rpm/d6cdbb89-d262-4f5d-89e3-1596a034c4eb/",
        "/pulp/api/v3/distributions/rpm/rpm/b6e949f9-be6b-4924-af31-69842f2cb61d/",
        "/pulp/api/v3/publications/rpm/rpm/579608a6-aee5-448c-af91-4b6dca2221c8/",
        "/pulp/api/v3/distributions/rpm/rpm/31b923fe-ef59-498f-9b1b-5c5824d17144/"
Actions #1

Updated by ipanova@redhat.com over 3 years ago

For docker repos, where both of them contain tags, which are mutable content, on re-run only for 1 repo distribution got re-created

+----------------------------------------------------------------------+
                          Docker Repositories
+----------------------------------------------------------------------+

Id:                  test-fixture-1
Display Name:        None
Description:         None
Content Unit Counts: 
  Docker Blob:          10
  Docker Manifest:      14
  Docker Manifest List: 4
  Docker Tag:           18

Id:                  lala
Display Name:        None
Description:         None
Content Unit Counts: 
  Docker Blob:          571
  Docker Manifest:      426
  Docker Manifest List: 56
  Docker Tag:           272

Re-run:

$ http GET $BASE_ADDR/pulp/api/v3/tasks/9ed8b99f-2a60-4e7b-8991-9540f4a31b52/
HTTP/1.1 200 OK
Allow: GET, PATCH, DELETE, HEAD, OPTIONS
Connection: close
Content-Length: 3188
Content-Type: application/json
Date: Wed, 05 Aug 2020 14:35:51 GMT
Server: gunicorn/20.0.4
Vary: Accept, Cookie
X-Frame-Options: SAMEORIGIN

{
    "child_tasks": [],
    "created_resources": [
        "/pulp/api/v3/task-groups/5ed40aa1-5b4f-4c50-84e3-7cc7d8e7df0b/",
        "/pulp/api/v3/distributions/container/container/b401577b-89c1-4c59-9a8c-e20b6e5967e0/"
Actions #2

Updated by ipanova@redhat.com over 3 years ago

By the end of 1 run, i can see 2 distributors migrated. I have spotted that 1 distributor, on the second run get removed in the 'delete_old_resource'

Actions #3

Updated by dalley over 3 years ago

  • Status changed from NEW to POST
  • Assignee set to dalley
Actions #4

Updated by ipanova@redhat.com over 3 years ago

  • Sprint set to Sprint 80
Actions #5

Updated by rchan over 3 years ago

  • Sprint changed from Sprint 80 to Sprint 81

Added by dalley over 3 years ago

Revision aed477b8 | View on GitHub

Don't entirely delete mutable content and re-pre-migrate them every time

closes: #7280 https://pulp.plan.io/issues/7280

Added by dalley over 3 years ago

Revision aed477b8 | View on GitHub

Don't entirely delete mutable content and re-pre-migrate them every time

closes: #7280 https://pulp.plan.io/issues/7280

Added by dalley over 3 years ago

Revision aed477b8 | View on GitHub

Don't entirely delete mutable content and re-pre-migrate them every time

closes: #7280 https://pulp.plan.io/issues/7280

Actions #6

Updated by dalley over 3 years ago

  • Status changed from POST to MODIFIED
Actions #7

Updated by ttereshc over 3 years ago

  • Sprint/Milestone set to 0.5.0
Actions #8

Updated by pulpbot over 3 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

Also available in: Atom PDF