Project

Profile

Help

Issue #101

sync after upload clobbers parent_id and size

Added by mhrivnak almost 6 years ago. Updated over 1 year ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
Start date:
Due date:
Estimated time:
Severity:
1. Low
Version - Docker:
Platform Release:
Target Release - Docker:
1.0.0
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

If you upload a tarball of docker images to repo A and then do a sync of repo B that includes the same images, the parent_id and size attributes on the common units gets clobbered by the sync process.

  1. docker pull busybox
  2. docker save busybox > bb.tar
  3. pulp-admin docker repo uploads upload -f bb.tar --repo-id=repoA
  4. pulp-admin docker repo images --repo-id=repoA # note that ParentId and Size are populated for some images
  5. pulp-admin docker repo create --repo-id=repoB --feed=https://index.docker.io --upstream-name=busybox
  6. pulp-admin docker repo images --repo-id=repoA # note that ParentId and Size are now None

This was seen on both rhel7 and centos7 with both pulp 2.5.1-1 and 2.6.0-0.2.beta. Both used pulp_docker 0.2.1-1

images_list.txt (1.57 KB) images_list.txt mhrivnak, 01/08/2015 10:33 PM

Associated revisions

Revision ef0b4e46 View on GitHub
Added by mhrivnak almost 6 years ago

sync no longer clobbers metadata of previously-uploaded images

fixes #101

Revision ef0b4e46 View on GitHub
Added by mhrivnak almost 6 years ago

sync no longer clobbers metadata of previously-uploaded images

fixes #101

Revision ef0b4e46 View on GitHub
Added by mhrivnak almost 6 years ago

sync no longer clobbers metadata of previously-uploaded images

fixes #101

Revision ef0b4e46 View on GitHub
Added by mhrivnak almost 6 years ago

sync no longer clobbers metadata of previously-uploaded images

fixes #101

Revision dcc2de50 View on GitHub
Added by mhrivnak almost 6 years ago

Documenting a quirk of this function that could lead to clobbering pre-existing unit metadata, and how to avoid that.

re #101

Revision dcc2de50 View on GitHub
Added by mhrivnak almost 6 years ago

Documenting a quirk of this function that could lead to clobbering pre-existing unit metadata, and how to avoid that.

re #101

History

#1 Updated by bmbouter almost 6 years ago

  • Triaged set to No

#3 Updated by skarmark@redhat.com almost 6 years ago

  • Priority changed from Normal to High
  • Triaged changed from No to Yes

#4 Updated by mhrivnak almost 6 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to mhrivnak

#5 Updated by mhrivnak almost 6 years ago

  • Status changed from ASSIGNED to POST

#7 Updated by mhrivnak almost 6 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100

#9 Updated by cduryee almost 6 years ago

  • Status changed from MODIFIED to 5

pulp-docker 1.0.0-0.2.beta

#10 Updated by pthomas@redhat.com almost 6 years ago

  • Status changed from 5 to 6

verified
[root@qe-blade-04 ~]# rpm -qa |grep pulp-docker
pulp-docker-plugins-1.0.0-0.2.beta.el6.noarch
pulp-docker-admin-extensions-1.0.0-0.2.beta.el6.noarch
python-pulp-docker-common-1.0.0-0.2.beta.el6.noarch
[root@qe-blade-04 ~]#

[root@qe-blade-04 ~]# pulp-admin docker repo images --repo-id=busybox
Created: 2015-02-25T19:58:45Z
Id: 54ee29751661f019be2f3870
Metadata:
Image Id: 4986bf8c15363d1c5d15512d5266f8777bfba4974ac56e3270e7760f6f0a8125
Parent Id: ea13149945cb6b1e746bf28032f02e9b5a793523481a0a18645fc77ad53c4ea2
Size: 0
Tags: latest
Owner Id: SYSTEM
Owner Type: user
Repo Id: busybox
Unit Id: e77800d2-91a6-400d-b8c2-4fc951210901
Unit Type Id: docker_image
Updated: 2015-02-25T19:58:45Z

Created: 2015-02-25T19:58:46Z
Id: 54ee29761661f019be2f3873
Metadata:
Image Id: 511136ea3c5a64f264b78b5433614aec563103b4d4702f3ba7d4d2698e22c158
Parent Id: None
Size: 0
Owner Id: SYSTEM
Owner Type: user
Repo Id: busybox
Unit Id: 4c1936f8-efa2-49bb-bd49-2c038d30153f
Unit Type Id: docker_image
Updated: 2015-02-25T19:58:46Z

Created: 2015-02-25T19:58:46Z
Id: 54ee29761661f019be2f3872
Metadata:
Image Id: df7546f9f060a2268024c8a230d8639878585defcc1bc6f79d2728a13957871b
Parent Id: 511136ea3c5a64f264b78b5433614aec563103b4d4702f3ba7d4d2698e22c158
Size: 0
Owner Id: SYSTEM
Owner Type: user
Repo Id: busybox
Unit Id: 7f159b35-e08b-4444-8950-bca45fb7f242
Unit Type Id: docker_image
Updated: 2015-02-25T19:58:46Z

Created: 2015-02-25T19:58:46Z
Id: 54ee29761661f019be2f3871
Metadata:
Image Id: ea13149945cb6b1e746bf28032f02e9b5a793523481a0a18645fc77ad53c4ea2
Parent Id: df7546f9f060a2268024c8a230d8639878585defcc1bc6f79d2728a13957871b
Size: 2433303
Owner Id: SYSTEM
Owner Type: user
Repo Id: busybox
Unit Id: c990ab34-185d-4331-adef-8d1306b159e2
Unit Type Id: docker_image
Updated: 2015-02-25T19:58:46Z

[root@qe-blade-04 ~]# pulp-admin docker repo images --repo-id=synctest
Created: 2015-02-25T20:28:32Z
Id: 54ee30701661f019be2f387c
Metadata:
Image Id: 2982ec56c8d910121e7594ca7890b062f6d37fadf7575f6a6f3adbabbafac9f5
Parent Id: df7546f9f060a2268024c8a230d8639878585defcc1bc6f79d2728a13957871b
Size: 5454693
Owner Id: docker_importer
Owner Type: importer
Repo Id: synctest
Unit Id: 905cc78b-77ed-4f74-a475-9ea01048cbd5
Unit Type Id: docker_image
Updated: 2015-02-25T20:28:32Z

Created: 2015-02-25T20:28:32Z
Id: 54ee30701661f019be2f387b
Metadata:
Image Id: 2aed48a4e41d3931167146e9b7492aa5639e7f6478be9eac584726ecec6824ed
Parent Id: 618b1fc306b06d11e192812ede4c685dcbf886d2a0189e9a552c550fd7663df0
Size: 0
Tags: buildroot-2013.08.1
Owner Id: docker_importer
Owner Type: importer
Repo Id: synctest
Unit Id: 3cf31528-877e-44b2-813e-4b186de3bfaf
Unit Type Id: docker_image
Updated: 2015-02-25T20:28:32Z

Created: 2015-02-25T20:28:32Z
Id: 54ee30701661f019be2f3878
Metadata:
Image Id: 492dad4279bae5bb73648efe9bf467b2cfa8bab1d593595226e3e7a95d9f6c35
Parent Id: 2982ec56c8d910121e7594ca7890b062f6d37fadf7575f6a6f3adbabbafac9f5
Size: 0
Tags: ubuntu-12.04
Owner Id: docker_importer
Owner Type: importer
Repo Id: synctest
Unit Id: 609a0182-9114-44e2-a698-e4c0a29ee578
Unit Type Id: docker_image
Updated: 2015-02-25T20:28:32Z

Created: 2015-02-25T20:28:25Z
Id: 54ee30691661f019be2f3874
Metadata:
Image Id: 4986bf8c15363d1c5d15512d5266f8777bfba4974ac56e3270e7760f6f0a8125
Parent Id: ea13149945cb6b1e746bf28032f02e9b5a793523481a0a18645fc77ad53c4ea2
Size: 0
Tags: latest, buildroot-2014.02
Owner Id: docker_importer
Owner Type: importer
Repo Id: synctest
Unit Id: e77800d2-91a6-400d-b8c2-4fc951210901
Unit Type Id: docker_image
Updated: 2015-02-25T20:28:25Z

Created: 2015-02-25T20:28:25Z
Id: 54ee30691661f019be2f3875
Metadata:
Image Id: 511136ea3c5a64f264b78b5433614aec563103b4d4702f3ba7d4d2698e22c158
Parent Id: None
Size: 0
Owner Id: docker_importer
Owner Type: importer
Repo Id: synctest
Unit Id: 4c1936f8-efa2-49bb-bd49-2c038d30153f
Unit Type Id: docker_image
Updated: 2015-02-25T20:28:25Z

Created: 2015-02-25T20:28:32Z
Id: 54ee30701661f019be2f387d
Metadata:
Image Id: 618b1fc306b06d11e192812ede4c685dcbf886d2a0189e9a552c550fd7663df0
Parent Id: df7546f9f060a2268024c8a230d8639878585defcc1bc6f79d2728a13957871b
Size: 2489301
Owner Id: docker_importer
Owner Type: importer
Repo Id: synctest
Unit Id: e2b5d329-5a0b-4b9c-98b9-eca11458588b
Unit Type Id: docker_image
Updated: 2015-02-25T20:28:32Z

Created: 2015-02-25T20:28:25Z
Id: 54ee30691661f019be2f3876
Metadata:
Image Id: df7546f9f060a2268024c8a230d8639878585defcc1bc6f79d2728a13957871b
Parent Id: 511136ea3c5a64f264b78b5433614aec563103b4d4702f3ba7d4d2698e22c158
Size: 0
Owner Id: docker_importer
Owner Type: importer
Repo Id: synctest
Unit Id: 7f159b35-e08b-4444-8950-bca45fb7f242
Unit Type Id: docker_image
Updated: 2015-02-25T20:28:25Z

Created: 2015-02-25T20:28:32Z
Id: 54ee30701661f019be2f3879
Metadata:
Image Id: e8a999563c473139dc74d02eefb7b13ffea63799bc05b8936b9ad7119b37742f
Parent Id: df7546f9f060a2268024c8a230d8639878585defcc1bc6f79d2728a13957871b
Size: 5609404
Owner Id: docker_importer
Owner Type: importer
Repo Id: synctest
Unit Id: c417b0d4-9e54-4edb-bfc2-701cb05b66f6
Unit Type Id: docker_image
Updated: 2015-02-25T20:28:32Z

Created: 2015-02-25T20:28:25Z
Id: 54ee30691661f019be2f3877
Metadata:
Image Id: ea13149945cb6b1e746bf28032f02e9b5a793523481a0a18645fc77ad53c4ea2
Parent Id: df7546f9f060a2268024c8a230d8639878585defcc1bc6f79d2728a13957871b
Size: 2433303
Owner Id: docker_importer
Owner Type: importer
Repo Id: synctest
Unit Id: c990ab34-185d-4331-adef-8d1306b159e2
Unit Type Id: docker_image
Updated: 2015-02-25T20:28:25Z

Created: 2015-02-25T20:28:32Z
Id: 54ee30701661f019be2f387a
Metadata:
Image Id: f6169d24347d30de48e4493836bec15c78a34f08cc7f17d6a45a19d68dc283ac
Parent Id: e8a999563c473139dc74d02eefb7b13ffea63799bc05b8936b9ad7119b37742f
Size: 0
Tags: ubuntu-14.04
Owner Id: docker_importer
Owner Type: importer
Repo Id: synctest
Unit Id: b876dce8-f4e9-4b10-937b-ea8feefa2de3
Unit Type Id: docker_image
Updated: 2015-02-25T20:28:32Z

#11 Updated by rbarlow over 5 years ago

  • Status changed from 6 to CLOSED - CURRENTRELEASE
  • Severity set to 1. Low
  • Target Release - Docker set to 1.0.0

#13 Updated by bmbouter over 1 year ago

  • Tags Pulp 2 added

Please register to edit this issue

Also available in: Atom PDF