Project

Profile

Help

Issue #1691

Updated by pthomas@redhat.com over 4 years ago

Running pulp-admin repo download on repositories with on_demand or background download plolicy.



<pre>

[root@cloud-qe-14 ~]# rpm -qa |grep pulp

pulp-rpm-consumer-extensions-2.8.0-0.5.beta.git.46.c9f2464.el7.noarch
pulp-puppet-plugins-2.8.0-0.5.beta.git.6.5894bd0.el7.noarch
pulp-rpm-admin-extensions-2.8.0-0.5.beta.git.46.c9f2464.el7.noarch
pulp-agent-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
python-pulp-rpm-common-2.8.0-0.5.beta.git.46.c9f2464.el7.noarch
python-pulp-bindings-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
pulp-consumer-client-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
python-isodate-0.5.0-4.pulp.el7.noarch
python-pulp-docker-common-2.0.0-0.5.beta.git.29.0ebc63d.el7.noarch
python-pulp-repoauth-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
pulp-rpm-plugins-2.8.0-0.5.beta.git.46.c9f2464.el7.noarch
python-pulp-streamer-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
pulp-admin-client-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
pulp-rpm-handlers-2.8.0-0.5.beta.git.46.c9f2464.el7.noarch
pulp-docker-plugins-2.0.0-0.5.beta.git.29.0ebc63d.el7.noarch
python-pulp-client-lib-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
pulp-docker-admin-extensions-2.0.0-0.5.beta.git.29.0ebc63d.el7.noarch
pulp-puppet-consumer-extensions-2.8.0-0.5.beta.git.6.5894bd0.el7.noarch
pulp-puppet-handlers-2.8.0-0.5.beta.git.6.5894bd0.el7.noarch
python-pulp-puppet-common-2.8.0-0.5.beta.git.6.5894bd0.el7.noarch
pulp-server-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
pulp-selinux-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
python-pulp-agent-lib-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
pulp-rpm-yumplugins-2.8.0-0.5.beta.git.46.c9f2464.el7.noarch
python-pulp-common-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
python-kombu-3.0.33-2.pulp.el7.noarch
python-pulp-oid_validation-2.8.0-0.5.beta.git.107.d52583d.el7.noarch
pulp-puppet-admin-extensions-2.8.0-0.5.beta.git.6.5894bd0.el7.noarch
[root@cloud-qe-14 ~]#

1. Create a repo with
[root@cloud-qe-14 ~]# pulp-admin rpm repo create --repo-id errata --feed https://repos.fedorapeople.org/repos/pulp/pulp/demo_repos/test_errata_install/ --download-policy background
Successfully created repository [errata]

[root@cloud-qe-14 ~]# pulp-admin rpm repo sync run --repo-id errata
+----------------------------------------------------------------------+
Synchronizing Repository [errata]
+----------------------------------------------------------------------+

This command may be exited via ctrl+c without affecting the request.

Downloading metadata...
[|]
... completed

Downloading repository content...
[==================================================] 100%
RPMs: 11/11 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed

Importing errata...
[-]
... completed

Importing package groups/categories...
[-]
... completed

Cleaning duplicate packages...
[-]
... completed

Task Succeeded

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[==================================================] 100%
11 of 11 items
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[==================================================] 100%
4 of 4 items
... completed

Publishing Comps file
[-]
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
... skipped

Publishing files to web
[-]
... completed

Writing Listings File
[-]
... completed

Task Succeeded

Task Succeeded

[root@cloud-qe-14 ~]# pulp-admin repo download --repo-id=zoo
+----------------------------------------------------------------------+
Downloading Repository [zoo]
+----------------------------------------------------------------------+

This command may be exited via ctrl+c without affecting the request.

Download Repository Content
[= ] 3%
1 of 32 items
... failed

Task Succeeded

[root@cloud-qe-14 ~]#
[root@cloud-qe-14 ~]#
[root@cloud-qe-14 ~]# pulp-admin repo download --repo-id=errata
+----------------------------------------------------------------------+
Downloading Repository [errata]
+----------------------------------------------------------------------+

This command may be exited via ctrl+c without affecting the request.

Download Repository Content
[==== ] 9%
1 of 11 items
... failed

Task Succeeded

[root@cloud-qe-14 ~]#

Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30467]: celery.worker.strategy:INFO: Received task: pulp.server.controllers.repository.download_repo[22da8e54-d337-4cd7-9315-959b4d2e777f]
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cloud-qe-14.idmqe.lab.eng.bos.redhat.com
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (2): cloud-qe-14.idmqe.lab.eng.bos.redhat.com
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (3): cloud-qe-14.idmqe.lab.eng.bos.redhat.com
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (4): cloud-qe-14.idmqe.lab.eng.bos.redhat.com
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (5): cloud-qe-14.idmqe.lab.eng.bos.redhat.com
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: nectar.downloaders.threaded:WARNING: Connection Error - https://cloud-qe-14.idmqe.lab.eng.bos.redhat.com/streamer/var/lib/pulp/content/units/rpm/1e/f8c06e51196250bb49ce5fdcabfed9f0d0ad410d39525c26c7b3c10284cbd1/grinder_test_package-3.0-1.fc14.noarch.rpm?policy=eyJleHRlbnNpb25zIjoge30sICJyZXNvdXJjZSI6ICIvc3RyZWFtZXIvdmFyL2xpYi9wdWxwL2NvbnRlbnQvdW5pdHMvcnBtLzFlL2Y4YzA2ZTUxMTk2MjUwYmI0OWNlNWZkY2FiZmVkOWYwZDBhZDQxMGQzOTUyNWMyNmM3YjNjMTAyODRjYmQxL2dyaW5kZXJfdGVzdF9wYWNrYWdlLTMuMC0xLmZjMTQubm9hcmNoLnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzM1MjQ4OH0%3D;signature=A6NLM7GFBAfv2GFV-lL8wG-_K6Sr745quwGOzO1ggx6TqxpX8GrQV0aOMbvtao_kgP6JxOUamVCjTGAHlIa_SGp-FJTHlEbrsaiJ-C2JaFxXjs7ghoDQKqfTnXhT7xTgDFccNMHQQkrpiha1-ae_L3x3jFCUfUB-BayKTsgWZ8CBZ8kRREJNdBcZ_LeNWilj5IW8wUARMSopNLgsFt_hvk4NACnFuV_Or4FV3MSGYznsNRaFo9y12Nb-QOMXvOEgtM7-euXL9jQvbn59ZGbHKnbJMQHNPIB4RjJ06kCX6PEcEJ6umu3n2VoxP2JnEXi6sR2n_7ULYe0r6CqR79ZjpA%3D%3D could not be reached.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/1e/f8c06e51196250bb49ce5fdcabfed9f0d0ad410d39525c26c7b3c10284cbd1/grinder_test_package-3.0-1.fc14.noarch.rpm failed: A connection error occurred.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: nectar.downloaders.threaded:WARNING: Connection Error - https://cloud-qe-14.idmqe.lab.eng.bos.redhat.com/streamer/var/lib/pulp/content/units/rpm/44/3e411d281f2f8c59ad22e0efb625d1cb0938ccddb7706ed34f0bd57bae4117/warnerbros-0.1-1.noarch.rpm?policy=eyJleHRlbnNpb25zIjoge30sICJyZXNvdXJjZSI6ICIvc3RyZWFtZXIvdmFyL2xpYi9wdWxwL2NvbnRlbnQvdW5pdHMvcnBtLzQ0LzNlNDExZDI4MWYyZjhjNTlhZDIyZTBlZmI2MjVkMWNiMDkzOGNjZGRiNzcwNmVkMzRmMGJkNTdiYWU0MTE3L3dhcm5lcmJyb3MtMC4xLTEubm9hcmNoLnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzM1MjQ4OH0%3D;signature=6SILh113ejZXZkp4dK-6T8JtBGHrv-4lV4DP-UZ-I34T2KQW1BLDcZUoTMLubV64epg6ceoq_pkjyFvNjoXvrAvF9xuxWzeERCv8zZbXzhD_YXMAax3xFqDlELI2Qn2PcnxYw_b1i4IChvypwHKkz1JWb3ZnSCv4lrLcEq65_KeK1mUR8dSkzXTU2oM_sF6s_keSRQye70ZHM7fQvxIV1UR7vMD4M1xGHV-QsZD7TxCiMO2ogxK6joKt157e4tMTnpdbdXIja2G3bOejPRDQPF5HYlPTMU578nnP0XuQKuFifJjmMkT12UWRMpGaXu71b62xfyAcg6txj6Hf9K0JNg%3D%3D could not be reached.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: nectar.downloaders.threaded:WARNING: Connection Error - https://cloud-qe-14.idmqe.lab.eng.bos.redhat.com/streamer/var/lib/pulp/content/units/rpm/dd/30d2174f9d9670c0c5bf2f2f97b59ab4064400f32a2ec6e0c5a806fd665f6f/feedless-1.0-1.noarch.rpm?policy=eyJleHRlbnNpb25zIjoge30sICJyZXNvdXJjZSI6ICIvc3RyZWFtZXIvdmFyL2xpYi9wdWxwL2NvbnRlbnQvdW5pdHMvcnBtL2RkLzMwZDIxNzRmOWQ5NjcwYzBjNWJmMmYyZjk3YjU5YWI0MDY0NDAwZjMyYTJlYzZlMGM1YTgwNmZkNjY1ZjZmL2ZlZWRsZXNzLTEuMC0xLm5vYXJjaC5ycG0iLCAiZXhwaXJhdGlvbiI6IDE0ODczNTI0ODh9;signature=wCH9i-mWLIegPF3IQ-nuvWlVxHGQNqMIh3-Ks7Ozxp77jexZvO-Qv3FpU3lkcNZxhJLledCR7phlcyEwHYnTKIeFXRufpAui3F9qfJkjyifuRzNP0SRmacAS67GAOrgI09hMDGGAE4ZcS4NKnW6_YotzYtwfTMD2AgHOwN8ag4Z8uNyYaor4xwGLTXqCDevp2ws3B5I_186PF7aukH95QgQBWIIy6H-pWONHuOPZOoLVUI9g76CTsZRIVDYdjFhG6tUlIXUp4KFzC-05F_kLtPtkFXvUmUUwWqPxVAV0kuvcRr8BUoB9NHCRUcCbeiS-LmWc_xtkf_7CaltmS-JBeA%3D%3D could not be reached.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: nectar.downloaders.threaded:WARNING: Connection Error - https://cloud-qe-14.idmqe.lab.eng.bos.redhat.com/streamer/var/lib/pulp/content/units/rpm/93/a0921b41d13eff8fc906a82341d4ca1b66c30d5bf5315101051e3938834250/patb-0.1-2.noarch.rpm?policy=eyJleHRlbnNpb25zIjoge30sICJyZXNvdXJjZSI6ICIvc3RyZWFtZXIvdmFyL2xpYi9wdWxwL2NvbnRlbnQvdW5pdHMvcnBtLzkzL2EwOTIxYjQxZDEzZWZmOGZjOTA2YTgyMzQxZDRjYTFiNjZjMzBkNWJmNTMxNTEwMTA1MWUzOTM4ODM0MjUwL3BhdGItMC4xLTIubm9hcmNoLnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzM1MjQ4OH0%3D;signature=Insgy59oNppmcRToJ8qEOxVDtAbD8eL2SOD9NooTgJm9lYeLiB5K613eOilFToacVdaD9RFgHN5i_uM4AIWjfF0yNrfxTWzyHJohWlehT30BtOBl871LPmAx_CWfe6kfs40hz6Wu1oXXFdyRFOm1FTkiVKU0OMgL4Uupif_85EpfyoZZ8HB8KKh2uSruBv8M2yVz7pma7q9zoQncF0kj17ZwMGaeK7OsGKlZ8j4qUKiCWdqHUfVPIpSkGfP3_QST0Ao6apoYqAVrfs8yj9B0raUTkzBxoZzQMCWR42WLbHTzW8gtcsa00ZS9QzrkPh8MJAZ7HBXDtfVjpLPeWZSQ_A%3D%3D could not be reached.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/44/3e411d281f2f8c59ad22e0efb625d1cb0938ccddb7706ed34f0bd57bae4117/warnerbros-0.1-1.noarch.rpm failed: A connection error occurred.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/dd/30d2174f9d9670c0c5bf2f2f97b59ab4064400f32a2ec6e0c5a806fd665f6f/feedless-1.0-1.noarch.rpm failed: A connection error occurred.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/93/a0921b41d13eff8fc906a82341d4ca1b66c30d5bf5315101051e3938834250/patb-0.1-2.noarch.rpm failed: A connection error occurred.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: nectar.downloaders.threaded:WARNING: Connection Error - https://cloud-qe-14.idmqe.lab.eng.bos.redhat.com/streamer/var/lib/pulp/content/units/rpm/ca/599342648dc9fcb59124ad23d7a77cc70bc3928b93bbfc393d349a42c37a1d/grinder_test_package-2.0-1.fc14.noarch.rpm?policy=eyJleHRlbnNpb25zIjoge30sICJyZXNvdXJjZSI6ICIvc3RyZWFtZXIvdmFyL2xpYi9wdWxwL2NvbnRlbnQvdW5pdHMvcnBtL2NhLzU5OTM0MjY0OGRjOWZjYjU5MTI0YWQyM2Q3YTc3Y2M3MGJjMzkyOGI5M2JiZmMzOTNkMzQ5YTQyYzM3YTFkL2dyaW5kZXJfdGVzdF9wYWNrYWdlLTIuMC0xLmZjMTQubm9hcmNoLnJwbSIsICJleHBpcmF0aW9uIjogMTQ4NzM1MjQ4OH0%3D;signature=KEefZmMwzGW3_zcTTXndw4PTSPmi066dfuiV7szpRkYwVhReeWnrqOyHWAuHmx6oMRVOgtZAncap1s50-qQ0kV43d_mWyrwetPpkz3ak9ROIPJCz_h8QurQmKhtjZCM2HOx1zHvdenNiCbpSkR8ZknCYMsZlG7UoHGSuLDW7gLe1mn3jsNq2VhEQrMRmZOrd5y8zH5CdmXjc_uTCst_-HCp4-KEptv7eLw2Tj5SH9kwpyf_AZRK8E0GqkCOVaYDaXbn3lz3BiVuCr9ND8_MIoZoYSXSmXDxHF3af8bijxMPalCvpKBrGejcZMBmCrkDIIi0pzAYQknx99hx2pMIuqw%3D%3D could not be reached.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/ca/599342648dc9fcb59124ad23d7a77cc70bc3928b93bbfc393d349a42c37a1d/grinder_test_package-2.0-1.fc14.noarch.rpm failed: A connection error occurred.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/32/49aa94759bff71fbddb774684f963fb409a662efcd736019b6fde1f5583807/origin-1.0-1.noarch.rpm failed: Download skipped.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/20/227e158c06f92aa843ff7a99e00f9be80996b5659825bc1be679d9dbc55784/grinder_test_package-5.0-1.fc14.noarch.rpm failed: Download skipped.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/87/180ee8f076e6c83d217ba32ebcd74f841f9c171cb911e47474615d4b1d9914/grinder_test_package-4.0-1.fc14.noarch.rpm failed: Download skipped.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/b5/592a3144ba786dc5bf8fe59caa634e0dbb9827d4a9f8eaadc2dbd260ee445a/parent-1.0-1.noarch.rpm failed: Download skipped.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/0e/5dba5924631327fc8f8054972eaf0d355484a0fb5d6817b75dd797279c01ef/emoticons-0.1-2.noarch.rpm failed: Download skipped.
Feb 18 12:28:08 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30535]: pulp.server.controllers.repository:INFO: Download of /var/lib/pulp/content/units/rpm/05/94b854b013c130d9ce0eb7a0529884ed15a22e3faeb23810c592446ff35100/animaniacs-0.1-1.noarch.rpm failed: Download skipped.
Feb 18 12:28:09 cloud-qe-14.idmqe.lab.eng.bos.redhat.com pulp[30467]: celery.worker.job:INFO: Task pulp.server.controllers.repository.download_repo[22da8e54-d337-4cd7-9315-959b4d2e777f] succeeded in 1.08056300902s: None

</pre>

Back