Project

Profile

Help

Issue #2272

Downloading on_demand repositories silently fails

Added by Ichimonji10 about 5 years ago. Updated over 2 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
3. High
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Sprint 9
Quarter:

Description

Let's say I execute the following commands:

pulp-admin rpm repo create \
    --repo-id ichi \
    --feed 'https://repos.fedorapeople.org/pulp/pulp/fixtures/rpm/' \
    --download-policy on_demand
pulp-admin -vv rpm repo sync run --repo-id ichi
pulp-admin -vv repo download --repo-id ichi

Importantly, the repository has an on_demand download policy. As a result, the repo sync run command doesn't download any content units from the remote repository onto disk. The third command forces content units to be downloaded onto disk. (Adding --verify-all has no effect.)

For more information on this feature, see:

Well, that's what's supposed to happen. In reality, Pulp never downloads any content units onto disk. This especially apparent if one resets Pulp directly before executing the script above: no /var/lib/pulp/content directory is created.

The system logs show no indication that anything has gone wrong:

Sep 20 17:14:09 example.com pulp[19129]: pulp_rpm.plugins.importers.yum.sync:INFO: Parsing metadata.
Sep 20 17:14:09 example.com pulp[19129]: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading metadata from https://repos.fedorapeople.org/pulp/pulp/fixtures/rpm/.
Sep 20 17:14:09 example.com pulp[19129]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): repos.fedorapeople.org
Sep 20 17:14:10 example.com pulp[19129]: pulp_rpm.plugins.importers.yum.sync:INFO: Parsing metadata.
Sep 20 17:14:10 example.com pulp[19129]: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading metadata from https://repos.fedorapeople.org/pulp/pulp/fixtures/rpm/.
Sep 20 17:14:10 example.com pulp[19129]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): repos.fedorapeople.org
Sep 20 17:14:11 example.com pulp[19129]: pulp_rpm.plugins.importers.yum.sync:INFO: Parsing metadata.
Sep 20 17:14:11 example.com pulp[19129]: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading metadata files.
Sep 20 17:14:11 example.com pulp[19129]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (2): repos.fedorapeople.org
Sep 20 17:14:11 example.com pulp[19129]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (3): repos.fedorapeople.org
Sep 20 17:14:11 example.com pulp[19129]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (4): repos.fedorapeople.org
Sep 20 17:14:11 example.com pulp[19129]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (5): repos.fedorapeople.org
Sep 20 17:14:12 example.com pulp[19129]: pulp_rpm.plugins.importers.yum.sync:INFO: Generating metadata databases.
Sep 20 17:14:12 example.com pulp[19129]: pulp_rpm.plugins.importers.yum.sync:INFO: Determining which units need to be downloaded.
Sep 20 17:14:13 example.com pulp[19129]: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading additional units.
Sep 20 17:14:13 example.com pulp[19129]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): repos.fedorapeople.org
Sep 20 17:14:14 example.com pulp[19129]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): repos.fedorapeople.org
Sep 20 17:14:15 example.com pulp[19129]: pulp_rpm.plugins.importers.yum.sync:INFO: Sync complete.
Sep 20 17:14:15 example.com pulp[19129]: kombu.transport.qpid:INFO: Connected to qpid with SASL mechanism ANONYMOUS
Sep 20 17:14:15 example.com pulp[18665]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[89880999-403a-4082-87b3-0755bec46e31]
Sep 20 17:14:15 example.com pulp[19060]: celery.worker.job:INFO: Task pulp.server.managers.repo.sync.sync[a56c5125-0061-4812-8be4-c7800ee25ac3] succeeded in 6.763268247s: <pulp.server.async.tasks.TaskResult object at 0x7fd1d404bcd0>
Sep 20 17:14:15 example.com pulp[19060]: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[d6ad75e6-0796-43e2-a7df-1f58cbdf719f] succeeded in 0.00523663999957s: None
Sep 20 17:14:15 example.com pulp[19060]: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.publish.publish[b076362f-2c4b-49c0-be65-446efe878050]
Sep 20 17:14:15 example.com pulp[19060]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[7d2436ee-10c2-4af6-97be-baece2cf2dff]
Sep 20 17:14:15 example.com pulp[18665]: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[89880999-403a-4082-87b3-0755bec46e31] succeeded in 0.0365141399998s: None
Sep 20 17:14:15 example.com pulp[19060]: celery.worker.job:INFO: Task pulp.server.managers.repo.publish.publish[b076362f-2c4b-49c0-be65-446efe878050] succeeded in 0.550737492s: {'exception': None, 'repo_id': u'cd95133a-af28-4ad7-b2fb-ab91102344ad', 'traceback': None, 'started': '2016-09-20T21:14:15Z',...
Sep 20 17:14:15 example.com pulp[19060]: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[7d2436ee-10c2-4af6-97be-baece2cf2dff] succeeded in 0.00386058500044s: None
Sep 20 17:14:22 example.com pulp[19056]: celery.worker.strategy:INFO: Received task: pulp.server.controllers.repository.download_repo[1ec5ace1-3b7e-473b-9f13-2b78bd2f9cc1]
Sep 20 17:14:22 example.com pulp[19126]: py.warnings:WARNING: (19126-06368) /usr/lib64/python2.7/site-packages/pymongo/topology.py:74: UserWarning: MongoClient opened before fork. Create MongoClient with connect=False, or create client after forking. See PyMongo's documentation for details: http://api.mongodb.org/python/current/faq.html#using-pymongo-with-multiprocessing>
Sep 20 17:14:22 example.com pulp[19126]: py.warnings:WARNING: (19126-06368)   "MongoClient opened before fork. Create MongoClient "
Sep 20 17:14:22 example.com pulp[19126]: py.warnings:WARNING: (19126-06368)
Sep 20 17:14:23 example.com pulp[19126]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): example.com
Sep 20 17:14:23 example.com pulp[19126]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (2): example.com
Sep 20 17:14:23 example.com pulp[19126]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (3): example.com
Sep 20 17:14:23 example.com pulp[19126]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (4): example.com
Sep 20 17:14:23 example.com pulp[19126]: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (5): example.com
Sep 20 17:14:24 example.com pulp[19056]: celery.worker.job:INFO: Task pulp.server.controllers.repository.download_repo[1ec5ace1-3b7e-473b-9f13-2b78bd2f9cc1] succeeded in 1.167712049s: None

The best clue I have as to what's wrong are the task reports. Here's an example of what pulp-admin writes to console during the execution of the third script command, above:

Download Repository Content
[=                                                 ] 3%
1 of 32 items
... failed
2016-09-20 19:46:39,862 - DEBUG - sending GET request to /pulp/api/v2/tasks/173b6fac-98d2-4faf-8e87-9f9be41e4011/
2016-09-20 19:46:39,888 - INFO - GET request to /pulp/api/v2/tasks/173b6fac-98d2-4faf-8e87-9f9be41e4011/ with parameters None
2016-09-20 19:46:39,888 - INFO - Response status : 200 

2016-09-20 19:46:39,888 - INFO - Response body :
 {
  "exception": null, 
  "task_type": "pulp.server.controllers.repository.download_repo", 
  "_href": "/pulp/api/v2/tasks/173b6fac-98d2-4faf-8e87-9f9be41e4011/", 
  "task_id": "173b6fac-98d2-4faf-8e87-9f9be41e4011", 
  "tags": [
    "pulp:repository:ichi", 
    "pulp:action:download"
  ], 
  "finish_time": "2016-09-20T23:46:38Z", 
  "_ns": "task_status", 
  "start_time": "2016-09-20T23:46:37Z", 
  "traceback": null, 
  "spawned_tasks": [], 
  "progress_report": {
    "background_download": [
      {
        "num_success": 0, 
        "description": "Download Repository Content", 
        "step_type": "background_download", 
        "items_total": 32, 
        "state": "FAILED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 1, 
        "step_id": "ac523705-9187-49a4-b3b7-4bbdc75b716d", 
        "num_processed": 1
      }
    ]
  }, 
  "queue": "celery.dq", 
  "state": "finished", 
  "worker_name": "celery", 
  "result": null, 
  "error": null, 
  "_id": {
    "$oid": "57e1ca5dcf39b1f2105dc504"
  }, 
  "id": "57e1ca5dcf39b1f2105dc504"
}

Task Succeeded

Notice the ... failed?

Here's an example of the task reports generated by a POST call to /pulp/api/v2/repositories/<repo_id>/actions/download/:

({'_href': '/pulp/api/v2/tasks/1ec5ace1-3b7e-473b-9f13-2b78bd2f9cc1/',
  '_id': {'$oid': '57e1a6aecf39b1f2105dc41e'},
  '_ns': 'task_status',
  'error': None,
  'exception': None,
  'finish_time': '2016-09-20T21:14:24Z',
  'id': '57e1a6aecf39b1f2105dc41e',
  'progress_report': {'background_download': [{'description': 'Download '
                                                              'Repository '
                                                              'Content',
                                               'details': '',
                                               'error_details': [],
                                               'items_total': 32,
                                               'num_failures': 1,
                                               'num_processed': 1,
                                               'num_success': 0,
                                               'state': 'FAILED',
                                               'step_id': '9cf8c6a6-e1a5-40f9-a8da-7415924f3892',
                                               'step_type': 'background_download'}]},
  'queue': 'celery.dq',
  'result': None,
  'spawned_tasks': [],
  'start_time': '2016-09-20T21:14:22Z',
  'state': 'finished',
  'tags': ['pulp:repository:cd95133a-af28-4ad7-b2fb-ab91102344ad',
           'pulp:action:download'],
  'task_id': '1ec5ace1-3b7e-473b-9f13-2b78bd2f9cc1',
  'task_type': 'pulp.server.controllers.repository.download_repo',
  'traceback': None,
  'worker_name': 'celery'},)

I've observed this issue on Pulp 2.10.1 and 2.11.0 systems provisioned this morning, on Fedora 24 and 23, respectively. Here's the exact packages on the test Fedora 24 system:

$ grep PRETTY /etc/os-release 
PRETTY_NAME="Fedora 24 (Twenty Four)"
$ rpm -qa | sort | grep -i pulp
pulp-admin-client-2.10.1-0.1.alpha.git.27.5ceb370.fc24.noarch
pulp-docker-admin-extensions-2.1.1-0.1.alpha.git.25.0292bec.fc24.noarch
pulp-docker-plugins-2.1.1-0.1.alpha.git.25.0292bec.fc24.noarch
pulp-puppet-admin-extensions-2.10.1-0.1.alpha.git.40.b5a745b.fc24.noarch
pulp-puppet-plugins-2.10.1-0.1.alpha.git.40.b5a745b.fc24.noarch
pulp-python-admin-extensions-1.1.2-1.fc24.noarch
pulp-python-plugins-1.1.2-1.fc24.noarch
pulp-rpm-admin-extensions-2.10.1-0.1.alpha.git.46.9669d43.fc24.noarch
pulp-rpm-plugins-2.10.1-0.1.alpha.git.46.9669d43.fc24.noarch
pulp-selinux-2.10.1-0.1.alpha.git.27.5ceb370.fc24.noarch
pulp-server-2.10.1-0.1.alpha.git.27.5ceb370.fc24.noarch
python-kombu-3.0.33-6.pulp.fc24.noarch
python-pulp-bindings-2.10.1-0.1.alpha.git.27.5ceb370.fc24.noarch
python-pulp-client-lib-2.10.1-0.1.alpha.git.27.5ceb370.fc24.noarch
python-pulp-common-2.10.1-0.1.alpha.git.27.5ceb370.fc24.noarch
python-pulp-docker-common-2.1.1-0.1.alpha.git.25.0292bec.fc24.noarch
python-pulp-oid_validation-2.10.1-0.1.alpha.git.27.5ceb370.fc24.noarch
python-pulp-puppet-common-2.10.1-0.1.alpha.git.40.b5a745b.fc24.noarch
python-pulp-python-common-1.1.2-1.fc24.noarch
python-pulp-repoauth-2.10.1-0.1.alpha.git.27.5ceb370.fc24.noarch
python-pulp-rpm-common-2.10.1-0.1.alpha.git.46.9669d43.fc24.noarch
python-pulp-streamer-2.10.1-0.1.alpha.git.27.5ceb370.fc24.noarch

Here's the exact packages on the test Fedora 23 system:

$ grep PRETTY /etc/os-release 
PRETTY_NAME="Fedora 23 (Twenty Three)"
$ rpm -qa | sort | grep -i pulp
pulp-admin-client-2.11.0-0.1.alpha.git.692.ab3aa93.fc23.noarch
pulp-docker-admin-extensions-2.2.0-0.1.alpha.git.201.dcabfb1.fc23.noarch
pulp-docker-plugins-2.2.0-0.1.alpha.git.201.dcabfb1.fc23.noarch
pulp-ostree-admin-extensions-1.2.0-0.1.alpha.git.104.777be19.fc23.noarch
pulp-ostree-plugins-1.2.0-0.1.alpha.git.104.777be19.fc23.noarch
pulp-puppet-admin-extensions-2.11.0-0.1.alpha.git.187.e97c179.fc23.noarch
pulp-puppet-plugins-2.11.0-0.1.alpha.git.187.e97c179.fc23.noarch
pulp-python-admin-extensions-1.2.0-0.1.alpha.git.108.e1444cf.fc23.noarch
pulp-python-plugins-1.2.0-0.1.alpha.git.108.e1444cf.fc23.noarch
pulp-rpm-admin-extensions-2.11.0-0.1.alpha.git.525.4e07924.fc23.noarch
pulp-rpm-plugins-2.11.0-0.1.alpha.git.525.4e07924.fc23.noarch
pulp-selinux-2.11.0-0.1.alpha.git.692.ab3aa93.fc23.noarch
pulp-server-2.11.0-0.1.alpha.git.692.ab3aa93.fc23.noarch
python-kombu-3.0.33-6.pulp.fc23.noarch
python-pulp-bindings-2.11.0-0.1.alpha.git.692.ab3aa93.fc23.noarch
python-pulp-client-lib-2.11.0-0.1.alpha.git.692.ab3aa93.fc23.noarch
python-pulp-common-2.11.0-0.1.alpha.git.692.ab3aa93.fc23.noarch
python-pulp-docker-common-2.2.0-0.1.alpha.git.201.dcabfb1.fc23.noarch
python-pulp-oid_validation-2.11.0-0.1.alpha.git.692.ab3aa93.fc23.noarch
python-pulp-ostree-common-1.2.0-0.1.alpha.git.104.777be19.fc23.noarch
python-pulp-puppet-common-2.11.0-0.1.alpha.git.187.e97c179.fc23.noarch
python-pulp-python-common-1.2.0-0.1.alpha.git.108.e1444cf.fc23.noarch
python-pulp-repoauth-2.11.0-0.1.alpha.git.692.ab3aa93.fc23.noarch
python-pulp-rpm-common-2.11.0-0.1.alpha.git.525.4e07924.fc23.noarch
python-pulp-streamer-2.11.0-0.1.alpha.git.692.ab3aa93.fc23.noarch

Associated revisions

Revision 2f82b294 View on GitHub
Added by bizhang about 5 years ago

Starts pulp_streamer with other pulp services

This is so plugins are loaded into the streamer.

closes #2272 https://pulp.plan.io/issues/2272

Revision 54750daf View on GitHub
Added by bizhang about 5 years ago

Restart services on vagrant-setup

Services are already started by ansible it make sense to do a prestart instead of a pstart on vagrant setup.

re #2272 https://pulp.plan.io/issues/2272

History

#1 Updated by Ichimonji10 about 5 years ago

This issue affects not only repositories with an on_demand download policy, but also repositories with a background download policy. Here's an example of a task report returned by Pulp when it attempts to download content units into a repository with a background download policy:

 {'_href': '/pulp/api/v2/tasks/9e6fd630-ba52-4a80-a104-f8c8d87655db/',
  '_id': {'$oid': '57e28bc241fc17e29299acc5'},
  '_ns': 'task_status',
  'error': None,
  'exception': None,
  'finish_time': '2016-09-21T13:31:49Z',
  'id': '57e28bc241fc17e29299acc5',
  'progress_report': {'background_download': [{'description': 'Download '
                                                              'Repository '
                                                              'Content',
                                               'details': '',
                                               'error_details': [],
                                               'items_total': 32,
                                               'num_failures': 16,
                                               'num_processed': 16,
                                               'num_success': 0,
                                               'state': 'FAILED',
                                               'step_id': 'e1ea65dc-3fec-46c5-9cff-1c96e565ca2a',
                                               'step_type': 'background_download'}]},
  'queue': 'celery.dq',
  'result': None,
  'spawned_tasks': [],
  'start_time': '2016-09-21T13:31:46Z',
  'state': 'finished',
  'tags': ['pulp:repository:5995e6db-4f77-4b0c-a19c-409b8d8a5996',
           'pulp:action:download'],
  'task_id': '9e6fd630-ba52-4a80-a104-f8c8d87655db',
  'task_type': 'pulp.server.controllers.repository.download_repo',
  'traceback': None,
  'worker_name': 'celery'}

#2 Updated by mhrivnak about 5 years ago

I wonder if it's something simple that's wrong, like the streamer isn't running, or squid isn't running, and pulp just isn't reporting a useful error message.

#3 Updated by Ichimonji10 about 5 years ago

That's not it.

$ ssh $hostname systemctl status squid | grep 'squid.service -\|Active'
● squid.service - Squid caching proxy
   Active: active (running) since Wed 2016-09-21 13:30:26 EDT; 5h 2min ago
$ ssh $hostname systemctl status 'pulp*' | grep '.service -\|Active'
● pulp_worker-2.service - Pulp Worker #2
   Active: active (running) since Wed 2016-09-21 17:00:48 EDT; 1h 30min ago
● pulp_streamer.service - The Pulp lazy content loading streamer
   Active: active (running) since Tue 2016-09-20 14:59:31 EDT; 1 day 3h ago
● pulp_workers.service - Pulp Celery Workers
   Active: active (exited) since Wed 2016-09-21 17:00:48 EDT; 1h 30min ago
● pulp_worker-3.service - Pulp Worker #3
   Active: active (running) since Wed 2016-09-21 17:00:48 EDT; 1h 30min ago
● pulp_worker-1.service - Pulp Worker #1
   Active: active (running) since Wed 2016-09-21 17:00:48 EDT; 1h 30min ago
● pulp_celerybeat.service - Pulp's Celerybeat
   Active: active (running) since Wed 2016-09-21 17:00:45 EDT; 1h 30min ago
● pulp_resource_manager.service - Pulp Resource Manager
   Active: active (running) since Wed 2016-09-21 17:00:46 EDT; 1h 30min ago
● pulp_worker-0.service - Pulp Worker #0
   Active: active (running) since Wed 2016-09-21 17:00:48 EDT; 1h 30min ago

This issue is also apparent on the Jenkins systems.

#4 Updated by pcreech about 5 years ago

  • Priority changed from Normal to Urgent
  • Severity changed from 2. Medium to 3. High
  • Triaged changed from No to Yes

#5 Updated by semyers about 5 years ago

  • Version set to 2.10.1

#6 Updated by mhrivnak about 5 years ago

  • Sprint/Milestone set to 27

#7 Updated by bizhang about 5 years ago

  • Assignee set to bizhang

#8 Updated by bizhang about 5 years ago

I reproduced this in the vargrant environment. It seems to be caused by the streamer not loading the plugins on start. When the streamer is restarted I can see the plugins being loaded into the streamer:

Oct 04 19:26:23 dev pulp_streamer[32101]: pulp.plugins.loader.manager:INFO: Loaded plugin yum for types: rpm
Oct 04 19:26:23 dev pulp_streamer[32101]: pulp.plugins.loader.manager:INFO: Loaded plugin yum_profiler for types: rpm,erratum
Oct 04 19:26:23 dev pulp_streamer[32101]: pulp.plugins.loader.manager:INFO: Loaded plugin yum_importer for types: distribution,drpm,erratum,package_group,package_category,rpm,srpm,yum_repo_metadata_file,package_environment,package_langpacks
Oct 04 19:26:23 dev pulp_streamer[32101]: pulp.plugins.loader.manager:INFO: Loaded plugin yum_distributor for types: rpm,srpm,drpm,erratum,package_group,package_category,distribution,yum_repo_metadata_file

This is not done before the restart. So I believe this is a environment setup issue rather than a code issue.

Jeremy, can you confirm that running sudo service pulp_streamer restart fixes it on your end?

I will take a look at resolving this for our vagrant env.

#9 Updated by bizhang about 5 years ago

  • Status changed from NEW to POST

#10 Updated by Ichimonji10 about 5 years ago

I'm unable to reproduce this issue with a pair of Pulp 2.10.1 and 2.11 (master) systems provisioned yesterday.

To be clear, the issue described is apparent on Pulp systems installed from packages. I'm not using Vagrant.

#11 Updated by Ichimonji10 about 5 years ago

Below are the packages on the two systems I'm currently using for testing.

$ grep PRETTY /etc/os-release
PRETTY_NAME="Fedora 24 (Twenty Four)"
$ rpm -qa | sort | grep -i pulp
pulp-admin-client-2.10.1-0.1.alpha.git.29.d93434d.fc24.noarch
pulp-docker-admin-extensions-2.1.1-0.1.alpha.git.25.b1956ff.fc24.noarch
pulp-docker-plugins-2.1.1-0.1.alpha.git.25.b1956ff.fc24.noarch
pulp-puppet-admin-extensions-2.10.1-0.1.alpha.git.40.b787209.fc24.noarch
pulp-puppet-plugins-2.10.1-0.1.alpha.git.40.b787209.fc24.noarch
pulp-python-admin-extensions-1.1.2-1.fc24.noarch
pulp-python-plugins-1.1.2-1.fc24.noarch
pulp-rpm-admin-extensions-2.10.1-0.1.alpha.git.49.6d2eaf2.fc24.noarch
pulp-rpm-plugins-2.10.1-0.1.alpha.git.49.6d2eaf2.fc24.noarch
pulp-selinux-2.10.1-0.1.alpha.git.29.d93434d.fc24.noarch
pulp-server-2.10.1-0.1.alpha.git.29.d93434d.fc24.noarch
python-kombu-3.0.33-6.pulp.fc24.noarch
python-pulp-bindings-2.10.1-0.1.alpha.git.29.d93434d.fc24.noarch
python-pulp-client-lib-2.10.1-0.1.alpha.git.29.d93434d.fc24.noarch
python-pulp-common-2.10.1-0.1.alpha.git.29.d93434d.fc24.noarch
python-pulp-docker-common-2.1.1-0.1.alpha.git.25.b1956ff.fc24.noarch
python-pulp-oid_validation-2.10.1-0.1.alpha.git.29.d93434d.fc24.noarch
python-pulp-puppet-common-2.10.1-0.1.alpha.git.40.b787209.fc24.noarch
python-pulp-python-common-1.1.2-1.fc24.noarch
python-pulp-repoauth-2.10.1-0.1.alpha.git.29.d93434d.fc24.noarch
python-pulp-rpm-common-2.10.1-0.1.alpha.git.49.6d2eaf2.fc24.noarch
python-pulp-streamer-2.10.1-0.1.alpha.git.29.d93434d.fc24.noarch
$ grep PRETTY /etc/os-release
PRETTY_NAME="Fedora 23 (Twenty Three)"
$ rpm -qa | sort | grep -i pulp
pulp-admin-client-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
pulp-docker-admin-extensions-2.2.0-0.1.alpha.git.201.ca717bc.fc23.noarch
pulp-docker-plugins-2.2.0-0.1.alpha.git.201.ca717bc.fc23.noarch
pulp-ostree-admin-extensions-1.2.0-0.1.alpha.git.104.d8fab7d.fc23.noarch
pulp-ostree-plugins-1.2.0-0.1.alpha.git.104.d8fab7d.fc23.noarch
pulp-puppet-admin-extensions-2.11.0-0.1.alpha.git.187.e97c179.fc23.noarch
pulp-puppet-plugins-2.11.0-0.1.alpha.git.187.e97c179.fc23.noarch
pulp-python-admin-extensions-1.2.0-0.1.alpha.git.109.03ee7ec.fc23.noarch
pulp-python-plugins-1.2.0-0.1.alpha.git.109.03ee7ec.fc23.noarch
pulp-rpm-admin-extensions-2.11.0-0.1.alpha.git.543.4255a48.fc23.noarch
pulp-rpm-plugins-2.11.0-0.1.alpha.git.543.4255a48.fc23.noarch
pulp-selinux-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
pulp-server-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-kombu-3.0.33-6.pulp.fc23.noarch
python-pulp-bindings-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-pulp-client-lib-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-pulp-common-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-pulp-docker-common-2.2.0-0.1.alpha.git.201.ca717bc.fc23.noarch
python-pulp-oid_validation-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-pulp-ostree-common-1.2.0-0.1.alpha.git.104.d8fab7d.fc23.noarch
python-pulp-puppet-common-2.11.0-0.1.alpha.git.187.e97c179.fc23.noarch
python-pulp-python-common-1.2.0-0.1.alpha.git.109.03ee7ec.fc23.noarch
python-pulp-repoauth-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-pulp-rpm-common-2.11.0-0.1.alpha.git.543.4255a48.fc23.noarch
python-pulp-streamer-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch

#12 Updated by bizhang about 5 years ago

  • Version deleted (2.10.1)
  • Platform Release deleted (2.10.1)

Based on Jeremy not being able to reproduce it, and the dev environment being an ansible config issue I am removing this as a blocker for 2.10.1

#13 Updated by Ichimonji10 about 5 years ago

Tested one more time with a fresh pair of systems. The issue is still not reproducible. I ran this script:

#!/usr/bin/env bash
pulp-admin rpm repo create \
    --repo-id ichi \
    --feed 'https://repos.fedorapeople.org/pulp/pulp/fixtures/rpm/' \
    --download-policy on_demand
pulp-admin -vv rpm repo sync run --repo-id ichi
pulp-admin -vv repo download --repo-id ichi

The /var/lib/pulp/content directory was created and populated on both systems. Here's the first test system:

$ grep PRETTY /etc/os-release
PRETTY_NAME="Fedora 24 (Twenty Four)"
$ rpm -qa | sort | grep -i pulp                                                                          
pulp-admin-client-2.10.1-0.1.alpha.git.29.d8dedbe.fc24.noarch
pulp-docker-admin-extensions-2.1.1-0.1.alpha.git.25.8d0b470.fc24.noarch
pulp-docker-plugins-2.1.1-0.1.alpha.git.25.8d0b470.fc24.noarch
pulp-puppet-admin-extensions-2.10.1-0.1.alpha.git.40.eebbc61.fc24.noarch
pulp-puppet-plugins-2.10.1-0.1.alpha.git.40.eebbc61.fc24.noarch
pulp-python-admin-extensions-1.1.2-1.fc24.noarch
pulp-python-plugins-1.1.2-1.fc24.noarch
pulp-rpm-admin-extensions-2.10.1-0.1.alpha.git.49.41cb4ef.fc24.noarch
pulp-rpm-plugins-2.10.1-0.1.alpha.git.49.41cb4ef.fc24.noarch
pulp-selinux-2.10.1-0.1.alpha.git.29.d8dedbe.fc24.noarch
pulp-server-2.10.1-0.1.alpha.git.29.d8dedbe.fc24.noarch
python-kombu-3.0.33-6.pulp.fc24.noarch
python-pulp-bindings-2.10.1-0.1.alpha.git.29.d8dedbe.fc24.noarch
python-pulp-client-lib-2.10.1-0.1.alpha.git.29.d8dedbe.fc24.noarch
python-pulp-common-2.10.1-0.1.alpha.git.29.d8dedbe.fc24.noarch
python-pulp-docker-common-2.1.1-0.1.alpha.git.25.8d0b470.fc24.noarch
python-pulp-oid_validation-2.10.1-0.1.alpha.git.29.d8dedbe.fc24.noarch
python-pulp-puppet-common-2.10.1-0.1.alpha.git.40.eebbc61.fc24.noarch
python-pulp-python-common-1.1.2-1.fc24.noarch
python-pulp-repoauth-2.10.1-0.1.alpha.git.29.d8dedbe.fc24.noarch
python-pulp-rpm-common-2.10.1-0.1.alpha.git.49.41cb4ef.fc24.noarch
python-pulp-streamer-2.10.1-0.1.alpha.git.29.d8dedbe.fc24.noarch

Here's the second test system:

$ grep PRETTY /etc/os-release
PRETTY_NAME="Fedora 23 (Twenty Three)"
$ rpm -qa | sort | grep -i pulp                                                                    
pulp-admin-client-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
pulp-docker-admin-extensions-2.2.0-0.1.alpha.git.201.9911531.fc23.noarch
pulp-docker-plugins-2.2.0-0.1.alpha.git.201.9911531.fc23.noarch
pulp-ostree-admin-extensions-1.2.0-0.1.alpha.git.104.2f01508.fc23.noarch
pulp-ostree-plugins-1.2.0-0.1.alpha.git.104.2f01508.fc23.noarch
pulp-puppet-admin-extensions-2.11.0-0.1.alpha.git.187.e97c179.fc23.noarch
pulp-puppet-plugins-2.11.0-0.1.alpha.git.187.e97c179.fc23.noarch
pulp-python-admin-extensions-1.2.0-0.1.alpha.git.109.e59ba95.fc23.noarch
pulp-python-plugins-1.2.0-0.1.alpha.git.109.e59ba95.fc23.noarch
pulp-rpm-admin-extensions-2.11.0-0.1.alpha.git.543.4255a48.fc23.noarch
pulp-rpm-plugins-2.11.0-0.1.alpha.git.543.4255a48.fc23.noarch
pulp-selinux-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
pulp-server-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-kombu-3.0.33-6.pulp.fc23.noarch
python-pulp-bindings-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-pulp-client-lib-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-pulp-common-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-pulp-docker-common-2.2.0-0.1.alpha.git.201.9911531.fc23.noarch
python-pulp-oid_validation-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-pulp-ostree-common-1.2.0-0.1.alpha.git.104.2f01508.fc23.noarch
python-pulp-puppet-common-2.11.0-0.1.alpha.git.187.e97c179.fc23.noarch
python-pulp-python-common-1.2.0-0.1.alpha.git.109.e59ba95.fc23.noarch
python-pulp-repoauth-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch
python-pulp-rpm-common-2.11.0-0.1.alpha.git.543.4255a48.fc23.noarch
python-pulp-streamer-2.11.0-0.1.alpha.git.710.7290d2b.fc23.noarch

#14 Updated by bizhang about 5 years ago

  • Status changed from POST to MODIFIED

#15 Updated by semyers about 5 years ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE
  • Priority changed from Urgent to Normal

Given that the fixes for this landed in the devel repo, this should be closed. Please reopen if needed.

#16 Updated by bmbouter over 3 years ago

  • Sprint set to Sprint 9

#17 Updated by bmbouter over 3 years ago

  • Sprint/Milestone deleted (27)

#18 Updated by bmbouter over 2 years ago

  • Tags Pulp 2 added

Please register to edit this issue

Also available in: Atom PDF