Project

Profile

Help

Issue #5098

closed

pypi mirror, File exists

Added by Poil over 4 years ago. Updated almost 4 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version - Python:
Platform Release:
2.21.2
Target Release - Python:
OS:
Triaged:
No
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:

Description

Hi,

I tried to mirror some python packages but each time I have an error on jupyter-core package, normally when I delete recreate the repository I have it work but not here. Any idea ?

```
[root@repos ~]# pulp-admin -v python repo create --repo-id=vpnssl_pypi --feed https://pypi.python.org/ --proxy-host=http://proxy.local --proxy-port=3128 --package-names setuptools,amqp,aniso8601,appdirs,arrow,asn1crypto,astroid,atomicwrites,attrs,backcall,bandit,beautifulsoup4,billiard,bs4,cached-property,celery,certifi,cffi,chardet,click,colorhash,configparser,CouchDB,coverage,cryptography,dataclasses,decorator,deep_merge,defusedxml,digicert_client,entrypoints,esdk-obs-python,filelock,flake8,flake8-bandit,flake8-colors,flake8-docstrings,flake8-import-order,flake8-polyfill,Flask,Flask-MonitoringDashboard,flask-restplus,Flask-WTF,gitdb2,GitPython,gunicorn,idna,ipython,ipython_genutils,isodate,isort,itsdangerous,jedi,Jinja2,jsonschema,jupyter_core,kombu,lazy-object-proxy,lxml,M2Crypto,MarkupSafe,mccabe,mock,more-itertools,nbformat,numpy,parso,pbr,pep8-naming,pexpect,pickleshare,pip,pipenv,pip-tools,plotly,pluggy,prompt_toolkit,psutil,ptyprocess,py,pycodestyle,pycparser,pydocstyle,pyflakes,Pygments,PyJWT,pylint,pyOpenSSL,pyrsistent,pytest,pytest-cov,pytest-mock,python-consul,python-dateutil,pytz,pyvmomi,PyYAML,redis,requests,requests-toolbelt,retry,setuptools,simplejson,six,smmap2,snowballstemmer,soupsieve,SQLAlchemy,stevedore,toml,tox,traitlets,typed-ast,tzlocal,urllib3,vine,virtualenv,virtualenv-clone,wcwidth,Werkzeug,wheel,wrapt,WTForms,zeep,importlib-metadata,zipp,packaging,pyparsing,designate,pbr,debtcollector,msgpack,netaddr,pyparsing,pytz,Babel,oslo.i18n,netifaces,iso8601,oslo.utils,oslo.serialization,stevedore,rfc3986,slo.config,os-service-types,keystoneauth1,python-keystoneclient,designate,PrettyTable,oslo.upgradecheck,monotonic,fasteners,oslo.concurrency,oslo.context,statsd,WebOb,oslo.middleware,tenacity,python-dateutil,pyinotify,oslo.log,greenlet,dnspython,eventlet,os-win,dogpile.cache,oslo.cache,pycadf,keystonemiddleware,repoze.lru,Routes,python-mimeparse,argparse,linecache2,traceback2,unittest2,extras,testtools,fixtures,PasteDeploy,Yappi,Paste,oslo.service,suds-jurko,Werkzeug,vine,amqp,kombu,cachetools,futurist,oslo.messaging,psutil,oslo.reports,jsonpointer,jsonpatch,appdirs,jmespath,munch,requestsexceptions,asn1crypto,pycparser,cffi,cryptography,openstacksdk,os-client-config,simplejson,colorama,wcwidth,attrs,pyperclip,cmd2,cliff,osc-lib,python-neutronclient,oslo.policy,oslo.rootwrap,waitress,WebTest,logutils,Mako,pecan,dnspython3,jsonschema,python-memcached,click,itsdangerous,Flask,SQLAlchemy,testresources,testscenarios,python-editor,alembic,sqlparse,Tempita,sqlalchemy-migrate,oslo.db,python-designateclient,oslo.versionedobjects,voluptuous,grpcio,tooz,monasca-statsd,designate

[root@repos ~]# pulp-admin -v python repo sync run --repo-id=vpnssl_pypi
----------------------------------------------------------------------
Synchronizing Repository [vpnssl_pypi]
--------------------------------------------------------------------

This command may be exited via ctrl+c without affecting the request.

Downloading Python metadata.
[========================================== ] 85%
186 of 217 items
... failed
Copying units already in pulp
[/]
... completed

Downloading and processing Python packages.
[==================================================] 100%
5690 of 5690 items
... completed

Task Succeeded

Publishing Python Metadata.
[/]

Task Failed

[Errno 17] File exists:
'/var/cache/pulp//63cb5ed4-e2ee-4163-a532
-8444fa49c2ff/vpnssl_pypi/simple/jupyter-core'
```

Actions #1

Updated by Poil over 4 years ago

I patch like this :

/usr/lib/python2.7/site-packages/pulp_python/plugins/distributors/steps.py

        if not os.path.exists(project_path):
            os.makedirs(project_path)

/usr/lib/python2.7/site-packages/pulp_python/plugins/distributors/steps.py

            if not os.path.exists(project_metadata_path):
                os.makedirs(project_metadata_path)
Actions #2

Updated by n.beernink about 4 years ago

Thanks Poil, I ran into the same problem and worked around it using your suggestion. Also opened a pull request here: https://github.com/pulp/pulp_python/pull/265

Actions #3

Updated by dalley almost 4 years ago

  • Platform Release set to 2.21.2
Actions #4

Updated by dalley almost 4 years ago

  • Status changed from NEW to MODIFIED
Actions #5

Updated by dalley almost 4 years ago

  • Status changed from MODIFIED to POST
Actions #6

Updated by dalley almost 4 years ago

  • Status changed from POST to MODIFIED

Added by dalley almost 4 years ago

Revision 0ee6680b | View on GitHub

Fix a mistake in the patch

closes: #5098 https://pulp.plan.io/issues/5098 (cherry picked from commit f1c18cb093c444c36ca1b76be035d11c82add9ff)

Actions #7

Updated by dalley almost 4 years ago

Actions #8

Updated by dalley almost 4 years ago

  • Status changed from MODIFIED to 5
Actions #9

Updated by dalley almost 4 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE

Also available in: Atom PDF