Project

Profile

Help

Issue #4734

closed

Downloading content with virt-install causes exceptions in the pulp-content app

Added by bmbouter almost 5 years ago. Updated over 3 years ago.

Status:
CLOSED - WORKSFORME
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Sprint:
Quarter:

Description

With the latest source checkouts of pulpcore, pulpcore-plugin and the pulp_deb. Using pulp_lift you can easily get into this setup.

Then sync+publish w/ a script like:

# Sync Repository
export REPOSITORY=$(http POST :24817/pulp/api/v3/repositories/ name=debian_stretch | jq -r '._href')
export REMOTE=$(http POST :24817/pulp/api/v3/remotes/deb/apt/ name=debian_stretch policy=streamed url="http://ftp.de.debian.org/debian/" distributions=stretch components=main architectures=amd64 sync_udebs=True sync_installer=True | jq -r '._href')
export SYNC_TASK=$(http POST :24817${REMOTE}sync/ repository=${REPOSITORY} | jq -r '.task')
# wait for task to finish
export VERSION=$(http :24817${SYNC_TASK} | jq -r '.created_resources[0]')

# Publish Repository
export PUBLISHER=$(http POST :24817/pulp/api/v3/publishers/deb/verbatim/ name=verbatim_stretch | jq -r '._href')
export PUBLISH_TASK=$(http POST :24817${PUBLISHER}publish/ repository=${REPOSITORY} | jq -r '.task')
# wait for task to finish
export PUBLICATION=$(http :24817${PUBLISH_TASK} | jq -r '.created_resources[0]')
http POST :24817/pulp/api/v3/distributions/ name=verbatim_stretch base_path=verbatim_stretch publication=${PUBLICATION}

You'll need your local ports forwarding from all local interfaces to the pulplift VM for ports 24816 and 24817. You can do this with something like:

vagrant ssh pulp3-source-fedora29 -- -R 29437:localhost:29437 -R 29438:localhost:29438 -L *:24816:127.0.0.1:24816 -L *:24817:127.0.0.1:24817

Then virt-install with a command like:

virt-install     \
    --name deb-pulp-install \
    --disk size=10 \
    --memory 1024 \
    --connect qemu:///system \
    --os-variant debian9 \
    --location http://192.168.122.1:24816/pulp/content/verbatim_stretch/dists/stretch/main/installer-amd64/ \
    --initrd-inject preseed.cfg

During the installation the pulp-content will continually emit errors like this:

Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]: [2019-04-24 19:43:33 +0000] [3266] [ERROR] Unhandled exception
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]: Traceback (most recent call last):
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/aiohttp/web_protocol.py", line 447, in start
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:     await resp.prepare(request)
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/aiohttp/web_response.py", line 353, in prepare
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:     return await self._start(request)
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/aiohttp/web_response.py", line 667, in _start
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:     return await super()._start(request)
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/aiohttp/web_response.py", line 410, in _start
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:     await writer.write_headers(status_line, headers)
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/aiohttp/http_writer.py", line 112, in write_headers
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:     self._write(buf)
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:   File "/usr/local/lib/pulp/lib64/python3.7/site-packages/aiohttp/http_writer.py", line 67, in _write
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]:     raise ConnectionResetError('Cannot write to closing transport')
Apr 24 19:43:33 pulp3-source-fedora29.localhost.example.com gunicorn[3255]: ConnectionResetError: Cannot write to closing transport

Also available in: Atom PDF