Task #3698
closed
Story #3693: Lazy for Pulp3
Make the streamer download using a configured downloader, configured by the correct remote.
100%
Description
The inbound request is mapped to a RemoteArtifact just like the Content app does. After that it gets the url and remote from there. It then can:
- forward headers first, then stream data
- Header injection requirements from squid (see old streamer)
- asyncio not twisted
Related issues
Updated by dkliban@redhat.com over 5 years ago
- Groomed changed from No to Yes
- Sprint Candidate changed from No to Yes
Updated by dkliban@redhat.com over 5 years ago
- Related to Task #3699: Make the streamer create an Artifact and update ContentArtifact with the foreign key added
Updated by dkliban@redhat.com over 5 years ago
- Related to deleted (Task #3699: Make the streamer create an Artifact and update ContentArtifact with the foreign key)
Updated by dkliban@redhat.com over 5 years ago
- Blocks Task #3699: Make the streamer create an Artifact and update ContentArtifact with the foreign key added
Updated by CodeHeeler over 5 years ago
- Status changed from NEW to ASSIGNED
- Assignee set to CodeHeeler
Updated by CodeHeeler over 5 years ago
- Assignee changed from CodeHeeler to bmbouter
Updated by bmbouter over 5 years ago
- Status changed from ASSIGNED to POST
The github.com/bmbouter/pulp_streamer/ master branch currently does this so I'm moving to POST.
We can move to MODIFIED once the repo is moved to the Pulp organization pending a bigger review/test.
Updated by bmbouter over 5 years ago
PR available here: https://github.com/pulp/pulp/pull/3779
Added by bmbouter over 5 years ago
Added by bmbouter over 5 years ago
Revision 8219efd5 | View on GitHub
Adds the content app to pulpcore.content
The Settings can be a lot simpler now that the architecture no longer required redirection. It does need to account for the content being served on a different HOST. This PR handles that.
Since the settings are now single values, they are much easier to override using Dynaconf, which is great.
The content app can be removed now that the streamer code is handling it all.
This PR is a prototype and has no docs. Use Pulp as normal , but run the streamer from github.com/bmbouter/pulp_streamer/ and run the streamer with:
gunicorn pulpcore.streamer:server --bind localhost:8080 --worker-class aiohttp.GunicornWebWorker -w 2
This PR needs pulp-smash changes from pulp_file so it requires the PR below:
Required PR: https://github.com/pulp/pulp_file/pull/140
https://pulp.plan.io/issues/4239 closes #4239
https://pulp.plan.io/issues/3698 closes #3698
https://pulp.plan.io/issues/3699 closes #3699
Updated by bmbouter over 5 years ago
- Status changed from POST to MODIFIED
- % Done changed from 0 to 100
Applied in changeset pulp|8219efd59098fc5e883ea831d4fb38b7ae15422d.
Updated by bmbouter over 4 years ago
- Status changed from MODIFIED to CLOSED - CURRENTRELEASE
.
Adds the content app to pulpcore.content
The Settings can be a lot simpler now that the architecture no longer required redirection. It does need to account for the content being served on a different HOST. This PR handles that.
Since the settings are now single values, they are much easier to override using Dynaconf, which is great.
The content app can be removed now that the streamer code is handling it all.
This PR is a prototype and has no docs. Use Pulp as normal , but run the streamer from github.com/bmbouter/pulp_streamer/ and run the streamer with:
gunicorn pulpcore.streamer:server --bind localhost:8080 --worker-class aiohttp.GunicornWebWorker -w 2This PR needs pulp-smash changes from pulp_file so it requires the PR below:
Required PR: https://github.com/pulp/pulp_file/pull/140
https://pulp.plan.io/issues/4239 closes #4239
https://pulp.plan.io/issues/3698 closes #3698
https://pulp.plan.io/issues/3699 closes #3699
https://pulp.plan.io/issues/4181 closes #4181
https://pulp.plan.io/issues/4243 closes #4243