Project

Profile

Help

Send by e-mail

Task #3699

Story #3693: Lazy for Pulp3

Make the streamer create an Artifact and update ContentArtifact with the foreign key

Added by dkliban@redhat.com about 2 years ago. Updated 6 months ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
bmbouter
Category:
-
Sprint/Milestone:
3.0.0
Start date:
Due date:
% Done:

100%

Platform Release:
Blocks Release:
Backwards Incompatible:
No
Groomed:
No
Sprint Candidate:
No
Tags:
QA Contact:
Complexity:
Smash Test:
Verified:
No
Verification Required:
No
Sprint:

Description

If the ContentArtifact has policy="on_demand" then do the following:

After the streamer streams/downloads the content, an Artifact is created and associated with all ContentArtifact associated with the RemoteArtifact. Make sure right indexes exist to make this snappy.

If the ContentArtifact has policy="cache_only" then do not create or save anything.

Related issues

Blocked by Pulp - Task #3698: Make the streamer download using a configured downloader, configured by the correct remote. CLOSED - CURRENTRELEASE Actions

Associated revisions

Revision 8219efd5 View on GitHub
Added by bmbouter over 1 year ago

Adds the content app to pulpcore.content

The Settings can be a lot simpler now that the architecture no longer required redirection. It does need to account for the content being served on a different HOST. This PR handles that.

Since the settings are now single values, they are much easier to override using Dynaconf, which is great.

The content app can be removed now that the streamer code is handling it all.

This PR is a prototype and has no docs. Use Pulp as normal , but run the streamer from github.com/bmbouter/pulp_streamer/ and run the streamer with:

gunicorn pulpcore.streamer:server --bind localhost:8080 --worker-class aiohttp.GunicornWebWorker -w 2

This PR needs pulp-smash changes from pulp_file so it requires the PR below:

Required PR: https://github.com/pulp/pulp_file/pull/140

https://pulp.plan.io/issues/4239 closes #4239

https://pulp.plan.io/issues/3698 closes #3698

https://pulp.plan.io/issues/3699 closes #3699

https://pulp.plan.io/issues/4181 closes #4181

https://pulp.plan.io/issues/4243 closes #4243

Revision 8219efd5 View on GitHub
Added by bmbouter over 1 year ago

Adds the content app to pulpcore.content

The Settings can be a lot simpler now that the architecture no longer required redirection. It does need to account for the content being served on a different HOST. This PR handles that.

Since the settings are now single values, they are much easier to override using Dynaconf, which is great.

The content app can be removed now that the streamer code is handling it all.

This PR is a prototype and has no docs. Use Pulp as normal , but run the streamer from github.com/bmbouter/pulp_streamer/ and run the streamer with:

gunicorn pulpcore.streamer:server --bind localhost:8080 --worker-class aiohttp.GunicornWebWorker -w 2

This PR needs pulp-smash changes from pulp_file so it requires the PR below:

Required PR: https://github.com/pulp/pulp_file/pull/140

https://pulp.plan.io/issues/4239 closes #4239

https://pulp.plan.io/issues/3698 closes #3698

https://pulp.plan.io/issues/3699 closes #3699

https://pulp.plan.io/issues/4181 closes #4181

https://pulp.plan.io/issues/4243 closes #4243

History

#1 Updated by dkliban@redhat.com about 2 years ago

  • Tags Pulp 3 added

#2 Updated by jortel@redhat.com almost 2 years ago

  • Description updated (diff)

#3 Updated by bmbouter almost 2 years ago

  • Description updated (diff)

Updates to allow for the "cache" versus "on_demand" policy options

#4 Updated by bmbouter almost 2 years ago

  • Description updated (diff)

It's called cache_only, not cache

#5 Updated by dkliban@redhat.com almost 2 years ago

  • Related to Task #3698: Make the streamer download using a configured downloader, configured by the correct remote. added

#6 Updated by dkliban@redhat.com almost 2 years ago

  • Related to deleted (Task #3698: Make the streamer download using a configured downloader, configured by the correct remote.)

#7 Updated by dkliban@redhat.com almost 2 years ago

  • Blocked by Task #3698: Make the streamer download using a configured downloader, configured by the correct remote. added

#8 Updated by CodeHeeler almost 2 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to CodeHeeler

#9 Updated by CodeHeeler over 1 year ago

  • Assignee changed from CodeHeeler to bmbouter

#10 Updated by bmbouter over 1 year ago

  • Status changed from ASSIGNED to POST

The github.com/bmbouter/pulp_streamer/ master branch currently does this so I'm moving to POST.

We can move to MODIFIED once the repo is moved to the Pulp organization pending a bigger review/test.

#12 Updated by bmbouter over 1 year ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100

#13 Updated by daviddavis about 1 year ago

  • Sprint/Milestone set to 3.0.0

#14 Updated by bmbouter about 1 year ago

  • Tags deleted (Pulp 3)

#15 Updated by bmbouter 6 months ago

  • Status changed from MODIFIED to CLOSED - CURRENTRELEASE

Please register to edit this issue

Send by e-mail

Also available in: Atom PDF