Project

Profile

Help

Pulp3 Plugin Brainstorming » History » Sprint/Milestone 4

dkliban@redhat.com, 08/21/2017 04:57 PM

1 1 bmbouter
-----
2
3
Content Unit Creator - Downloads and creates objects
4
5 4 dkliban@redhat.com
  - Processes content units in slices
6
  - Determines which content units in a slice are already present in Pulp
7
  - For immediate download policy, determines which artifacts in a slice are already present in Pulp
8
  - Downloads all artifacts for each content unit 
9 1 bmbouter
  - Saves all necessary units to the db after downloading all artifacts
10 4 dkliban@redhat.com
  - Handles race conditions for db around object creation
11 1 bmbouter
  - Transactional support around unit creation to ensure always creating a complete content unit or none
12
13
open questions: should this associate each unit as its made?
14
15
-----
16
17
Content Unit Downloader - Parallelized downloads, but it emits a content unit only when all files are downloaded
18
19
  - manages the asyncio loop for you
20
  - abstracts the collecting of downloads for a given content unit
21
  - driven by a simple loop
22
23
-----
24
25
Concurrent Downloader - Downloads any number of artifacts in parallel
26
27
  - provides digest and size validation
28
  - yields a file that is written to a temp area and all digests which were computed during download
29
  - you provide the asyncio loop
30
  - constrains the number of connections
31
  - share resources such as sessions,connection pools and auth tokens
32
33
-----
34
35 3 bmbouter
Synchronous Downloader - download a single file synchronously
36 1 bmbouter
37
  - blocking call so one download at a time
38
  - provides digest and size validation
39
  - yields a file that is written to a temp area and all digests which were computed during download
40
41
-----