Project

Profile

Help

31+ Ideas (post MVP) » History » Sprint/Milestone 20

bmbouter, 11/28/2017 08:18 PM
Posting results of the "Publication use cases" MVP call

1 12 bmbouter
# Core 3.1+ Ideas (post MVP)
2 1 bmbouter
3 11 bmbouter
## Authentication
4 1 bmbouter
5
  - External
6
  - Expiring passwords
7
  - REMOTE_USER support?
8
9 11 bmbouter
## Authorization
10 1 bmbouter
11
\<put ideas here\>
12
13 11 bmbouter
## Versioned Repository
14 1 bmbouter
15 6 bmbouter
<span style="color:red;">As an authenticated user, I can get a list of a repo's versions.</span>
16
17
<span style="color:red;">As an authenticated user, I can specify how many versions to keep at a time.</span>
18
19 7 bmbouter
<span style="color:red;">As an authenticated user, I can get a reference to a new repo version from any task that adds or removes content.</span>
20 6 bmbouter
21
<span style="color:red;">As an authenticated user, I can publish a repo and have it default to the latest version.</span>
22
23
<span style="color:red;">As an authenticated user, I can run a publisher with a repository version.</span>
24 1 bmbouter
25 11 bmbouter
## Content Manipulation
26 2 bmbouter
27
  - Sync can have "sync" options.
28
  - Sync options are different than "importer" attributes.
29
30 14 bmbouter
As an authenticated user, I can remove one or more units from one or more repositories
31
32
  - filtering support on the unit(s)
33
  - filtering support on the repositories
34
35 16 bmbouter
<span style="color:red;">As an authenticated user I can specify a filter to identify content to be added to a repo</span>
36
37 19 bmbouter
## Content Filtering
38
39
As a user, I can search all content for a specific content unit regardless of type
40
41
As a user, I can find out all the repos in which a piece of content appears
42
43
  - example: bad content the user wants to remove from all repos in Pulp
44
45 20 bmbouter
## Publications
46
47
As an authenticated user, I have filters on the Publication list:
48
49
  - id: (id_in_list) \# id equality is not necessary, objects are referenced by id
50
  - filter by created range
51
  - filter by not associated w/ distribution.
52
53 11 bmbouter
## Upload
54 5 bmbouter
55
  - Allow for a large single file to have its chunks uploaded in parallel.
56
57 18 amacdona@redhat.com
Repositories 3.1+  
58
filter by content type(ex. repository_contains_type: rpm)  
59
last_content_added(content_added_since)  
60
last_content_removed(content_removed_since)  
61
"partial" repo name search (name: substring)  
62
"tagged" repo names (name: substring)
63
64
Importer 3.1+
65
66 11 bmbouter
## Importers
67 1 bmbouter
68
  - Sync from multiple importers
69
  - We need to support multiple importers to properly support distributions and ostree (with distributions).
70
  - add auto-publish feature
71
  - As an authenticated user I have a notes field I can use to store arbitrary \<key, value\> tuples with both key and value being strings.
72 11 bmbouter
  - Add the force-full option.
73 18 amacdona@redhat.com
  - add filter for last_synced, either last_synced_lt or last_syced_in_range
74
  - add filter by repository if we no longer nest
75
  - add filter for feed_url: (equality, substring)
76 1 bmbouter
77 11 bmbouter
## Publishers
78 2 bmbouter
79 11 bmbouter
  - Add an auto_publish feature. Possibly a field called auto_publish \[default to true\] that indicates that the publisher will publish automatically when the associated repository's content has changed.
80 1 bmbouter
  - Add the force-full option.
81 12 bmbouter
  - Add a no-op publishing feature
82 11 bmbouter
83
## Task Management
84
85 3 bmbouter
Allow filtering of tasks on 'completed' or 'started'. These 'meta' states are not states directly, but they represent a group of states. For instance 'completed' would be represent 'skipped', 'completed', 'failed', and 'canceled'.
86
87
Additional filtering support:
88 1 bmbouter
89 3 bmbouter
  - worker
90
  - started_at, filtered by less than, greater than
91 1 bmbouter
  - finished_at, filtered by less than, greater than
92 3 bmbouter
  - resource field on an associated ReservedResource
93
94
As an authenticated user I can DELETE a task
95
96 11 bmbouter
## Task Scheduling
97 5 bmbouter
98
  - As an authenticated user, I can schedule a task.
99 1 bmbouter
100 11 bmbouter
## Data Exports
101 4 bmbouter
102
As an authenticated user, I can export a group of published repositories to a single media
103
104
As an authenticated user, I can export an incremental publish of a group of repositories to a single media
105
106
For both use cases \^, the layout needs some more discussion.
107
108
  - maybe it is specified by the user?
109 1 bmbouter
  - maybe it is maintains the published filesystem tree structure?
110
111 4 bmbouter
Also there are two main options in this area.
112
113
1\. One is a publish bundler that bundles up all the units published to disk. Then this media (e.g. an iso) is mounted and brought into another Pulp installation using a sync. This will only work for content types that don't require 'live APIs'
114
115
2\. Another option is to export database model data and disk content units from one Pulp to media and then import by directly adding those units to another Pulp. This could be done through the API possibly. This would allow things like Docker to be exported and imported, but it may not work for OSTree??
116
117 1 bmbouter
Also there was discussion about OSTree possibly never supporting and incremental export/import due to how OSTree stores content.
118
119
## Server Plugins (which content types are available and importers and publishers)
120 9 bmbouter
121
## Orphans
122
123 14 bmbouter
As an authenticated user, I can force delete content units even when associated with repositories.  
124
As an authenticated user, I can cleanup orphaned content units for a specific "type" without specifying the units specifically.  
125 15 bmbouter
As an authenticated user, I can filter orphan cleanup to only remove orphaned content units and artifacts created before a specified datetime.  
126
As an authenticated user, I list all orphaned content units and orphaned artifacts that are not in any repositories
127 1 bmbouter
128 12 bmbouter
## Plugin API
129 1 bmbouter
130 12 bmbouter
Incremental publishing support
131 8 dkliban@redhat.com
132 11 bmbouter
## Status API
133 8 dkliban@redhat.com
134
Status API return status of Squid (aka Proxy), web server, streamer
135
136
API to view an overall health attribute that returns a message when something is not operating properly or True.
137
138
I can view information about unapplied migrations
139
140 1 bmbouter
I can view a verbose Status API which returns a Pulp version for each component along with a list of all plugins and their versions.
141
142
## Alternate content source support
143 12 bmbouter
144 17 bmbouter
## Deployment
145
146
<span style="color:red;">As a user, I can deploy the Pulp content serving view without all of Pulp's requirements.</span>
147
148 12 bmbouter
# Plugin Feature Set 3.1+ Ideas (post MVP)
149
150
## Python
151
152
  - Add a mirror sync policy
153 13 mhrivnak
154
## Event Listener Notifier
155
156
I can receive serialized task info via AMQP on each task save
157
158
*Can this be restated in more pedantic terms? Does this mean that an arbitrary host can attach itself to Pulp's AMQP message bus and get updates on the progress of tasks?*