Project

Profile

Help

Pulp 3 Minimum Viable Product » History » Sprint/Milestone 28

bmbouter, 04/25/2017 08:10 PM
Posting results of the "Plugin API" MVP call

1 1 bmbouter
# Pulp 3.0.0 Minimum Viable Product (MVP)
2
3 21 bmbouter
<span style="color:red;">Lines highlighted in red need more attention.</span>
4 20 bmbouter
5 1 bmbouter
## Authentication
6
7 17 semyers
As an authenticated user I can manage user(s).
8
9
  - Add a user
10
  - View user(s)
11
  - Update any user detail
12
  - Delete a user
13
14
As an API user, I can have documentation to generate a JSON Web Token (JWT) without the server being online.
15
16
A user authenticated with HTTP/HTTPS "Basic" auth can acquire a non-expiring JWT to access the API.
17
18
  - The JWT shall have a created timestamp which can be used to invalidate
19
  - The JWT shall have a user identifier (its primary key)
20
21
I can authenticate to any API call using HTTP/HTTPS "Basic" auth with a username and password that Pulp stores.
22
23
  - The password is stored as a hash (for security).
24
25
As an API user, I can authenticate any API call with a JWT.
26
27
As an API user, I can invalidate all JWT tokens for a given user issued earlier than now.
28
29
As an authenticated user, when deleting a user 'foo', all of user 'foo's JWTs are invalidated.
30 1 bmbouter
31
## Repositories
32
33 18 dkliban@redhat.com
As an authenticated user, I can list all repos.
34
35
  - All fields are included
36
  - Pagination is supported
37 22 bmbouter
  - <span style="color:red;">Filtering support</span>
38 18 dkliban@redhat.com
39
As an authenticated user, I can CRUD a repository
40
41
  - Create a repo
42
  - Read a repo
43
  - Update all mutable repo fields
44 21 bmbouter
  - Delete a repo (asynchronous)
45 18 dkliban@redhat.com
46
As an authenticated user, I can list a repository's associated importers and publishers
47
48
  - All fields are included
49
  - Pagination is supported
50 22 bmbouter
  - <span style="color:red;">Filtering support</span>
51 18 dkliban@redhat.com
52
As an authenticated user, I can list content in a repository
53
54
  - All fields are included
55
  - Pagination is supported
56 22 bmbouter
  - <span style="color:red;">Filtering support</span>
57 1 bmbouter
58 20 bmbouter
<span style="color:red;">As an authenticated user, I can summarize content in a repo (including counts)</span>
59 18 dkliban@redhat.com
60
As an authenticated user, I can CRUD an importer
61
62
  - Create an importer
63
  - Read an importer
64
  - Update all mutable importer fields
65 21 bmbouter
  - Delete an importer (asynchronous)
66 18 dkliban@redhat.com
67
As an authenticated user, I can CRUD a publisher
68
69
  - Create a publisher
70
  - Read a publisher
71
  - Update all mutable publisher fields
72 21 bmbouter
  - Delete a publisher (asynchronous)
73 1 bmbouter
74
## Content Manipulation
75
76 19 bmbouter
As an authenticated user, I can trigger an importer to sync.
77
78
  - I can follow the progress of all syncs. (Syncs are asynchronous.)
79
  - I cannot pass "sync" options.
80
  - Auto-publish is not included as an importer property.
81
82
As an authenticated user, I can trigger a publisher to publish.
83
84
  - I can follow the progress of all publishes. (Publishes are asynchronous.)
85
  - I cannot pass "publish" options.
86
87 25 bmbouter
## Upload & Copy
88
89 19 bmbouter
As an authenticated user, I can upload files that will become part of a unit
90
91
As an authenticated user, I can create a unit based on uploaded files
92
93
As an authenticated user, I can associate a unit with a repo.
94
95
As an authenticated user, I can copy a unit(s) from one repo to another
96
97 22 bmbouter
  - <span style="color:red;">Filtering support for specifying the unit(s)</span>
98 1 bmbouter
  - I can follow the progress of all copies. (Copies are asynchronous.)
99 25 bmbouter
100
## Orphans
101 1 bmbouter
102 20 bmbouter
<span style="color:red;">As an authenticated user, I can clean up orphans</span>  
103
<span style="color:red;">\* I can follow the progress of all cleanups. (Cleanups are asynchronous.)</span>
104 1 bmbouter
105
## Filter
106
107
I can filter all nouns *(What is the meaning of "filter?" What is a noun?)*
108
109
## Task Management
110
111 22 bmbouter
As an authenticated user, I can list all tasks
112
113
  - Filtering support on \['state', 'id', 'group'\]
114
  - This does not include associated progress reports
115
116
As an authenticated user, I can see a detail view for a specific task
117
118
  - all attributes of a task
119
  - all associated progress reports
120
121
As an authenticated user, I can cancel a task
122
123
  - don't dare to use the DELETE verb!
124 1 bmbouter
125
## Task Group
126
127
I can view a summary of the status of all tasks in a group
128
129
## Event Listener Notifier
130
131
I can receive serialized task info via AMQP on each task save
132
133 12 Ichimonji10
*Can this be restated in more pedantic terms? Does this mean that an arbitrary host can attach itself to Pulp's AMQP message bus and get updates on the progress of tasks?*
134
135 1 bmbouter
## Status
136
137
I can view the status of all pulp components  
138
I can view an overall health attribute  
139
I can view information about unapplied migrations
140
141
## Plugin API
142
143 28 bmbouter
As a plugin writer, I have a plugin API that is semantically versioned at 0.x separate from the REST API
144 1 bmbouter
145 28 bmbouter
As a plugin writer, I can report progress with a message and state
146 1 bmbouter
147 28 bmbouter
As a plugin writer, I can report progress with an optional suffix
148
149
As a plugin writer, I can report progress with a total count of things to do an the current count of things done
150
151
As a plugin writer, non-fatal exceptions a on the Task and are included in the Task detail. non_fatal exceptions do not cause the Task to be marked as failed, but may be interpreted by the user as not fully successful.
152
153
As a plugin writer, the working directory is set before Task work is done and cleaned up afterwards. I should not need to interact with the file system outside of the working dir.
154
155
As a plugin writer, I can provide a subclassed Importer. The importer's responsibility is to synchronize the content of a Pulp repository with the content of a remote repository.
156
157
As a plugin writer, I can provide a subclassed Publisher. The publisher's responsibility is to publish content.
158
159
As a plugin writer, I can define unit types by subclassing Content models to provide concrete content unit types to be manged by the platform.
160
161
As a plugin writer, I can interact with and create Artifacts
162
163
As a plugin writer, my app will be discovered by Pulp's app via an entry point provided by the plugin writer
164
165
As a plugin writer, I can use the plugin API to query content units/artifacts associated with a repository.
166
167
As a plugin writer, I can assocate/disassociate content units with a repository.
168 6 Ichimonji10
169 1 bmbouter
## CLI
170
171 8 Ichimonji10
We will port what is there with as little effort as possible *(Does this mean that porting will be easy for developers, or that switching from the Pulp 2-3 CLI will be easy for users? If the former, isn't this an implementation detail that doesn't belong in an MVP document? If the latter, does this mean that we're going to carry forward the issues with pulp-admin, like a lack of status codes?)*
172
173 1 bmbouter
repo CRUD  
174
CRUD for importers  
175
CRUD for publishers  
176
trigger syncs  
177
trigger publish  
178
list content in a repo  
179
upload  
180
server status  
181
list and cancel tasks  
182 8 Ichimonji10
authn via basic auth  
183
*(Should the supported set of operations be stated in terms of "The capabilities listed in the 'Authenctication,' 'Repositories,' and 'Filter' sections will be supported by the CLI."?)*
184 1 bmbouter
185 24 bmbouter
## Download API
186 1 bmbouter
187 26 bmbouter
As a plugin writer, I can download files via
188
189
  - http://
190
  - https://
191
  - file://
192
193
As a plugin writer, I can configure a downloader with:
194
195
  - Basic Auth
196 27 bmbouter
  - SSL Cert Client Auth
197
  - Custom CAs will be configured via a "trust store" either on the system or similar. Pulp will not do anything to read/load/manage CAs directly.
198 26 bmbouter
199
As a plugin writer, I can provide arbitrary behaviors for customized downloaders
200
201
  - For example token authentication in the docker plugin
202
203
As a plugin writer, I can have connection pooling/reuse
204
205
As a plugin writer, I have proxy settings
206
207
  - proxy url (containing basic auth info)
208
209
As a plugin writer, I can have great logs
210
211
As a user, I have documentation about how to use something for bandwidth limiting
212
213
As a plugin writer, I can configure the validation mechanisms used at download time
214
215
  - checksum validation - minimum (md5, sha1, sha256, sha512)
216
  - size validation
217
218
<span style="color:red;">As a plugin writer, I expect units that are missing from the remote repository to not be created in Pulp when using the immediate download policy.</span>
219
220
<span style="color:red;">As a plugin writer, I expect units that are missing from the remote repository to be created in Pulp when using background or on_demand download policies.</span>
221
222
As a plugin writer I can configure mirror lists and rotate between the mirrors
223
224
  - round robin
225
  - nearest mirror support
226
227
As a plugin writer, the plugin API provides tooling whereby I can provide the content to be added and removed from the repository. This tooling supports both immediate and deferred downloading.
228
229
As a plugin writer I can manage the catalog by using ChangeSets
230
231 1 bmbouter
As a plugin writer, the plugin can participate in adding content for cases where the decision to add additional content is based content that has been downloaded.
232 26 bmbouter
233 27 bmbouter
As a plugin writer, I can fetch content myself (but I am not encouraged to do so) with code I write
234 26 bmbouter
235
As a plugin writer, I can CRUD content units
236
237
## Alternate Content Source Support
238
239
<span class="Etc? Python? RPM? this? support will importers of types which things, importer-related an is this Assuming else? Something locations? of list prioritized a from content download to attempt may importer single a that mean it Does file://? and HTTPS HTTP, than other protocol a via downloaded be can content that mean this Does means. this what clarify Please" style="color:red;"></span>
240
241
  - Streamer parity with 2.y
242 1 bmbouter
243
## Consumer Applicability
244
245
Using consumer profiles and repo bindings I can compute applicability with 2.y parity  
246
Performance needs to be awesome
247
248 11 Ichimonji10
*(Is the Pulp Consumer going away in Pulp 3? If so, is this section still appropriate?)*
249
250 1 bmbouter
## Plugin compatibility
251
252
rpm will work with platform  
253
puppet will work with platform  
254
ostree will work with platform  
255
python will work with platform  
256
file_plugin will work with platform  
257
docker will work with platform
258
259
## Migrations
260
261
users can run an executable similar to pulp-manage-db that is not named pulp-manage-db *(Why the change in name?)*
262 20 bmbouter
263
<span style="color:red;">What about migrating fields that we don't use in 3.0 but will use in 3.1+. For example the auto-publish feature?</span>