Project

Profile

Help

31+ Ideas (post MVP) » History » Sprint/Milestone 27

amacdona@redhat.com, 04/11/2018 05:04 PM

1 12 bmbouter
# Core 3.1+ Ideas (post MVP)
2 1 bmbouter
3 11 bmbouter
## Authentication
4 1 bmbouter
5
  - External
6
  - Expiring passwords
7
  - REMOTE_USER support?
8
9 24 bmbouter
As an API user, I can have documentation to generate a JSON Web Token (JWT) without the server being online.
10
11
As an administrator, I can disable JWT token expiration. This configuration is in the settings file and is system-wide.
12
13
As an administrator, I can configure the JWT tokens to expire after a configurable amount of time. This configuration is in the settings file and is system-wide.
14
15
The JWT shall have a username identifier
16
17
As an API user, I can authenticate any API call with a valid JWT
18
19
As a JWT authenticated user, I can refresh my JWT token if Pulp is configured with JWT_ALLOW_REFRESH set to True (default is False)
20
21
As an API user, I can invalidate all existing JWT tokens for a given user.
22
23
As an authenticated user, when deleting a user 'foo', all of user 'foo's existing JWTs are invalidated.
24
25
As an un-authenticated user, I can obtain a JWT token by using a username and password.
26
27 25 bmbouter
## Metalink 4.0 support
28
29 26 ttereshc
As a plugin writer I can hand metalink URLs without digest to HttpDownloaders and have them Do The Right Thing™ \[[3415](https://pulp.plan.io/issues/3415)\]
30 25 bmbouter
31 11 bmbouter
## Authorization
32 1 bmbouter
33
\<put ideas here\>
34
35 11 bmbouter
## Versioned Repository
36 1 bmbouter
37 27 amacdona@redhat.com
As an authenticated user, I can create a repository version from any repository version
38
39 22 bmbouter
As an authenticated user, I can get a list of a repo's versions.
40 6 bmbouter
41 22 bmbouter
As an authenticated user, I can specify how many versions to keep at a time.
42 6 bmbouter
43 22 bmbouter
As an authenticated user, I can get a reference to a new repo version from any task that adds or removes content.
44 6 bmbouter
45 22 bmbouter
As an authenticated user, I can publish a repo and have it default to the latest version.
46 6 bmbouter
47 22 bmbouter
As an authenticated user, I can run a publisher with a repository version.
48 1 bmbouter
49 11 bmbouter
## Content Manipulation
50 2 bmbouter
51
  - Sync can have "sync" options.
52
  - Sync options are different than "importer" attributes.
53
54 14 bmbouter
As an authenticated user, I can remove one or more units from one or more repositories
55
56
  - filtering support on the unit(s)
57
  - filtering support on the repositories
58
59 22 bmbouter
As an authenticated user I can specify a filter to identify content to be added to a repo
60 16 bmbouter
61 21 bmbouter
## Content Deletion
62
63
As an authenticated user, artifacts are deleted if they were exclusively used by the content unit
64
65
As an authenticated user, I can delete multiple content units with filtering
66
67
  - If a content unit is still in at least one repository the delete fails with a listing of all repositories the unit is part of.
68
  - Artifacts and associated files from deleted units are cleaned up
69
70 19 bmbouter
## Content Filtering
71
72
As a user, I can search all content for a specific content unit regardless of type
73
74
As a user, I can find out all the repos in which a piece of content appears
75
76
  - example: bad content the user wants to remove from all repos in Pulp
77
78 20 bmbouter
## Publications
79
80
As an authenticated user, I have filters on the Publication list:
81
82
  - id: (id_in_list) \# id equality is not necessary, objects are referenced by id
83
  - filter by created range
84
  - filter by not associated w/ distribution.
85
86 11 bmbouter
## Upload
87 5 bmbouter
88
  - Allow for a large single file to have its chunks uploaded in parallel.
89
90 18 amacdona@redhat.com
Repositories 3.1+  
91
filter by content type(ex. repository_contains_type: rpm)  
92
last_content_added(content_added_since)  
93
last_content_removed(content_removed_since)  
94
"partial" repo name search (name: substring)  
95
"tagged" repo names (name: substring)
96
97
Importer 3.1+
98
99 11 bmbouter
## Importers
100 1 bmbouter
101
  - Sync from multiple importers
102
  - We need to support multiple importers to properly support distributions and ostree (with distributions).
103
  - add auto-publish feature
104
  - As an authenticated user I have a notes field I can use to store arbitrary \<key, value\> tuples with both key and value being strings.
105 11 bmbouter
  - Add the force-full option.
106 18 amacdona@redhat.com
  - add filter for last_synced, either last_synced_lt or last_syced_in_range
107
  - add filter by repository if we no longer nest
108
  - add filter for feed_url: (equality, substring)
109 1 bmbouter
110 11 bmbouter
## Publishers
111 2 bmbouter
112 11 bmbouter
  - Add an auto_publish feature. Possibly a field called auto_publish \[default to true\] that indicates that the publisher will publish automatically when the associated repository's content has changed.
113 1 bmbouter
  - Add the force-full option.
114 12 bmbouter
  - Add a no-op publishing feature
115 11 bmbouter
116
## Task Management
117
118 3 bmbouter
Allow filtering of tasks on 'completed' or 'started'. These 'meta' states are not states directly, but they represent a group of states. For instance 'completed' would be represent 'skipped', 'completed', 'failed', and 'canceled'.
119
120
Additional filtering support:
121 1 bmbouter
122 3 bmbouter
  - worker
123
  - started_at, filtered by less than, greater than
124 1 bmbouter
  - finished_at, filtered by less than, greater than
125 3 bmbouter
  - resource field on an associated ReservedResource
126
127
As an authenticated user I can DELETE a task
128
129 11 bmbouter
## Data Exports
130 4 bmbouter
131
As an authenticated user, I can export a group of published repositories to a single media
132
133
As an authenticated user, I can export an incremental publish of a group of repositories to a single media
134
135
For both use cases \^, the layout needs some more discussion.
136
137
  - maybe it is specified by the user?
138 1 bmbouter
  - maybe it is maintains the published filesystem tree structure?
139
140 4 bmbouter
Also there are two main options in this area.
141
142
1\. One is a publish bundler that bundles up all the units published to disk. Then this media (e.g. an iso) is mounted and brought into another Pulp installation using a sync. This will only work for content types that don't require 'live APIs'
143
144
2\. Another option is to export database model data and disk content units from one Pulp to media and then import by directly adding those units to another Pulp. This could be done through the API possibly. This would allow things like Docker to be exported and imported, but it may not work for OSTree??
145
146 1 bmbouter
Also there was discussion about OSTree possibly never supporting and incremental export/import due to how OSTree stores content.
147
148
## Server Plugins (which content types are available and importers and publishers)
149 9 bmbouter
150
## Orphans
151
152 14 bmbouter
As an authenticated user, I can force delete content units even when associated with repositories.  
153
As an authenticated user, I can cleanup orphaned content units for a specific "type" without specifying the units specifically.  
154 15 bmbouter
As an authenticated user, I can filter orphan cleanup to only remove orphaned content units and artifacts created before a specified datetime.  
155
As an authenticated user, I list all orphaned content units and orphaned artifacts that are not in any repositories
156 1 bmbouter
157
## Plugin API
158
159
Incremental publishing support
160 23 bmbouter
161
## Consumer Profile Applicability
162
163
Using Consumer Profiles and repository bindings I can compute applicability with 2.y parity
164
165
  - Performance needs to be awesome
166
167
Glossary term:  
168
Consumer Profile - A set of installed units on a specific machine. In Pulp3 this machine is not a "consumer" in the same sense as Pulp2. Pulp is not "managing" the machine anymore; Pulp3 only collects Profile information.
169 8 dkliban@redhat.com
170 11 bmbouter
## Status API
171 8 dkliban@redhat.com
172
Status API return status of Squid (aka Proxy), web server, streamer
173
174
API to view an overall health attribute that returns a message when something is not operating properly or True.
175
176
I can view information about unapplied migrations
177
178 1 bmbouter
I can view a verbose Status API which returns a Pulp version for each component along with a list of all plugins and their versions.
179
180
## Alternate content source support
181 12 bmbouter
182 17 bmbouter
## Deployment
183
184 22 bmbouter
As a user, I can deploy the Pulp content serving view without all of Pulp's requirements.
185 17 bmbouter
186 12 bmbouter
# Plugin Feature Set 3.1+ Ideas (post MVP)
187
188
## Python
189
190
  - Add a mirror sync policy
191 13 mhrivnak
192
## Event Listener Notifier
193
194
I can receive serialized task info via AMQP on each task save
195
196
*Can this be restated in more pedantic terms? Does this mean that an arbitrary host can attach itself to Pulp's AMQP message bus and get updates on the progress of tasks?*