Skip creating new repo versions when content has not changed
Per our discussion on pulp-dev0, we should stop creating new repo versions if content has not changed. To recap the reasons:
- They were meant to serve as a historical record but this information is available by looking at the tasks api
- It creates additional, unnecessary versions and bumps the latest version number of the repo
- If we ever have a feature to retain only the latest X repo versions, it'll be less useful since some repo versions may not have any changes
I believe sync is the only place that needs to be updated but we may also need to consider any other places in the code.
Also, we should document that this is the intended behavior.
Update tests to not rely on version always incrementing.
#2 Updated by email@example.com about 2 years ago
- Status changed from NEW to CLOSED - WONTFIX
This is correct behavior. A new RepositoryVersion needs to be created, even if the sync does not add or remove any content units.
The reasoning for this is made clear by a worker crash scenario. When a sync is started, a new RepositoryVersion is created, (number= 2) and Repository.last_version = 2. Before the sync is completed, the worker crashes. While the crash is waiting to be cleaned up, a second sync task is run, which creates another new RepositoryVersion. The second sync task creates a new RepositoryVersion(number=3). If the crash/failure cleanup decrements Repository.last_version, then Repository.last_version will be incorrect, leading to duplicate key errors.
All of this complexity goes away if we have "empty" RepositoryVersions, which can be deleted by the user.
#5 Updated by daviddavis 8 months ago
- Status changed from CLOSED - WONTFIX to NEW
In pulp_ansible, we couldn't use the Stages code and we made the decision to NOT create a repo version when content doesn't change. This of course is not consistent with other plugins. I am reopening this issue to rediscuss this and also to make sure we have proper docs around the correct behavior for plugin writers.
- Subject changed from Sync of unchanged importer update repo version to Document that a repo version is expected to be created for all sync's regardles of if there is new content remotely or now
- Description updated (diff)
- Sprint set to Sprint 54
- Tags Documentation added
After discussion during today's open floor we decided:
1) the current behavior is a good behavior. It's less surprising to users when they ask Pulp to sync and receive a repo version N+1 that is that same as repo version N, and more confusing if they get some repo verisons for some sync's and not for others depending on the remote state.
2) We should document this expectation in the plugin write API, so now this is a docs story
3) it should go on the sprint
#16 Updated by daviddavis 3 months ago
- Tracker changed from Story to Task
- Subject changed from Document that a repo version is expected to be created for all sync's regardles of if there is new content remotely or now to Skip creating new repo versions when content has not changed
- Description updated (diff)
- Tags deleted (
Please register to edit this issue