Project

Profile

Help

Task #3608

Create small, medium, large, and extra-large test fixtures

Added by dalley over 1 year ago. Updated 4 months ago.

Status:
CLOSED - COMPLETE
Priority:
Normal
Assignee:
Category:
-
Sprint/Milestone:
Start date:
Due date:
% Done:

0%

Platform Release:
Blocks Release:
Target Release - Python:
Backwards Incompatible:
No
Groomed:
Yes
Sprint Candidate:
No
Tags:
Pulp 2
QA Contact:
Complexity:
Smash Test:
Verified:
No
Verification Required:
No
Sprint:
Sprint 39

Description

In order to test certain things such as filtering or sync / repo version behavior, we need a richer set of test fixtures than what we currently have.

A completely non-binding suggestion for how this could work (this may be overkill, feel free to suggest something else):

  • python-pypi-xs would contain just 2-3 packages, one of each kind of packagetype, all from the same project
  • python-pypi-sm would contain ~10 packages, perhaps mostly with weird names or old/new metadata formats
  • python-pypi-md would contain ~50 packages from ~6 projects
  • python-pypi-lg would contain ~100 packages
  • python-pypi-xl would contain at least a couple hundred (and perhaps more than 1000) packages from lots of projects

It would be good to select packages to get a good breadth of options available for testing.

Extra-small would be for the most basic tests, and for the README.

Small could be for testing weird corner cases like making sure Pulp can handle weird characters in names/metadata, and metadata versions. And also a few tests where you want to test syncing from different remotes into one repo.

Medium and large would be mostly for testing filtering, so it would be good to have a variety of authors, projects, packagetypes, etc.

Extra-large would be exclusively for performance and load testing and not for normal tests. The primary purpose of these would avoid having to use lots of PyPI resources when stress-testing Pulp. We could also use this for performance optimization and maybe performance regression testing.

(Again, all of that is a suggestion and more opinions are welcome)

History

#1 Updated by dalley over 1 year ago

  • Subject changed from Create small, medium, and large test fixtures to Create small, medium, large, and extra-large test fixtures
  • Description updated (diff)
  • Tags Pulp 3 added

#2 Updated by bizhang over 1 year ago

  • Sprint/Milestone set to 3.0 beta release

#3 Updated by dalley over 1 year ago

  • Description updated (diff)

#4 Updated by dalley over 1 year ago

  • Description updated (diff)

#5 Updated by bizhang over 1 year ago

  • Sprint/Milestone deleted (3.0 beta release)

#6 Updated by dalley over 1 year ago

  • Description updated (diff)

#7 Updated by bizhang about 1 year ago

  • Sprint/Milestone set to 3.0 GA

#8 Updated by amacdona@redhat.com about 1 year ago

  • Groomed changed from No to Yes
  • Sprint Candidate changed from No to Yes

#9 Updated by rchan about 1 year ago

  • Sprint Candidate changed from Yes to No
  • Sprint set to Sprint 38

#10 Updated by bizhang about 1 year ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to bizhang

#11 Updated by rchan about 1 year ago

  • Sprint changed from Sprint 38 to Sprint 39

#12 Updated by bizhang about 1 year ago

  • Status changed from ASSIGNED to POST

#13 Updated by bizhang about 1 year ago

  • Status changed from POST to MODIFIED

#14 Updated by bizhang about 1 year ago

  • Status changed from MODIFIED to CLOSED - COMPLETE

#15 Updated by bmbouter 4 months ago

  • Tags Pulp 2 added

Please register to edit this issue

Also available in: Atom PDF