Task #3608
closedCreate small, medium, large, and extra-large test fixtures
0%
Description
In order to test certain things such as filtering or sync / repo version behavior, we need a richer set of test fixtures than what we currently have.
A completely non-binding suggestion for how this could work (this may be overkill, feel free to suggest something else):
- python-pypi-xs would contain just 2-3 packages, one of each kind of packagetype, all from the same project
- python-pypi-sm would contain ~10 packages, perhaps mostly with weird names or old/new metadata formats
- python-pypi-md would contain ~50 packages from ~6 projects
- python-pypi-lg would contain ~100 packages
- python-pypi-xl would contain at least a couple hundred (and perhaps more than 1000) packages from lots of projects
It would be good to select packages to get a good breadth of options available for testing.
Extra-small would be for the most basic tests, and for the README.
Small could be for testing weird corner cases like making sure Pulp can handle weird characters in names/metadata, and metadata versions. And also a few tests where you want to test syncing from different remotes into one repo.
Medium and large would be mostly for testing filtering, so it would be good to have a variety of authors, projects, packagetypes, etc.
Extra-large would be exclusively for performance and load testing and not for normal tests. The primary purpose of these would avoid having to use lots of PyPI resources when stress-testing Pulp. We could also use this for performance optimization and maybe performance regression testing.
(Again, all of that is a suggestion and more opinions are welcome)