Project

Profile

Help

Maintenance: Planio will be observing a scheduled maintenance window this Tuesday, November 5, 2024 from 03:00 UTC until 06:30 UTC to perform urgent network maintenance in our primary data center. Your Planio account will be unavailable during this maintenance window.

Test Day on August 8 2017 » History » Sprint/Milestone 36

kdelee@redhat.com, 08/03/2017 07:45 PM

1 1 kdelee@redhat.com
# Test Day for 2.14 and pulp deb plugin
2
3 10 kdelee@redhat.com
## Join us on August 8, 2017 to test the 2.14 release and the new pulp_deb plugin!
4
5 1 kdelee@redhat.com
## Contents
6
7 12 kdelee@redhat.com
>   - How to join
8 36 kdelee@redhat.com
>   - How to contribute
9 4 kdelee@redhat.com
>   - Who is available for help
10 1 kdelee@redhat.com
>   - Prerequisites for test day
11
>   - Resources ( where to get RPMs, fedora images, etc)
12
>   - How to test
13
>   - Confirming existing issues
14
>   - Filing new issues
15
>   - How to report results
16
17
### Can't make the date?
18
19
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find here on https://pulp.plan.io, and report your results as detailed in "How to report results" section below.
20
21
## How to join
22
23
Join the [#pulp channel on freenode](http://irc.netsplit.de/channels/details.php?room=%23pulp&net=freenode)  
24
You can join via your favorite IRC client, or either of the two web clients below:
25
26
[pulp channel on irc2go](http://en.irc2go.com/webchat/?net=freenode&room=pulp)  
27 35 kdelee@redhat.com
[pulp channel on freenode webchat](http://webchat.freenode.net/?channels=%23pulp&uio=d4)
28 1 kdelee@redhat.com
29
Specify a nickname that you would like to go by, and keep it safe for work please!  
30
Many people choose something close to their name, as in Elijah's nickname is "elijah_d".
31
32 36 kdelee@redhat.com
## == How to contribute ==
33 1 kdelee@redhat.com
34
The August 8th Pulp Test Day will focus on the [Pulp 2.14 beta release](http://docs.pulpproject.org/en/2.14/testing/user-guide/release-notes/2.14.x.html#pulp-2-14-release-notes) and the new [pulp debian plugin](https://github.com/pulp/pulp_deb/#debian-support)
35
36 36 kdelee@redhat.com
  - Collaborate with a Pulp QE member to provide a guide for installing on an cloud instance \[ ask in #pulp\](http://webchat.freenode.net/?channels=%23pulp&uio=d4)
37
  - walk through a [manual upgrade from an existing pulp install](http://docs.pulpproject.org/en/nightly/user-guide/release-notes/2.14.x.html#upgrade-instructions), 
38
  - installing manually both [pulp](http://docs.pulpproject.org/user-guide/installation/index.html) and the [pulp_debian plugin](https://github.com/pulp/pulp_deb/#installation) 
39
  - Install using [ansible](https://pulp.plan.io/projects/pulp/wiki/Virtualization_quickstart#SETTING-UP-ANSIBLE-on-the-VM) and moving on to confirming functionality of the project, that bugs that were fixed in the release are indeed fixed, or other exploratory testing.
40 1 kdelee@redhat.com
41
## == Who's available ==
42
43
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion.
44
45
### Quality Engineering
46
47 7 kdelee@redhat.com
  - Elijah DeLee (email: kdelee@redhat.com irc: elijah_d)
48
  - Preethi Thomas (email: pthomas@redhat.com irc: preethi) 
49
  - Kersom Oliveira (email: koliveir@redhat.com irc: kersom)
50 1 kdelee@redhat.com
  - Jeremy Audet (email: jaudet@redhat.com irc: Ichimonji10)
51
52 6 kdelee@redhat.com
Specifically in the case of problem related to test day wiki, please reach out to Elijah DeLee at kdelee@redhat.com or on irc (nick: elijah_d)
53 1 kdelee@redhat.com
54 5 kdelee@redhat.com
## == Prerequisite for Test Day ==
55 1 kdelee@redhat.com
56 14 kdelee@redhat.com
  - Fedora 24, 25, or 26, RHEL 7, CentOS 7 system ( bare metal or VM )
57 1 kdelee@redhat.com
  - Root access on the system
58
59 15 kdelee@redhat.com
For a guide on some ways to spin up a VM on your machine. see [[Virtualization quickstart]]
60 1 kdelee@redhat.com
61 7 kdelee@redhat.com
## == Resources (where to get RPMs, fedora images, etc) ==
62 1 kdelee@redhat.com
63
The Pulp 2.14 beta repository is included in the pulp repo files:  
64
https://repos.fedorapeople.org/repos/pulp/pulp/fedora-pulp.repo for fedora 24 & 25  
65 4 kdelee@redhat.com
https://repos.fedorapeople.org/repos/pulp/pulp/rhel-pulp.repo for RHEL 7
66 1 kdelee@redhat.com
67 16 kdelee@redhat.com
You can also find the packages themselves here:  
68
https://repos.fedorapeople.org/pulp/pulp/beta/2.14/
69
70 4 kdelee@redhat.com
Fedora images:  
71 18 kdelee@redhat.com
You can find fedora "live" images here to install with:  
72 17 kdelee@redhat.com
[Fedora 25](http://mirrors.mit.edu/fedora/linux/releases/25/Workstation/x86_64/iso/)  
73
[Fedora 24](http://mirrors.mit.edu/fedora/linux/releases/24/Workstation/x86_64/iso/)  
74
[Fedora 26](http://mirrors.mit.edu/fedora/linux/releases/26/Workstation/x86_64/iso/)
75 1 kdelee@redhat.com
76 4 kdelee@redhat.com
## == How to test? ==
77 1 kdelee@redhat.com
78 7 kdelee@redhat.com
### == Run the tests ==  
79 9 kdelee@redhat.com
If you'd like to run the integration test suite, [pulp-smash](https://github.com/PulpQE/pulp-smash) or any individual tests, you can run them either locally on the pulp_server or remotely from any machine that can SSH into the pulp_server.
80 1 kdelee@redhat.com
81 7 kdelee@redhat.com
For docs on pulp-smash, see http://pulp-smash.readthedocs.io/en/latest/ where you can find instructions on how to install and configure pulp-smash to run against your pulp install.
82 1 kdelee@redhat.com
83 7 kdelee@redhat.com
If you have trouble, email us or ping us on IRC and we can help you get it set up!
84
85
### == Exploratory testing ==
86
87 1 kdelee@redhat.com
You can help out by playing around with the tool in whatever ways you can think of: try out all the things you can find.  
88 24 kdelee@redhat.com
Get creative! Any problems you find please file a bug, or report to the IRC channel. See [Filing new issues](https://pulp.plan.io/projects/pulp/wiki/Test_Day_on_August_8\_2017#Filing-new-issues)
89 1 kdelee@redhat.com
90 22 kdelee@redhat.com
Find the 2.14 User Guide [here.](http://docs.pulpproject.org/en/2.14/nightly/user-guide/index.html)  
91 23 kdelee@redhat.com
Find the 2.14 RPM Quick Start Guide [here.](http://docs.pulpproject.org/en/2.14/nightly/plugins/pulp_rpm/user-guide/quick-start.html)
92 22 kdelee@redhat.com
93 23 kdelee@redhat.com
Look for other quick start guides among the plugin documentation. Note that the main docs.pulpproject.org may direct you to docs for 2.13, check the URL to make sure you are looking at the right version.
94 21 kdelee@redhat.com
95 8 kdelee@redhat.com
Think [CRUD](https://en.wikipedia.org/wiki/Create,\_read,\_update_and_delete)  
96
As a user, you should be able to Create, Read, Update, and Delete repositories and the data within. Is this the case? Where do you run into trouble?
97
98 25 kdelee@redhat.com
## == Verifying existing issues ==
99 1 kdelee@redhat.com
100 7 kdelee@redhat.com
There are three different ways you can use existing issues.
101
102 26 kdelee@redhat.com
### 1\. Verify that user stories marked "closed" work
103 7 kdelee@redhat.com
104 27 kdelee@redhat.com
You can find closed "user stories" [here](https://pulp.plan.io/issues?utf8=%E2%9C%93&set_filter=1&f%5B%5D=cf_4&op%5Bcf_4%5D=%3D&v%5Bcf_4%5D%5B%5D=2.14.0&f%5B%5D=tracker_id&op%5Btracker_id%5D=%3D&v%5Btracker_id%5D%5B%5D=3&f%5B%5D=&c%5B%5D=project&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&c%5B%5D=cf_4&group_by=project&t%5B%5D=)
105 7 kdelee@redhat.com
106 26 kdelee@redhat.com
### 2\. Verify that bugs fixed in the 2.14 release are indeed fixed!
107 7 kdelee@redhat.com
108 28 kdelee@redhat.com
[Bugs fixed in 2.14](https://pulp.plan.io/issues?c[]=tracker&c[]=status&c[]=priority&c[]=cf_5&c[]=subject&c[]=author&c[]=assigned_to&c[]=cf_3&f[]=cf_4&f[]=tracker_id&f[]=&group_by=&op[cf_4]=%3D&op[tracker_id]=%3D&set_filter=1&sort=priority%3Adesc%2Ccf_5%3Adesc%2Cid%3Adesc&utf8=%E2%9C%93&v[cf_4][]=2.14.0&v[tracker_id][]=1)
109 7 kdelee@redhat.com
110 29 kdelee@redhat.com
### 3\. Recreate outstanding bugs
111 7 kdelee@redhat.com
112 29 kdelee@redhat.com
Validate existence of [outstanding bugs.](https://pulp.plan.io/issues?utf8=%E2%9C%93&set_filter=1&f%5B%5D=tracker_id&op%5Btracker_id%5D=%3D&v%5Btracker_id%5D%5B%5D=1&f%5B%5D=status_id&op%5Bstatus_id%5D=o&f%5B%5D=cf_34&op%5Bcf_34%5D=%21\*&f%5B%5D=cf_8&op%5Bcf_8%5D=%3D&v%5Bcf_8%5D%5B%5D=2.14.0&v%5Bcf_8%5D%5B%5D=2.13.3&v%5Bcf_8%5D%5B%5D=2.13.2&v%5Bcf_8%5D%5B%5D=2.13.1&v%5Bcf_8%5D%5B%5D=2.13.0&v%5Bcf_8%5D%5B%5D=2.12.2&v%5Bcf_8%5D%5B%5D=2.12.1&v%5Bcf_8%5D%5B%5D=2.12.0&v%5Bcf_8%5D%5B%5D=2.11.1&v%5Bcf_8%5D%5B%5D=2.11.0&v%5Bcf_8%5D%5B%5D=2.10.3&v%5Bcf_8%5D%5B%5D=2.10.2&v%5Bcf_8%5D%5B%5D=2.10.1&v%5Bcf_8%5D%5B%5D=2.10.0&f%5B%5D=&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&group_by=cf_8&t%5B%5D=)
113 7 kdelee@redhat.com
114 29 kdelee@redhat.com
If the bug is replicable and seems suitable for for pulp-smash tests, file an issue on [pulp-smash github issues](https://github.com/PulpQE/pulp-smash/issues)
115 7 kdelee@redhat.com
116 5 kdelee@redhat.com
## == Filing new issues ==
117 1 kdelee@redhat.com
118 30 kdelee@redhat.com
If you have problems with any of the tests, first search for a issue related to the same bug and add a comment on the issue at https://pulp.plan.io.
119
120
Otherwise, report the bug to https://pulp.plan.io in the appropriate project section.
121
122
For example, you can file a new bug or find an existing issue for the debian plugin under the [Debain issues](https://pulp.plan.io/projects/pulp_deb/issues?utf8=%E2%9C%93&set_filter=1&f%5B%5D=status_id&op%5Bstatus_id%5D=o&f%5B%5D=tracker_id&op%5Btracker_id%5D=%3D&v%5Btracker_id%5D%5B%5D=1&f%5B%5D=&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&group_by=&t%5B%5D=)
123
124
Again, if you are having trouble finding where to file your issue or search for existing ones, join us on IRC to get help!
125 1 kdelee@redhat.com
126 5 kdelee@redhat.com
## == How to report results ==
127 31 kdelee@redhat.com
128 32 kdelee@redhat.com
### New bugs
129 1 kdelee@redhat.com
130 32 kdelee@redhat.com
If you found a new bug, then you can file a new issue as described above. Also, refer to [[Issue filing template]]
131
132
### Verified bugs
133
134 33 kdelee@redhat.com
If you verified that a fix is correct or that a bug still exists, then comment on the issue with details about your system including all information pertinent to filing a new bug: [[Issue filing template]]
135
136
For more thoughts on what make a good bug report, see [here.](https://stackoverflow.com/help/mcve)