Project

Profile

Help

Test Day on August 8 2017 » History » Sprint/Milestone 51

kersom, 08/08/2017 07:15 PM

1 1 kdelee@redhat.com
# Test Day for 2.14 and pulp deb plugin
2 1 kdelee@redhat.com
3 10 kdelee@redhat.com
## Join us on August 8, 2017 to test the 2.14 release and the new pulp_deb plugin!
4 10 kdelee@redhat.com
5 1 kdelee@redhat.com
## Contents
6 1 kdelee@redhat.com
7 12 kdelee@redhat.com
>   - How to join
8 36 kdelee@redhat.com
>   - How to contribute
9 4 kdelee@redhat.com
>   - Who is available for help
10 1 kdelee@redhat.com
>   - Prerequisites for test day
11 1 kdelee@redhat.com
>   - Resources ( where to get RPMs, fedora images, etc)
12 1 kdelee@redhat.com
>   - How to test
13 1 kdelee@redhat.com
>   - Confirming existing issues
14 1 kdelee@redhat.com
>   - Filing new issues
15 1 kdelee@redhat.com
>   - How to report results
16 1 kdelee@redhat.com
17 1 kdelee@redhat.com
### Can't make the date?
18 1 kdelee@redhat.com
19 1 kdelee@redhat.com
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find here on https://pulp.plan.io, and report your results as detailed in "How to report results" section below.
20 1 kdelee@redhat.com
21 1 kdelee@redhat.com
## How to join
22 1 kdelee@redhat.com
23 39 kdelee@redhat.com
RSVP with this form to let us know you are coming and request help getting set up:  
24 43 kdelee@redhat.com
[RSVP and request help](https://goo.gl/forms/eHzCGsRDzDVWse923)
25 39 kdelee@redhat.com
26 39 kdelee@redhat.com
If you don't get around to RSVPing, just show up!
27 39 kdelee@redhat.com
28 1 kdelee@redhat.com
Join the [#pulp channel on freenode](http://irc.netsplit.de/channels/details.php?room=%23pulp&net=freenode)  
29 1 kdelee@redhat.com
You can join via your favorite IRC client, or either of the two web clients below:
30 1 kdelee@redhat.com
31 35 kdelee@redhat.com
[pulp channel on freenode webchat](http://webchat.freenode.net/?channels=%23pulp&uio=d4)
32 1 kdelee@redhat.com
33 1 kdelee@redhat.com
Specify a nickname that you would like to go by, and keep it safe for work please!  
34 1 kdelee@redhat.com
Many people choose something close to their name, as in Elijah's nickname is "elijah_d".
35 1 kdelee@redhat.com
36 36 kdelee@redhat.com
## == How to contribute ==
37 1 kdelee@redhat.com
38 1 kdelee@redhat.com
The August 8th Pulp Test Day will focus on the [Pulp 2.14 beta release](http://docs.pulpproject.org/en/2.14/testing/user-guide/release-notes/2.14.x.html#pulp-2-14-release-notes) and the new [pulp debian plugin](https://github.com/pulp/pulp_deb/#debian-support)
39 1 kdelee@redhat.com
40 37 kdelee@redhat.com
Things you can do:
41 37 kdelee@redhat.com
42 38 kdelee@redhat.com
  - Collaborate with a Pulp QE member to provide a guide for installing on an cloud instance [ask in #pulp](http://webchat.freenode.net/?channels=%23pulp&uio=d4)
43 36 kdelee@redhat.com
  - walk through a [manual upgrade from an existing pulp install](http://docs.pulpproject.org/en/nightly/user-guide/release-notes/2.14.x.html#upgrade-instructions), 
44 49 kdelee@redhat.com
  - installing manually both "pulp":docs.pulpproject.org/en/2.14/nightly/user-guide/installation/f24+.html and the [pulp_debian plugin](https://github.com/pulp/pulp_deb/#installation) 
45 44 kdelee@redhat.com
  - [Install using ansible](https://pulp.plan.io/projects/pulp/wiki/Virtualization_quickstart#SETTING-UP-ANSIBLE-on-the-VM) and moving on to confirming functionality of the project, that bugs that were fixed in the release are indeed fixed, or other exploratory testing.
46 37 kdelee@redhat.com
  - Manually test user stories included in this release
47 37 kdelee@redhat.com
  - Verify bug fixes in this release
48 37 kdelee@redhat.com
  - Explore pulp functionality and provide feedback
49 1 kdelee@redhat.com
50 1 kdelee@redhat.com
## == Who's available ==
51 1 kdelee@redhat.com
52 1 kdelee@redhat.com
The following cast of characters will be available testing, workarounds, bug fixes, and general discussion.
53 1 kdelee@redhat.com
54 1 kdelee@redhat.com
### Quality Engineering
55 1 kdelee@redhat.com
56 7 kdelee@redhat.com
  - Elijah DeLee (email: kdelee@redhat.com irc: elijah_d)
57 7 kdelee@redhat.com
  - Preethi Thomas (email: pthomas@redhat.com irc: preethi) 
58 7 kdelee@redhat.com
  - Kersom Oliveira (email: koliveir@redhat.com irc: kersom)
59 40 Ichimonji10
  - Jeremy Audet (email: jaudet@redhat.com irc: ichimonji10)
60 1 kdelee@redhat.com
61 6 kdelee@redhat.com
Specifically in the case of problem related to test day wiki, please reach out to Elijah DeLee at kdelee@redhat.com or on irc (nick: elijah_d)
62 1 kdelee@redhat.com
63 5 kdelee@redhat.com
## == Prerequisite for Test Day ==
64 1 kdelee@redhat.com
65 14 kdelee@redhat.com
  - Fedora 24, 25, or 26, RHEL 7, CentOS 7 system ( bare metal or VM )
66 1 kdelee@redhat.com
  - Root access on the system
67 1 kdelee@redhat.com
68 50 kdelee@redhat.com
**Ansible [install on Fedora 26 is currently broken](https://pulp.plan.io/issues/2961). Rumor is, it is manually installable. Unless you want to battle install issues today, it is best to go with Fedora 25**
69 50 kdelee@redhat.com
70 51 kersom
  - If Pulp was installed using Ansible, then "docs:"https://docs.pulpproject.org/user-guide/installation/index.html are not applicable.
71 51 kersom
72 51 kersom
<!-- end list -->
73 51 kersom
74 51 kersom
  - To confirm that Pulp was installed properly run:
75 51 kersom
76 51 kersom
<!-- end list -->
77 51 kersom
78 51 kersom
~~~
79 51 kersom
pulp-admin login -u admin -p admin
80 51 kersom
~~~
81 51 kersom
82 51 kersom
  - Then:
83 51 kersom
84 51 kersom
<!-- end list -->
85 51 kersom
86 51 kersom
~~~
87 51 kersom
pulp-admin status
88 51 kersom
~~~
89 51 kersom
90 42 kdelee@redhat.com
For a guide on some ways to spin up a VM on your machine. see [[Virtualization quickstart]]  
91 42 kdelee@redhat.com
For some information on how to provision a machine from a cloud provider such as digital ocean see [[Provisioning Test Machine from Cloud]]
92 1 kdelee@redhat.com
93 7 kdelee@redhat.com
## == Resources (where to get RPMs, fedora images, etc) ==
94 1 kdelee@redhat.com
95 1 kdelee@redhat.com
The Pulp 2.14 beta repository is included in the pulp repo files:  
96 45 kdelee@redhat.com
[2.14 beta repo file for fedora 24 & 25](https://repos.fedorapeople.org/repos/pulp/pulp/fedora-pulp.repo)  
97 45 kdelee@redhat.com
[2.14 beta repo file for RHEL7](https://repos.fedorapeople.org/repos/pulp/pulp/rhel-pulp.repo)
98 1 kdelee@redhat.com
99 16 kdelee@redhat.com
You can also find the packages themselves here:  
100 45 kdelee@redhat.com
[2.14 beta RPMs](https://repos.fedorapeople.org/pulp/pulp/beta/2.14/)
101 16 kdelee@redhat.com
102 4 kdelee@redhat.com
Fedora images:  
103 18 kdelee@redhat.com
You can find fedora "live" images here to install with:  
104 1 kdelee@redhat.com
[Fedora 24](http://mirrors.mit.edu/fedora/linux/releases/24/Workstation/x86_64/iso/)  
105 41 Ichimonji10
[Fedora 25](http://mirrors.mit.edu/fedora/linux/releases/25/Workstation/x86_64/iso/)  
106 17 kdelee@redhat.com
[Fedora 26](http://mirrors.mit.edu/fedora/linux/releases/26/Workstation/x86_64/iso/)
107 1 kdelee@redhat.com
108 4 kdelee@redhat.com
## == How to test? ==
109 1 kdelee@redhat.com
110 7 kdelee@redhat.com
### == Run the tests ==  
111 9 kdelee@redhat.com
If you'd like to run the integration test suite, [pulp-smash](https://github.com/PulpQE/pulp-smash) or any individual tests, you can run them either locally on the pulp_server or remotely from any machine that can SSH into the pulp_server.
112 1 kdelee@redhat.com
113 7 kdelee@redhat.com
For docs on pulp-smash, see http://pulp-smash.readthedocs.io/en/latest/ where you can find instructions on how to install and configure pulp-smash to run against your pulp install.
114 1 kdelee@redhat.com
115 7 kdelee@redhat.com
If you have trouble, email us or ping us on IRC and we can help you get it set up!
116 7 kdelee@redhat.com
117 7 kdelee@redhat.com
### == Exploratory testing ==
118 7 kdelee@redhat.com
119 1 kdelee@redhat.com
You can help out by playing around with the tool in whatever ways you can think of: try out all the things you can find.  
120 24 kdelee@redhat.com
Get creative! Any problems you find please file a bug, or report to the IRC channel. See [Filing new issues](https://pulp.plan.io/projects/pulp/wiki/Test_Day_on_August_8\_2017#Filing-new-issues)
121 1 kdelee@redhat.com
122 22 kdelee@redhat.com
Find the 2.14 User Guide [here.](http://docs.pulpproject.org/en/2.14/nightly/user-guide/index.html)  
123 23 kdelee@redhat.com
Find the 2.14 RPM Quick Start Guide [here.](http://docs.pulpproject.org/en/2.14/nightly/plugins/pulp_rpm/user-guide/quick-start.html)
124 22 kdelee@redhat.com
125 23 kdelee@redhat.com
Look for other quick start guides among the plugin documentation. Note that the main docs.pulpproject.org may direct you to docs for 2.13, check the URL to make sure you are looking at the right version.
126 21 kdelee@redhat.com
127 8 kdelee@redhat.com
Think [CRUD](https://en.wikipedia.org/wiki/Create,\_read,\_update_and_delete)  
128 8 kdelee@redhat.com
As a user, you should be able to Create, Read, Update, and Delete repositories and the data within. Is this the case? Where do you run into trouble?
129 8 kdelee@redhat.com
130 25 kdelee@redhat.com
## == Verifying existing issues ==
131 1 kdelee@redhat.com
132 7 kdelee@redhat.com
There are three different ways you can use existing issues.
133 7 kdelee@redhat.com
134 26 kdelee@redhat.com
### 1\. Verify that user stories marked "closed" work
135 7 kdelee@redhat.com
136 46 kdelee@redhat.com
[User stories closed in the 2.14 beta release](https://pulp.plan.io/issues?utf8=%E2%9C%93&set_filter=1&f%5B%5D=cf_4&op%5Bcf_4%5D=%3D&v%5Bcf_4%5D%5B%5D=2.14.0&f%5B%5D=tracker_id&op%5Btracker_id%5D=%3D&v%5Btracker_id%5D%5B%5D=3&f%5B%5D=&c%5B%5D=project&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&c%5B%5D=cf_4&group_by=project&t%5B%5D=)
137 7 kdelee@redhat.com
138 26 kdelee@redhat.com
### 2\. Verify that bugs fixed in the 2.14 release are indeed fixed!
139 7 kdelee@redhat.com
140 28 kdelee@redhat.com
[Bugs fixed in 2.14](https://pulp.plan.io/issues?c[]=tracker&c[]=status&c[]=priority&c[]=cf_5&c[]=subject&c[]=author&c[]=assigned_to&c[]=cf_3&f[]=cf_4&f[]=tracker_id&f[]=&group_by=&op[cf_4]=%3D&op[tracker_id]=%3D&set_filter=1&sort=priority%3Adesc%2Ccf_5%3Adesc%2Cid%3Adesc&utf8=%E2%9C%93&v[cf_4][]=2.14.0&v[tracker_id][]=1)
141 7 kdelee@redhat.com
142 29 kdelee@redhat.com
### 3\. Recreate outstanding bugs
143 7 kdelee@redhat.com
144 46 kdelee@redhat.com
Validate existence of [outstanding bugs in 2.14 beta.](https://pulp.plan.io/issues?utf8=%E2%9C%93&set_filter=1&f%5B%5D=tracker_id&op%5Btracker_id%5D=%3D&v%5Btracker_id%5D%5B%5D=1&f%5B%5D=status_id&op%5Bstatus_id%5D=o&f%5B%5D=cf_34&op%5Bcf_34%5D=%21\*&f%5B%5D=cf_8&op%5Bcf_8%5D=%3D&v%5Bcf_8%5D%5B%5D=2.14.0&v%5Bcf_8%5D%5B%5D=2.13.3&v%5Bcf_8%5D%5B%5D=2.13.2&v%5Bcf_8%5D%5B%5D=2.13.1&v%5Bcf_8%5D%5B%5D=2.13.0&v%5Bcf_8%5D%5B%5D=2.12.2&v%5Bcf_8%5D%5B%5D=2.12.1&v%5Bcf_8%5D%5B%5D=2.12.0&v%5Bcf_8%5D%5B%5D=2.11.1&v%5Bcf_8%5D%5B%5D=2.11.0&v%5Bcf_8%5D%5B%5D=2.10.3&v%5Bcf_8%5D%5B%5D=2.10.2&v%5Bcf_8%5D%5B%5D=2.10.1&v%5Bcf_8%5D%5B%5D=2.10.0&f%5B%5D=&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&group_by=cf_8&t%5B%5D=)
145 7 kdelee@redhat.com
146 29 kdelee@redhat.com
If the bug is replicable and seems suitable for for pulp-smash tests, file an issue on [pulp-smash github issues](https://github.com/PulpQE/pulp-smash/issues)
147 7 kdelee@redhat.com
148 5 kdelee@redhat.com
## == Filing new issues ==
149 1 kdelee@redhat.com
150 30 kdelee@redhat.com
If you have problems with any of the tests, first search for a issue related to the same bug and add a comment on the issue at https://pulp.plan.io.
151 30 kdelee@redhat.com
152 30 kdelee@redhat.com
Otherwise, report the bug to https://pulp.plan.io in the appropriate project section.
153 30 kdelee@redhat.com
154 30 kdelee@redhat.com
For example, you can file a new bug or find an existing issue for the debian plugin under the [Debain issues](https://pulp.plan.io/projects/pulp_deb/issues?utf8=%E2%9C%93&set_filter=1&f%5B%5D=status_id&op%5Bstatus_id%5D=o&f%5B%5D=tracker_id&op%5Btracker_id%5D=%3D&v%5Btracker_id%5D%5B%5D=1&f%5B%5D=&c%5B%5D=tracker&c%5B%5D=status&c%5B%5D=priority&c%5B%5D=cf_5&c%5B%5D=subject&c%5B%5D=author&c%5B%5D=assigned_to&c%5B%5D=cf_3&group_by=&t%5B%5D=)
155 30 kdelee@redhat.com
156 30 kdelee@redhat.com
Again, if you are having trouble finding where to file your issue or search for existing ones, join us on IRC to get help!
157 1 kdelee@redhat.com
158 5 kdelee@redhat.com
## == How to report results ==
159 31 kdelee@redhat.com
160 32 kdelee@redhat.com
### New bugs
161 1 kdelee@redhat.com
162 32 kdelee@redhat.com
If you found a new bug, then you can file a new issue as described above. Also, refer to [[Issue filing template]]
163 32 kdelee@redhat.com
164 32 kdelee@redhat.com
### Verified bugs
165 32 kdelee@redhat.com
166 33 kdelee@redhat.com
If you verified that a fix is correct or that a bug still exists, then comment on the issue with details about your system including all information pertinent to filing a new bug: [[Issue filing template]]
167 33 kdelee@redhat.com
168 47 kdelee@redhat.com
[More thoughts on what make a good bug report](https://stackoverflow.com/help/mcve)