Project

Profile

Help

Issue #1018 ยป Issue #6606 - 2015-10-14T20_04_04Z.eml

Ben.Stanley, 10/14/2015 10:04 PM

 
1
Return-Path: <Ben.Stanley@exemail.com.au>
2
Received: from mi015.mc1.hosteurope.de ([80.237.138.240]) by wp245.webpack.hosteurope.de running ExIM with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) id 1ZmSHA-00020g-4Z; Wed, 14 Oct 2015 22:03:52 +0200
3
Received: from pecan2-mail.exetel.com.au ([220.233.0.71] helo=pecan2.exetel.com.au) by mx0.webpack.hosteurope.de (mi015.mc1.hosteurope.de) with esmtp id 1ZmSH8-0002fJ-6C for dropbox+pulp+c71e+pulp@plan.io; Wed, 14 Oct 2015 22:03:51 +0200
4
Received: from 69.55.70.115.static.exetel.com.au ([115.70.55.69] helo=[192.168.2.117]) by pecan2.exetel.com.au with esmtp (Exim 4.84) (envelope-from <Ben.Stanley@exemail.com.au>) id 1ZmSH3-0004j2-VQ for dropbox+pulp+c71e+pulp@plan.io; Thu, 15 Oct 2015 07:03:46 +1100
5
Date: Thu, 15 Oct 2015 07:03:45 +1100
6
From: Ben Stanley <Ben.Stanley@exemail.com.au>
7
To: Pulp <dropbox+pulp+c71e+pulp@plan.io>
8
Message-ID: <15067f388e8.2811.5c72c04e7b2534944f17f24240f7ac0b@exemail.com.au>
9
In-Reply-To: <redmine.journal-6604.20151014153854.b2629020d9ca3988@plan.io>
10
References: <redmine.issue-1018.20150601085854@plan.io>
11
 <redmine.journal-6604.20151014153854.b2629020d9ca3988@plan.io>
12
Subject: Re: [Pulp - Issue #1018] (CLOSED - WORKSFORME) nux-dextop-el7-x86_64
13
 repo sync gets stuck
14
Mime-Version: 1.0
15
Content-Type: multipart/alternative;
16
 boundary=----------15067f38b5f51a82811171134d3;
17
 charset=UTF-8
18
Content-Transfer-Encoding: 7bit
19
Delivery-date: Wed, 14 Oct 2015 22:03:52 +0200
20
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101
21
 Thunderbird/24.6.0 AquaMail/1.5.9.14 (build: 22000040)
22
X-HE-Spam-Level: /
23
X-HE-Spam-Score: -0.6
24
X-HE-Spam-Report: Content analysis details: (-0.6 points) pts rule name
25
 description ---- ----------------------
26
 -------------------------------------------------- -0.7 RCVD_IN_DNSWL_LOW RBL:
27
 Sender listed at http://www.dnswl.org/, low trust [220.233.0.71 listed in
28
 list.dnswl.org] 0.1 HTML_MESSAGE BODY: HTML included in message
29
Envelope-to: dropbox+pulp+c71e+pulp@plan.io
30

    
31
This is a multi-part message in MIME format.
32
------------15067f38b5f51a82811171134d3
33
Content-Type: text/plain;
34
 charset=UTF-8;
35
 format=flowed
36
Content-Transfer-Encoding: quoted-printable
37

    
38
It also works for me now.
39

    
40
I recently attempted to find the root of this kind of problem, and I foun=
41
d =
42

    
43
that I could make problems happen by synchronizing multiple repos =
44

    
45
simultaneously. However, if I serialize the syncs, then all 580 repos syn=
46
c =
47

    
48
successfully. It is the first time I have been able to sync all the repos=
49
.
50

    
51
I used to have all 580 repos sync on a schedule at 10pm on Friday night, =
52

    
53
assuming that pulp could handle some concurrency and scheduling. It seems=
54
 =
55

    
56
that it can't.
57

    
58
Ben Stanley
59

    
60

    
61

    
62
On 15 October 2015 2:39:13 am Pulp <dropbox+pulp+c71e+pulp@plan.io> wrote=
63
:
64

    
65
> --- Please write your response above this line ---
66
>
67
> Issue #1018 has been updated by ipanova@redhat.com.
68
>
69
> Status changed from ASSIGNED to CLOSED - WORKSFORME
70
>
71
> I've been trying to reproduce this issue, nothing that happened to you =
72

    
73
> happened during steps of reproduce.
74
> One really strange thing that i noticed in your repo details output is =
75
that =
76

    
77
> you did not synced repo so the Last sync is None but nevertheless there=
78
 are =
79

    
80
> Content unit Counts that usually appear after sync.
81
> I am closing this as Worksforme, in case it will happen again please re=
82
open.
83
>
84
> ----------------------------------------
85
> Issue #1018: nux-dextop-el7-x86_64 repo sync gets stuck
86
> https://pulp.plan.io/issues/1018#change-6604
87
>
88
> * Author: Ben.Stanley
89
> * Status: CLOSED - WORKSFORME
90
> * Priority: High
91
> * Assignee: ipanova@redhat.com
92
> * Category: pulp-admin
93
> * Severity: 3. High
94
> * Version: 2.6.1
95
> * Target Release:
96
> * OS: RHEL 7
97
> * Backwards Incompatible: No
98
> * Triaged: Yes
99
> * Tags:
100
> * QA Contact:
101
> ----------------------------------------
102
> I have observed that attempts to sync my repo nux-dextop-el7-x86_64 do =
103
not =
104

    
105
> complete.
106
> The feed comes from
107
> http://mirror.li.nux.ro/li.nux.ro/nux/dextop/el7/x86_64/
108
>
109
> -----------------------------------------------------------------------=
110
---------
111
> [root@bumblebee ]# pulp-admin rpm repo sync run --repo-id=3Dnux-dextop-=
112
el7-x86_64
113
> +----------------------------------------------------------------------=
114
+
115
>             Synchronizing Repository [nux-dextop-el7-x86_64]
116
> +----------------------------------------------------------------------=
117
+
118
>
119
> This command may be exited via ctrl+c without affecting the request.
120
>
121
>
122
> [-]
123
> Waiting to begin...
124
> -----------------------------------------------------------------------=
125
---------
126
> Nothing appears in the logs.
127
>
128
> I know that no sync is progressing because nload tells me there is no =
129

    
130
> network traffic.
131
>
132
> The tasks list says
133
> -----------------------------------------------------------------------=
134
---------
135
> [root@bumblebee ~]# pulp-admin tasks list
136
> Operations:  sync
137
> Resources:   nux-dextop-el7-x86_64 (repository)
138
> State:       Waiting
139
> Start Time:  Unstarted
140
> Finish Time: Incomplete
141
> Task Id: b621280e-75b5-42eb-932c-c2e3f8a23cfa
142
> -----------------------------------------------------------------------=
143
---------
144
>
145
> Other tasks referencing this repository are either Cancelled or Success=
146
ful.
147
>
148
> Listing the details of the repo reveals the following:
149
> -----------------------------------------------------------------------=
150
---------
151
> [root@bumblebee ~]# pulp-admin rpm repo list --details
152
> Id:                  nux-dextop-el7-x86_64
153
> Display Name:        nux-dextop-el7-x86_64
154
> Description:         None
155
> Content Unit Counts:
156
>   Rpm: 1834
157
> Notes:
158
> Importers:
159
>   Config:
160
>     Feed:     http://mirror.li.nux.ro/li.nux.ro/nux//dextop/el7/x86_64
161
>     Validate: True
162
>   Id:               yum_importer
163
>   Importer Type Id: yum_importer
164
>   Last Sync:        None
165
>   Repo Id:          nux-dextop-el7-x86_64
166
>   Scheduled Syncs:
167
> Distributors:
168
>   Auto Publish:        True
169
>   Config:
170
>     Http:         True
171
>     Https:        False
172
>     Relative URL: nux/dextop/el7/x86_64
173
>   Distributor Type Id: yum_distributor
174
>   Id:                  yum_distributor
175
>   Last Publish:        None
176
>   Repo Id:             nux-dextop-el7-x86_64
177
>   Scheduled Publishes:
178
>   Auto Publish:        False
179
>   Config:
180
>     Http:  True
181
>     Https: False
182
>   Distributor Type Id: export_distributor
183
>   Id:                  export_distributor
184
>   Last Publish:        None
185
>   Repo Id:             nux-dextop-el7-x86_64
186
>   Scheduled Publishes:
187
> -----------------------------------------------------------------------=
188
---------
189
>
190
> How can I find out what is preventing this sync from running?
191
>
192
> I have found that I can fix errors of this type by deleting the repo an=
193
d =
194

    
195
> re-creating it.
196
>
197
> I am preserving the state of this problem so that we can investigate it=
198
.
199
>
200
>
201
>
202
>
203
> --
204
> You have received this notification because you have either subscribed =
205
to =
206

    
207
> or are involved in a project on Pulp Planio.
208
> To change your notification preferences, please click here: =
209

    
210
> https://pulp.plan.io/my/account?tour=3Dmail_preferences
211
>
212
> This notification was cheerfully delivered by https://plan.io
213
> =C2=A0
214
>
215

    
216
------------15067f38b5f51a82811171134d3
217
Content-Type: text/html;
218
 charset=UTF-8
219
Content-Transfer-Encoding: quoted-printable
220

    
221
<html>
222
<head>
223
<style>
224
@import url(https://assets.plan.io/stylesheets/fonts.css);
225
body {
226
  font-family: "ProximaNova-Regular", Verdana, sans-serif;
227
  font-size: 1.1em;
228
  color:#333434;
229
}
230
h1, h2, h3 { font-family: "ProximaNova-Bold", "Trebuchet MS", Verdana,
231
sans-serif; margin: 0px; }
232
h1 { font-size: 1.2em; }
233
h2, h3 { font-size: 1.1em; }
234
a, a:link, a:visited, a:hover, a:active { color:#2b7a94; }
235
a.wiki-anchor { display: none; }
236
fieldset.attachments {border-width: 1px 0 0 0;}
237
hr {
238
  width: 100%;
239
  height: 1px;
240
  background: #ccc;
241
  border: 0;
242
}
243
</style>
244

    
245

    
246
</head>
247
<body>
248
<div style=3D"color: black;">
249
<div style=3D"color: black;">
250
<p style=3D"margin: 0 0 1em 0; color: black;">It also works for me now.</=
251
p>
252
<p style=3D"margin: 0 0 1em 0; color: black;">I recently attempted to fin=
253
d
254
the root of this kind of problem, and I found that I could make problems
255
happen by synchronizing multiple repos simultaneously. However, if I
256
serialize the syncs, then all 580 repos sync successfully. It is the firs=
257
t
258
time I have been able to sync all the repos.</p>
259
<p style=3D"margin: 0 0 1em 0; color: black;">I used to have all 580 repo=
260
s
261
sync on a schedule at 10pm on Friday night, assuming that pulp could hand=
262
le
263
some concurrency and scheduling. It seems that it can't.</p>
264
<p style=3D"margin: 0 0 1em 0; color: black;">Ben Stanley<br>
265
</p>
266
</div>
267
<div style=3D"color: black;">
268
<p
269
style=3D"color: black; font-size: 10pt; font-family: Arial, sans-serif; m=
270
argin: 10pt 0;">On
271
15 October 2015 2:39:13 am Pulp &lt;dropbox+pulp+c71e+pulp@plan.io&gt;
272
wrote:</p>
273
<blockquote type=3D"cite" class=3D"gmail_quote"
274
style=3D"margin: 0 0 0 0.75ex; border-left: 1px solid #808080; padding-le=
275
ft: 0.75ex;">
276
<table width=3D"100%">
277
<tr><td
278
style=3D"font-family: MarketWeb, Verdana, sans-serif;font-size:0.8em;text=
279
-align:center;width:100%;color:#D7D7D7;"><p>---
280
Please write your response above this line ---</p></td></tr>
281
<tr><td>Issue #1018 has been updated by ipanova@redhat.com.
282

    
283
<ul>
284
  <li><strong>Status</strong> changed from <i>ASSIGNED</i> to <i>CLOSED -=
285

    
286
WORKSFORME</i></li>
287
</ul>
288

    
289
<p>I've been trying to reproduce this issue, nothing that happened to you=
290

    
291
happened during steps of reproduce.<br />One really strange thing that i
292
noticed in your repo details output is that you did not synced repo so th=
293
e
294
Last sync is None but nevertheless there are Content unit Counts that
295
usually appear after sync.<br />I am closing this as Worksforme, in case =
296
it
297
will happen again please reopen.</p>
298
<hr />
299
<h1><a href=3D"https://pulp.plan.io/issues/1018#change-6604">Issue #1018:=
300

    
301
nux-dextop-el7-x86_64 repo sync gets stuck</a></h1>
302

    
303
<ul><li>Author: Ben.Stanley</li>
304
<li>Status: CLOSED - WORKSFORME</li>
305
<li>Priority: High</li>
306
<li>Assignee: ipanova@redhat.com</li>
307
<li>Category: pulp-admin</li>
308
<li>Severity: 3. High</li>
309
<li>Version: 2.6.1</li>
310
<li>Target Release: </li>
311
<li>OS: RHEL 7</li>
312
<li>Backwards Incompatible: No</li>
313
<li>Triaged: Yes</li>
314
<li>Tags: </li>
315
<li>QA Contact: </li></ul>
316

    
317
<p>I have observed that attempts to sync my repo nux-dextop-el7-x86_64 do=
318

    
319
not complete.<br />The feed comes from<br /><a class=3D"external"
320
href=3D"http://mirror.li.nux.ro/li.nux.ro/nux/dextop/el7/x86_64/">http://=
321
mirror.li.nux.ro/li.nux.ro/nux/dextop/el7/x86_64/</a></p>
322

    
323

    
324
	<p>---------------------------------------------------------------------=
325
-----------<br
326
/>[root@bumblebee ]# pulp-admin rpm repo sync run
327
--repo-id=3Dnux-dextop-el7-x86_64<br
328
/><ins><del>-------------------------------------------------------------=
329
-------</del></ins><br
330
/>            Synchronizing Repository [nux-dextop-el7-x86_64]<br
331
/><ins><del>-------------------------------------------------------------=
332
-------</del></ins></p>
333

    
334

    
335
	<p>This command may be exited via ctrl+c without affecting the request.<=
336
/p>
337

    
338

    
339
	<p>[-]<br />Waiting to begin...<br
340
/>-----------------------------------------------------------------------=
341
---------<br
342
/>Nothing appears in the logs.</p>
343

    
344

    
345
	<p>I know that no sync is progressing because nload tells me there is no=
346

    
347
network traffic.</p>
348

    
349

    
350
	<p>The tasks list says<br
351
/>-----------------------------------------------------------------------=
352
---------<br
353
/>[root@bumblebee ~]# pulp-admin tasks list<br />Operations:  sync<br
354
/>Resources:   nux-dextop-el7-x86_64 (repository)<br />State:      =
355

    
356
Waiting<br />Start Time:  Unstarted<br />Finish Time: Incomplete<br />Tas=
357
k
358
Id: b621280e-75b5-42eb-932c-c2e3f8a23cfa<br
359
/>-----------------------------------------------------------------------=
360
---------</p>
361

    
362

    
363
	<p>Other tasks referencing this repository are either Cancelled or
364
Successful.</p>
365

    
366

    
367
	<p>Listing the details of the repo reveals the following:<br
368
/>-----------------------------------------------------------------------=
369
---------<br
370
/>[root@bumblebee ~]# pulp-admin rpm repo list --details<br />Id:        =
371
  =
372

    
373
       nux-dextop-el7-x86_64<br />Display Name:       =
374

    
375
nux-dextop-el7-x86_64<br />Description:         None<br />Content Unit
376
Counts:<br />  Rpm: 1834<br />Notes:<br />Importers:<br />  Config:<br />=
377
  =
378

    
379
 Feed:     <a class=3D"external"
380
href=3D"http://mirror.li.nux.ro/li.nux.ro/nux//dextop/el7/x86_64">http://=
381
mirror.li.nux.ro/li.nux.ro/nux//dextop/el7/x86_64</a><br
382
/>    Validate: True<br />  Id:               yum_importer<br />  Importe=
383
r
384
Type Id: yum_importer<br />  Last Sync:        None<br />  Repo Id:      =
385
  =
386

    
387
 nux-dextop-el7-x86_64<br />  Scheduled Syncs:<br />Distributors:<br /> =
388

    
389
Auto Publish:        True<br />  Config:<br />    Http:         True<br /=
390
> =
391

    
392
  Https:        False<br />    Relative URL: nux/dextop/el7/x86_64<br /> =
393

    
394
Distributor Type Id: yum_distri
395
 butor<br />  Id:                  yum_distributor<br />  Last Publish:  =
396
  =
397

    
398
   None<br />  Repo Id:             nux-dextop-el7-x86_64<br />  Schedule=
399
d
400
Publishes:<br />  Auto Publish:        False<br />  Config:<br />    Http=
401
: =
402

    
403
True<br />    Https: False<br />  Distributor Type Id:
404
export_distributor<br />  Id:                  export_distributor<br /> =
405

    
406
Last Publish:        None<br />  Repo Id:            =
407

    
408
nux-dextop-el7-x86_64<br />  Scheduled Publishes:<br
409
/>-----------------------------------------------------------------------=
410
---------</p>
411

    
412

    
413
	<p>How can I find out what is preventing this sync from running?</p>
414

    
415

    
416
	<p>I have found that I can fix errors of this type by deleting the repo
417
and re-creating it.</p>
418

    
419

    
420
	<p>I am preserving the state of this problem so that we can investigate
421
it.</p>
422

    
423

    
424
<script type=3D"application/ld+json">
425
{
426
  "@context": "http://schema.org",
427
  "@type": "EmailMessage",
428
  "action": {
429
    "@type": "ViewAction",
430
    "url": "https://pulp.plan.io/issues/1018#change-6604",
431
    "name": "View on Planio"
432
  },
433
  "description": "Click here to view this issue update on Planio."
434
}
435
</script>
436

    
437
</td></tr>
438
<tr><td style=3D"font-size:0.8em;width:100%;"><hr/><p>You have received t=
439
his
440
notification because you have either subscribed to or are involved in a
441
project on Pulp Planio.<br />To change your notification preferences,
442
please click here: <a class=3D"external"
443
href=3D"https://pulp.plan.io/my/account?tour=3Dmail_preferences">https://=
444
pulp.plan.io/my/account?tour=3Dmail_preferences</a></p><td></tr>
445
<tr><td
446
style=3D"font-family: MarketWeb, Verdana, sans-serif;font-size:1.2em;text=
447
-align:center;width:100%;color:#D7D7D7;"><br/><div><a
448
href=3D"https://plan.io/" style=3D"color:#D7D7D7;text-decoration:none;">T=
449
his
450
notification was cheerfully delivered by</a></div><td></tr>
451
<tr><td style=3D"text-align:center;width:100%;"><a href=3D"https://plan.i=
452
o/"
453
title=3D"Planio"><img
454
src=3D"https://assets.plan.io/images/planio_logo_gray_204x50.png" height=3D=
455
"25"
456
width=3D"102" alt=3D"Planio" style=3D"vertical-align: middle;"/></a></td>=
457
</tr>
458
</table>
459
</blockquote>
460
</div>
461
</div>
462
</body>
463
</html>
464

    
465
------------15067f38b5f51a82811171134d3--
    (1-1/1)