Project

Profile

Help

Download (15.2 KB)

Issue #1018 ยป Issue #6606 - 2015-10-14T20_04_04Z.eml

Ben.Stanley, 10/14/2015 10:04 PM

 
Return-Path: <Ben.Stanley@exemail.com.au>
Received: from mi015.mc1.hosteurope.de ([80.237.138.240]) by wp245.webpack.hosteurope.de running ExIM with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) id 1ZmSHA-00020g-4Z; Wed, 14 Oct 2015 22:03:52 +0200
Received: from pecan2-mail.exetel.com.au ([220.233.0.71] helo=pecan2.exetel.com.au) by mx0.webpack.hosteurope.de (mi015.mc1.hosteurope.de) with esmtp id 1ZmSH8-0002fJ-6C for dropbox+pulp+c71e+pulp@plan.io; Wed, 14 Oct 2015 22:03:51 +0200
Received: from 69.55.70.115.static.exetel.com.au ([115.70.55.69] helo=[192.168.2.117]) by pecan2.exetel.com.au with esmtp (Exim 4.84) (envelope-from <Ben.Stanley@exemail.com.au>) id 1ZmSH3-0004j2-VQ for dropbox+pulp+c71e+pulp@plan.io; Thu, 15 Oct 2015 07:03:46 +1100
Date: Thu, 15 Oct 2015 07:03:45 +1100
From: Ben Stanley <Ben.Stanley@exemail.com.au>
To: Pulp <dropbox+pulp+c71e+pulp@plan.io>
Message-ID: <15067f388e8.2811.5c72c04e7b2534944f17f24240f7ac0b@exemail.com.au>
In-Reply-To: <redmine.journal-6604.20151014153854.b2629020d9ca3988@plan.io>
References: <redmine.issue-1018.20150601085854@plan.io>
<redmine.journal-6604.20151014153854.b2629020d9ca3988@plan.io>
Subject: Re: [Pulp - Issue #1018] (CLOSED - WORKSFORME) nux-dextop-el7-x86_64
repo sync gets stuck
Mime-Version: 1.0
Content-Type: multipart/alternative;
boundary=----------15067f38b5f51a82811171134d3;
charset=UTF-8
Content-Transfer-Encoding: 7bit
Delivery-date: Wed, 14 Oct 2015 22:03:52 +0200
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101
Thunderbird/24.6.0 AquaMail/1.5.9.14 (build: 22000040)
X-HE-Spam-Level: /
X-HE-Spam-Score: -0.6
X-HE-Spam-Report: Content analysis details: (-0.6 points) pts rule name
description ---- ----------------------
-------------------------------------------------- -0.7 RCVD_IN_DNSWL_LOW RBL:
Sender listed at http://www.dnswl.org/, low trust [220.233.0.71 listed in
list.dnswl.org] 0.1 HTML_MESSAGE BODY: HTML included in message
Envelope-to: dropbox+pulp+c71e+pulp@plan.io

This is a multi-part message in MIME format.
------------15067f38b5f51a82811171134d3
Content-Type: text/plain;
charset=UTF-8;
format=flowed
Content-Transfer-Encoding: quoted-printable

It also works for me now.

I recently attempted to find the root of this kind of problem, and I foun=
d =

that I could make problems happen by synchronizing multiple repos =

simultaneously. However, if I serialize the syncs, then all 580 repos syn=
c =

successfully. It is the first time I have been able to sync all the repos=
.

I used to have all 580 repos sync on a schedule at 10pm on Friday night, =

assuming that pulp could handle some concurrency and scheduling. It seems=
=

that it can't.

Ben Stanley



On 15 October 2015 2:39:13 am Pulp <dropbox+pulp+c71e+pulp@plan.io> wrote=
:

> --- Please write your response above this line ---
>
> Issue #1018 has been updated by ipanova@redhat.com.
>
> Status changed from ASSIGNED to CLOSED - WORKSFORME
>
> I've been trying to reproduce this issue, nothing that happened to you =

> happened during steps of reproduce.
> One really strange thing that i noticed in your repo details output is =
that =

> you did not synced repo so the Last sync is None but nevertheless there=
are =

> Content unit Counts that usually appear after sync.
> I am closing this as Worksforme, in case it will happen again please re=
open.
>
> ----------------------------------------
> Issue #1018: nux-dextop-el7-x86_64 repo sync gets stuck
> https://pulp.plan.io/issues/1018#change-6604
>
> * Author: Ben.Stanley
> * Status: CLOSED - WORKSFORME
> * Priority: High
> * Assignee: ipanova@redhat.com
> * Category: pulp-admin
> * Severity: 3. High
> * Version: 2.6.1
> * Target Release:
> * OS: RHEL 7
> * Backwards Incompatible: No
> * Triaged: Yes
> * Tags:
> * QA Contact:
> ----------------------------------------
> I have observed that attempts to sync my repo nux-dextop-el7-x86_64 do =
not =

> complete.
> The feed comes from
> http://mirror.li.nux.ro/li.nux.ro/nux/dextop/el7/x86_64/
>
> -----------------------------------------------------------------------=
---------
> [root@bumblebee ]# pulp-admin rpm repo sync run --repo-id=3Dnux-dextop-=
el7-x86_64
> +----------------------------------------------------------------------=
+
> Synchronizing Repository [nux-dextop-el7-x86_64]
> +----------------------------------------------------------------------=
+
>
> This command may be exited via ctrl+c without affecting the request.
>
>
> [-]
> Waiting to begin...
> -----------------------------------------------------------------------=
---------
> Nothing appears in the logs.
>
> I know that no sync is progressing because nload tells me there is no =

> network traffic.
>
> The tasks list says
> -----------------------------------------------------------------------=
---------
> [root@bumblebee ~]# pulp-admin tasks list
> Operations: sync
> Resources: nux-dextop-el7-x86_64 (repository)
> State: Waiting
> Start Time: Unstarted
> Finish Time: Incomplete
> Task Id: b621280e-75b5-42eb-932c-c2e3f8a23cfa
> -----------------------------------------------------------------------=
---------
>
> Other tasks referencing this repository are either Cancelled or Success=
ful.
>
> Listing the details of the repo reveals the following:
> -----------------------------------------------------------------------=
---------
> [root@bumblebee ~]# pulp-admin rpm repo list --details
> Id: nux-dextop-el7-x86_64
> Display Name: nux-dextop-el7-x86_64
> Description: None
> Content Unit Counts:
> Rpm: 1834
> Notes:
> Importers:
> Config:
> Feed: http://mirror.li.nux.ro/li.nux.ro/nux//dextop/el7/x86_64
> Validate: True
> Id: yum_importer
> Importer Type Id: yum_importer
> Last Sync: None
> Repo Id: nux-dextop-el7-x86_64
> Scheduled Syncs:
> Distributors:
> Auto Publish: True
> Config:
> Http: True
> Https: False
> Relative URL: nux/dextop/el7/x86_64
> Distributor Type Id: yum_distributor
> Id: yum_distributor
> Last Publish: None
> Repo Id: nux-dextop-el7-x86_64
> Scheduled Publishes:
> Auto Publish: False
> Config:
> Http: True
> Https: False
> Distributor Type Id: export_distributor
> Id: export_distributor
> Last Publish: None
> Repo Id: nux-dextop-el7-x86_64
> Scheduled Publishes:
> -----------------------------------------------------------------------=
---------
>
> How can I find out what is preventing this sync from running?
>
> I have found that I can fix errors of this type by deleting the repo an=
d =

> re-creating it.
>
> I am preserving the state of this problem so that we can investigate it=
.
>
>
>
>
> --
> You have received this notification because you have either subscribed =
to =

> or are involved in a project on Pulp Planio.
> To change your notification preferences, please click here: =

> https://pulp.plan.io/my/account?tour=3Dmail_preferences
>
> This notification was cheerfully delivered by https://plan.io
> =C2=A0
>

------------15067f38b5f51a82811171134d3
Content-Type: text/html;
charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style>
@import url(https://assets.plan.io/stylesheets/fonts.css);
body {
font-family: "ProximaNova-Regular", Verdana, sans-serif;
font-size: 1.1em;
color:#333434;
}
h1, h2, h3 { font-family: "ProximaNova-Bold", "Trebuchet MS", Verdana,
sans-serif; margin: 0px; }
h1 { font-size: 1.2em; }
h2, h3 { font-size: 1.1em; }
a, a:link, a:visited, a:hover, a:active { color:#2b7a94; }
a.wiki-anchor { display: none; }
fieldset.attachments {border-width: 1px 0 0 0;}
hr {
width: 100%;
height: 1px;
background: #ccc;
border: 0;
}
</style>


</head>
<body>
<div style=3D"color: black;">
<div style=3D"color: black;">
<p style=3D"margin: 0 0 1em 0; color: black;">It also works for me now.</=
p>
<p style=3D"margin: 0 0 1em 0; color: black;">I recently attempted to fin=
d
the root of this kind of problem, and I found that I could make problems
happen by synchronizing multiple repos simultaneously. However, if I
serialize the syncs, then all 580 repos sync successfully. It is the firs=
t
time I have been able to sync all the repos.</p>
<p style=3D"margin: 0 0 1em 0; color: black;">I used to have all 580 repo=
s
sync on a schedule at 10pm on Friday night, assuming that pulp could hand=
le
some concurrency and scheduling. It seems that it can't.</p>
<p style=3D"margin: 0 0 1em 0; color: black;">Ben Stanley<br>
</p>
</div>
<div style=3D"color: black;">
<p
style=3D"color: black; font-size: 10pt; font-family: Arial, sans-serif; m=
argin: 10pt 0;">On
15 October 2015 2:39:13 am Pulp &lt;dropbox+pulp+c71e+pulp@plan.io&gt;
wrote:</p>
<blockquote type=3D"cite" class=3D"gmail_quote"
style=3D"margin: 0 0 0 0.75ex; border-left: 1px solid #808080; padding-le=
ft: 0.75ex;">
<table width=3D"100%">
<tr><td
style=3D"font-family: MarketWeb, Verdana, sans-serif;font-size:0.8em;text=
-align:center;width:100%;color:#D7D7D7;"><p>---
Please write your response above this line ---</p></td></tr>
<tr><td>Issue #1018 has been updated by ipanova@redhat.com.

<ul>
<li><strong>Status</strong> changed from <i>ASSIGNED</i> to <i>CLOSED -=

WORKSFORME</i></li>
</ul>

<p>I've been trying to reproduce this issue, nothing that happened to you=

happened during steps of reproduce.<br />One really strange thing that i
noticed in your repo details output is that you did not synced repo so th=
e
Last sync is None but nevertheless there are Content unit Counts that
usually appear after sync.<br />I am closing this as Worksforme, in case =
it
will happen again please reopen.</p>
<hr />
<h1><a href=3D"https://pulp.plan.io/issues/1018#change-6604">Issue #1018:=

nux-dextop-el7-x86_64 repo sync gets stuck</a></h1>

<ul><li>Author: Ben.Stanley</li>
<li>Status: CLOSED - WORKSFORME</li>
<li>Priority: High</li>
<li>Assignee: ipanova@redhat.com</li>
<li>Category: pulp-admin</li>
<li>Severity: 3. High</li>
<li>Version: 2.6.1</li>
<li>Target Release: </li>
<li>OS: RHEL 7</li>
<li>Backwards Incompatible: No</li>
<li>Triaged: Yes</li>
<li>Tags: </li>
<li>QA Contact: </li></ul>

<p>I have observed that attempts to sync my repo nux-dextop-el7-x86_64 do=

not complete.<br />The feed comes from<br /><a class=3D"external"
href=3D"http://mirror.li.nux.ro/li.nux.ro/nux/dextop/el7/x86_64/">http://=
mirror.li.nux.ro/li.nux.ro/nux/dextop/el7/x86_64/</a></p>


<p>---------------------------------------------------------------------=
-----------<br
/>[root@bumblebee ]# pulp-admin rpm repo sync run
--repo-id=3Dnux-dextop-el7-x86_64<br
/><ins><del>-------------------------------------------------------------=
-------</del></ins><br
/> Synchronizing Repository [nux-dextop-el7-x86_64]<br
/><ins><del>-------------------------------------------------------------=
-------</del></ins></p>


<p>This command may be exited via ctrl+c without affecting the request.<=
/p>


<p>[-]<br />Waiting to begin...<br
/>-----------------------------------------------------------------------=
---------<br
/>Nothing appears in the logs.</p>


<p>I know that no sync is progressing because nload tells me there is no=

network traffic.</p>


<p>The tasks list says<br
/>-----------------------------------------------------------------------=
---------<br
/>[root@bumblebee ~]# pulp-admin tasks list<br />Operations: sync<br
/>Resources: nux-dextop-el7-x86_64 (repository)<br />State: =

Waiting<br />Start Time: Unstarted<br />Finish Time: Incomplete<br />Tas=
k
Id: b621280e-75b5-42eb-932c-c2e3f8a23cfa<br
/>-----------------------------------------------------------------------=
---------</p>


<p>Other tasks referencing this repository are either Cancelled or
Successful.</p>


<p>Listing the details of the repo reveals the following:<br
/>-----------------------------------------------------------------------=
---------<br
/>[root@bumblebee ~]# pulp-admin rpm repo list --details<br />Id: =
=

nux-dextop-el7-x86_64<br />Display Name: =

nux-dextop-el7-x86_64<br />Description: None<br />Content Unit
Counts:<br /> Rpm: 1834<br />Notes:<br />Importers:<br /> Config:<br />=
=

Feed: <a class=3D"external"
href=3D"http://mirror.li.nux.ro/li.nux.ro/nux//dextop/el7/x86_64">http://=
mirror.li.nux.ro/li.nux.ro/nux//dextop/el7/x86_64</a><br
/> Validate: True<br /> Id: yum_importer<br /> Importe=
r
Type Id: yum_importer<br /> Last Sync: None<br /> Repo Id: =
=

nux-dextop-el7-x86_64<br /> Scheduled Syncs:<br />Distributors:<br /> =

Auto Publish: True<br /> Config:<br /> Http: True<br /=
> =

Https: False<br /> Relative URL: nux/dextop/el7/x86_64<br /> =

Distributor Type Id: yum_distri
butor<br /> Id: yum_distributor<br /> Last Publish: =
=

None<br /> Repo Id: nux-dextop-el7-x86_64<br /> Schedule=
d
Publishes:<br /> Auto Publish: False<br /> Config:<br /> Http=
: =

True<br /> Https: False<br /> Distributor Type Id:
export_distributor<br /> Id: export_distributor<br /> =

Last Publish: None<br /> Repo Id: =

nux-dextop-el7-x86_64<br /> Scheduled Publishes:<br
/>-----------------------------------------------------------------------=
---------</p>


<p>How can I find out what is preventing this sync from running?</p>


<p>I have found that I can fix errors of this type by deleting the repo
and re-creating it.</p>


<p>I am preserving the state of this problem so that we can investigate
it.</p>


<script type=3D"application/ld+json">
{
"@context": "http://schema.org",
"@type": "EmailMessage",
"action": {
"@type": "ViewAction",
"url": "https://pulp.plan.io/issues/1018#change-6604",
"name": "View on Planio"
},
"description": "Click here to view this issue update on Planio."
}
</script>

</td></tr>
<tr><td style=3D"font-size:0.8em;width:100%;"><hr/><p>You have received t=
his
notification because you have either subscribed to or are involved in a
project on Pulp Planio.<br />To change your notification preferences,
please click here: <a class=3D"external"
href=3D"https://pulp.plan.io/my/account?tour=3Dmail_preferences">https://=
pulp.plan.io/my/account?tour=3Dmail_preferences</a></p><td></tr>
<tr><td
style=3D"font-family: MarketWeb, Verdana, sans-serif;font-size:1.2em;text=
-align:center;width:100%;color:#D7D7D7;"><br/><div><a
href=3D"https://plan.io/" style=3D"color:#D7D7D7;text-decoration:none;">T=
his
notification was cheerfully delivered by</a></div><td></tr>
<tr><td style=3D"text-align:center;width:100%;"><a href=3D"https://plan.i=
o/"
title=3D"Planio"><img
src=3D"https://assets.plan.io/images/planio_logo_gray_204x50.png" height=3D=
"25"
width=3D"102" alt=3D"Planio" style=3D"vertical-align: middle;"/></a></td>=
</tr>
</table>
</blockquote>
</div>
</div>
</body>
</html>

------------15067f38b5f51a82811171134d3--
    (1-1/1)