Project

Profile

Help

Issue #8864 ยป Re_ [RPM Support - Issue #8864] Workers go OOM while trying to sync RHEL 7 - 2021-06-11T21_41_37Z.eml

ehelms@redhat.com, 06/11/2021 11:41 PM

 
X-He-Spam-Score: -3.1
Return-Path: <ehelms@redhat.com>
Delivered-To: dropbox@plan.io
Received: from m.launch.gmbh ([127.0.0.1])
by m.launch.gmbh with LMTP id iB7/LIfYw2DrLgAAJzdhvw
for <dropbox@plan.io>; Fri, 11 Jun 2021 23:41:27 +0200
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on m.launch.gmbh
X-Spam-Level:
X-Spam-Status: No, score=-3.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH,
DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DMARC_PASS,HTML_MESSAGE,
RCVD_IN_DNSWL_LOW,RCVD_IN_MSPIKE_H4,RCVD_IN_MSPIKE_WL,SPF_HELO_NONE,
SPF_PASS autolearn=ham autolearn_force=no version=3.4.2
X-Spam-Report:
* -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at https://www.dnswl.org/,
* low trust
* [170.10.133.124 listed in list.dnswl.org]
* -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
* [score: 0.0000]
* -0.1 DMARC_PASS DMARC check passed
* -0.1 SPF_PASS SPF check passed
* 0.0 RCVD_IN_MSPIKE_H4 RBL: Very Good reputation (+4)
* [170.10.133.124 listed in wl.mailspike.net]
* 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record
* 0.0 HTML_MESSAGE BODY: HTML included in message
* -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from
* author's domain
* 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily
* valid
* -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature
* 0.0 RCVD_IN_MSPIKE_WL Mailspike good senders
* -0.2 DKIMWL_WL_HIGH DKIMwl.org - High trust sender
X-Spam-Score: -3.1
Envelope-to: inbox+pulp+c71e+pulp_rpm@plan.io
Authentication-Results: m.launch.gmbh; dmarc=pass (p=none dis=none) header.from=redhat.com
Authentication-Results: m.launch.gmbh; spf=pass smtp.mailfrom=ehelms@redhat.com
Authentication-Results: m.launch.gmbh;
dkim=pass (1024-bit key; unprotected) header.d=redhat.com header.i=@redhat.com header.b="d++/OcA5";
dkim-atps=neutral
Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124])
(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
(No client certificate requested)
by m.launch.gmbh (Postfix) with ESMTPS id 5000E80151
for <inbox+pulp+c71e+pulp_rpm@plan.io>; Fri, 11 Jun 2021 23:41:27 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com;
s=mimecast20190719; t=1623447685;
h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
to:to:cc:mime-version:mime-version:content-type:content-type:
in-reply-to:in-reply-to:references:references;
bh=KEYBgduleLAMNBoSgxWzxKDkOBMc4WmfEyroalzGUEc=;
b=d++/OcA5qj3KTF2rwizIXUr8iT5/OeOrRf+Hkt9vV+zazgvoP8uUdQjJdirYD+TKJACJ2D
3KzTbpzNy/ux4LwahqNaT7o0B3s9tVW0ugmfH0uLecq4CFs+jGzNQaOL4jq7E8LU4xrpKW
8Vpbi2E+t4X/hTGIHT8+2NUfHmct+QU=
Received: from mail-pg1-f199.google.com (mail-pg1-f199.google.com
[209.85.215.199]) (Using TLS) by relay.mimecast.com with ESMTP id
us-mta-118-fN4V_dyiN4OeSzB2v2LLng-1; Fri, 11 Jun 2021 17:41:22 -0400
X-MC-Unique: fN4V_dyiN4OeSzB2v2LLng-1
Received: by mail-pg1-f199.google.com with SMTP id s14-20020a63450e0000b029021f631b8861so2422143pga.20
for <inbox+pulp+c71e+pulp_rpm@plan.io>; Fri, 11 Jun 2021 14:41:22 -0700 (PDT)
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20161025;
h=x-gm-message-state:mime-version:references:in-reply-to:from:date
:message-id:subject:to;
bh=KEYBgduleLAMNBoSgxWzxKDkOBMc4WmfEyroalzGUEc=;
b=cI6yZhRF61Vk9sN9tBV+9JoZWcX5WOE50MMINDwFY8SyBWVdtOlPRR4UUXUnpMwUZg
864mhwI2axM92HAJiH1kn8bx/Lk6IOcqLzJAKDx2KK8YJ5E0U3VrjKtz65HoA2OI6ELI
klbtdOgl7zOPBlSVpQ4rF1zHeg4RjCObLKGfYU9d7+sR4TzgHOqKF0BqpSHJZhhERnIH
u2pJLYKAosB17hhB4ABaF8k3tXSbfD/sAUKvsfyU1CUUg1m7sfv/4Uv1UAMGHpSHNxks
9qcUVH9yWN7DUVsb376e3xqKYMgdlcHHBJf2lwRdfywo93Z2odP2RDXPFHSb73ibasT/
qY1A==
X-Gm-Message-State: AOAM531vbVNOBUczC1OSE/gjjjozh/fIbJyWeyfnL0PGzTJP2cY1pm6+
fj6WgAClgBlkvEeV07MpnUxej/DHR/xaVTnlMrfz92o6XQVTmTy+MAWrw+aIGkWGP2eeS1FLmmd
iif7SdrZYZ4lChNWC7WQBSRTG5c3zDq04BOwiFSpD+6x6+w==
X-Received: by 2002:a17:90a:1150:: with SMTP id d16mr6502385pje.180.1623447681264;
Fri, 11 Jun 2021 14:41:21 -0700 (PDT)
X-Google-Smtp-Source: ABdhPJxHymeski/pO1EsjksNzmTt4KtFScsNDWZz8RqHpfVRfeIxH0CeIsWPSE1+UkrRR7fdLPYiJqnybXuICg7CKFE=
X-Received: by 2002:a17:90a:1150:: with SMTP id d16mr6502351pje.180.1623447680679;
Fri, 11 Jun 2021 14:41:20 -0700 (PDT)
MIME-Version: 1.0
References: <redmine.issue-8864.20210604120935@plan.io> <redmine.journal-71870.20210611203319.8351924699667cce@plan.io>
In-Reply-To: <redmine.journal-71870.20210611203319.8351924699667cce@plan.io>
From: Eric Helms <ehelms@redhat.com>
Date: Fri, 11 Jun 2021 17:41:11 -0400
Message-ID: <CAJauPC=gpn_cKZ4bnmw7H2oiGU=kxd9GzHkpzPRJWErAsyo-Hg@mail.gmail.com>
Subject: Re: [RPM Support - Issue #8864] Workers go OOM while trying to sync
RHEL 7
To: Pulp <inbox+pulp+c71e+pulp_rpm@plan.io>
Authentication-Results: relay.mimecast.com;
auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=ehelms@redhat.com
X-Mimecast-Spam-Score: 0
X-Mimecast-Originator: redhat.com
Content-Type: multipart/alternative; boundary="00000000000051989005c4845e12"

--00000000000051989005c4845e12
Content-Type: text/plain; charset="UTF-8"

After bumping the memory by 4GB on the same setup I encounter the same
issue. I could try going higher to find an upper limit (if one exists). Are
there memory requirement guidelines available ?

On Fri, Jun 11, 2021, 4:33 PM Pulp <notifications@plan.io> wrote:

> --- Please write your response above this line ---
> Issue #8864 <https://pulp.plan.io/issues/8864?pn=1#change-71870> has been
> updated by dalley.
> ------------------------------
>
> - *Assignee* set to *dalley*
> - *Priority* changed from *Normal* to *High*
> - *Severity* changed from *2. Medium* to *3. High*
> - *Triaged* changed from *No* to *Yes*
> - *Bugzillas* set to *1948258*
> - *Sprint* set to *Sprint 98*
>
> This seems workable.
>
> Long-term, we need to fix this upstream in createrepo_c
> ------------------------------
> Issue #8864: Workers go OOM while trying to sync RHEL 7
> <https://pulp.plan.io/issues/8864?pn=1#change-71870>
>
> - *Author: *ehelms@redhat.com
> - *Status: *NEW
> - *Priority: *High
> - *Assignee: *dalley
> - *Category: *
> - *Sprint/Milestone: *
> - *Severity: *3. High
> - *Version: *
> - *Platform Release: *
> - *OS: *
> - *Triaged: *Yes
> - *Groomed: *No
> - *Sprint Candidate: *No
> - *Tags: *
> - *Bugzillas: *1948258
> - *Sprint: *Sprint 98
> - *Quarter: *
>
> Setup:
>
> - CentOS 7 Vagrant box
> - Memory: 8GB
> - Running Katello w/ Pulp 3.11
> - 2 workers present
>
> When I attempt to sync RHEL 7 Server x86_64, it fails every time with Pulp
> workers going OOM. At the time when I initiate the sync there is 3.5GB of
> available memory on the VM.
> ------------------------------
>
> You have received this notification because you have either subscribed to
> or are involved in a project on Pulp Planio.
> To change your notification preferences, please click here:
> https://pulp.plan.io/my/account?tour=mail_preferences
>
> This notification was cheerfully delivered by <https://plan.io/>
> [image: Planio] <https://plan.io/>
>

--00000000000051989005c4845e12
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"auto">After bumping the memory by 4GB on the same setup I encou=
nter the same issue. I could try going higher to find an upper limit (if on=
e exists). Are there memory requirement guidelines available ?</div><br><di=
v class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Fri, Jun 1=
1, 2021, 4:33 PM Pulp &lt;<a href=3D"mailto:notifications@plan.io">notifica=
tions@plan.io</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" sty=
le=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><u></u=
>







<div style=3D"font-family:&quot;ProximaNova-Regular&quot;,Helvetica,Arial,s=
ans-serif;font-size:14px;line-height:1.4em;color:#333434">
<table width=3D"100%" cellspacing=3D"0" cellpadding=3D"0" style=3D"border-c=
ollapse:collapse;margin-bottom:1em;border:1px solid #bbb;padding:4px;border=
-spacing:0;margin-bottom:0;width:100%;border:none;padding:0">
<tr><td style=3D"border:1px solid #bbb;padding:4px;text-align:center;width:=
100%;font-family:MarketWeb,Helvetica,Arial,sans-serif;font-size:0.8em;color=
:#d7d7d7;border:none;padding:0"><p>--- Please write your response above thi=
s line ---</p></td></tr>
<tr><td style=3D"border:1px solid #bbb;padding:4px;border:none;padding:0">I=
ssue <a href=3D"https://pulp.plan.io/issues/8864?pn=3D1#change-71870" style=
=3D"color:#0088b7" target=3D"_blank" rel=3D"noreferrer">#8864</a> has been =
updated by dalley.
<hr style=3D"width:100%;height:1px;background:#ccc;border:0;margin:1.2em 0"=
>

<ul style=3D"color:#959595;margin-bottom:1.5em">
<li><strong>Assignee</strong> set to <i>dalley</i></li>
<li><strong>Priority</strong> changed from <i>Normal</i> to <i>High</i></=
li>
<li><strong>Severity</strong> changed from <i>2. Medium</i> to <i>3. High=
</i></li>
<li><strong>Triaged</strong> changed from <i>No</i> to <i>Yes</i></li>
<li><strong>Bugzillas</strong> set to <i>1948258</i></li>
<li><strong>Sprint</strong> set to <i>Sprint 98</i></li>
</ul>

<p>This seems workable.</p>
<p>Long-term, we need to fix this upstream in createrepo_c</p>
<hr style=3D"width:100%;height:1px;background:#ccc;border:0;margin:1.2em 0"=
>
<h1 style=3D"font-family:&quot;ProximaNova-Bold&quot;,Helvetica,Arial,sans-=
serif;font-weight:normal;margin:0px;font-size:1.3em;line-height:1.4em"><a h=
ref=3D"https://pulp.plan.io/issues/8864?pn=3D1#change-71870" style=3D"color=
:#0088b7;text-decoration:none" target=3D"_blank" rel=3D"noreferrer">Issue #=
8864: Workers go OOM while trying to sync RHEL 7</a></h1>

<ul style=3D"color:#959595;margin-bottom:1.5em"><li><strong>Author: </stron=
g><a href=3D"mailto:ehelms@redhat.com" target=3D"_blank" rel=3D"noreferrer"=
>ehelms@redhat.com</a></li>
<li><strong>Status: </strong>NEW</li>
<li><strong>Priority: </strong>High</li>
<li><strong>Assignee: </strong>dalley</li>
<li><strong>Category: </strong></li>
<li><strong>Sprint/Milestone: </strong></li>
<li><strong>Severity: </strong>3. High</li>
<li><strong>Version: </strong></li>
<li><strong>Platform Release: </strong></li>
<li><strong>OS: </strong></li>
<li><strong>Triaged: </strong>Yes</li>
<li><strong>Groomed: </strong>No</li>
<li><strong>Sprint Candidate: </strong>No</li>
<li><strong>Tags: </strong></li>
<li><strong>Bugzillas: </strong>1948258</li>
<li><strong>Sprint: </strong>Sprint 98</li>
<li><strong>Quarter: </strong></li></ul>

<p>Setup:</p>
<ul>
<li>CentOS 7 Vagrant box</li>
<li>Memory: 8GB</li>
<li>Running Katello w/ Pulp 3.11</li>
<li>2 workers present</li>
</ul>
<p>When I attempt to sync RHEL 7 Server x86_64, it fails every time with Pu=
lp workers going OOM. At the time when I initiate the sync there is 3.5GB o=
f available memory on the VM.</p>


<div><div></div></div>

</td></tr>
<tr><td style=3D"border:1px solid #bbb;padding:4px;font-size:0.8em;width:10=
0%;border:none;padding:0"><hr style=3D"width:100%;height:1px;background:#cc=
c;border:0;margin:1.2em 0"><p>You have received this notification because y=
ou have either subscribed to or are involved in a project on Pulp Planio.<b=
r>
To change your notification preferences, please click here: <a href=3D"http=
s://pulp.plan.io/my/account?tour=3Dmail_preferences" style=3D"color:#0088b7=
" target=3D"_blank" rel=3D"noreferrer">https://pulp.plan.io/my/account?tour=
=3Dmail_preferences</a></p></td></tr>
<tr><td style=3D"border:1px solid #bbb;padding:4px;text-align:center;width:=
100%;font-family:MarketWeb,Helvetica,Arial,sans-serif;font-size:1.2em;color=
:#d7d7d7;border:none;padding:0"><br><div><a href=3D"https://plan.io/" style=
=3D"color:#0088b7;color:#d7d7d7;text-decoration:none" target=3D"_blank" rel=
=3D"noreferrer">This notification was cheerfully delivered by</a></div></td=
></tr>
<tr><td style=3D"border:1px solid #bbb;padding:4px;text-align:center;width:=
100%;border:none;padding:0"><a href=3D"https://plan.io/" title=3D"Planio" s=
tyle=3D"color:#0088b7" target=3D"_blank" rel=3D"noreferrer"><img src=3D"htt=
ps://assets.plan.io/images/planio_logo_gray_204x50.png" height=3D"25" width=
=3D"102" border=3D"0" alt=3D"Planio" style=3D"vertical-align:middle;border:=
none"></a></td></tr>
</table>
</div>

</blockquote></div>

--00000000000051989005c4845e12--
    (1-1/1)