Project

Profile

Help

Actions
Send by e-mail Copy link

Issue #1885

closed

Pulp uploads are failing with "too many open files" error

Added by dgregor@redhat.com over 8 years ago. Updated over 5 years ago.

Status:
CLOSED - WORKSFORME
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version:
2.7.1
Platform Release:
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

We are seeing uploads to pulp fail like:

Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) [Errno 24] Too many open files: '/var/lib/pulp/uploads/a1fce30f-f731-4109-ab2d-9cc15464727d'
Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) Traceback (most recent call last):
Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) File "/usr/lib/python2.6/site-packages/django/core/handlers/base.py", line 109, in get_response
Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) File "/usr/lib/python2.6/site-packages/django/views/generic/base.py", line 48, in view
Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) File "/usr/lib/python2.6/site-packages/django/views/generic/base.py", line 69, in dispatch
Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) File "/usr/lib/python2.6/site-packages/pulp/server/webservices/views/decorators.py", line 237, in _auth_decorator
Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) File "/usr/lib/python2.6/site-packages/pulp/server/webservices/views/decorators.py", line 191, in _verify_auth
Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) File "/usr/lib/python2.6/site-packages/pulp/server/webservices/views/util.py", line 111, in wrapper
Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) File "/usr/lib/python2.6/site-packages/pulp/server/webservices/views/content.py", line 433, in post
Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) File "/usr/lib/python2.6/site-packages/pulp/server/managers/content/upload.py", line 48, in initialize_upload
Apr 30 08:35:48 pulp07 pulp: pulp.server.webservices.middleware.exception:ERROR: (12507-64512) IOError: [Errno 24] Too many open files: '/var/lib/pulp/uploads/a1fce30f-f731-4109-ab2d-9cc15464727d'

The apache user limit for open files is the default of 1024 and we have 8 pulp processes. I don't know if the problem is leaking file descriptors or is 1024 just isn't enough for Pulp.

Actions
Send by e-mail Copy link

Also available in: Atom PDF