Project

Profile

Help

Story #8852

closed

Delay publication file deletion to orphan cleanup to aid in online backups

Added by jsherril@redhat.com almost 3 years ago. Updated over 2 years ago.

Status:
CLOSED - DUPLICATE
Priority:
Normal
Assignee:
-
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Platform Release:
Groomed:
No
Sprint Candidate:
No
Tags:
Katello
Sprint:
Quarter:

Description

Ticket moved to GitHub: "pulp/pulpcore/2009":https://github.com/pulp/pulpcore/issues/2009


It would be useful if we could:

  1. perform an online backup of the pulp postgresql database, this is relatively quick
  2. backup the /var/lib/pulp/ filesystem

This is nearly possible today as we could simply not run orphan cleanup. However publication files (such as repomd files for yum content), are cleaned up when a publication is deleted. It would be awesome to defer that until orphan cleanup time. This would allow /var/lib/pulp/ to be additive until orphan cleanup is called.

Actions #1

Updated by bmbouter almost 3 years ago

I'd like to see this improve so +1 to this effort.

I have these concerns about the proposal (although I like the idea sharing):

  1. Other users may rely on this functionality and we probably couldn't adjust this with Pulp3 being released for so long.
  2. How can we find a solution that also serves users who want online backups but can't "hold back" the orphan cleanups?

Can more info be shared about the problems with an LVM snapshot approach? I've always heard that's the answer, but maybe in practice it's not that simple.

Actions #2

Updated by dkliban@redhat.com almost 3 years ago

  • Tracker changed from Issue to Story
  • % Done set to 0
  • Severity deleted (2. Medium)
  • Triaged deleted (No)
Actions #3

Updated by jsherril@redhat.com almost 3 years ago

Evgeni was the one that shared the issues, essentially what it sounded like was that once you have a snapshot created, write performance drops considerably.

I found a blog post that details this: https://www.percona.com/blog/2009/02/05/disaster-lvm-performance-in-snapshot-mode/

Actions #4

Updated by pulpbot over 2 years ago

  • Description updated (diff)
  • Status changed from NEW to CLOSED - DUPLICATE

Also available in: Atom PDF