Project

Profile

Help

Actions
Send by e-mail Copy link

Story #236

closed

Don't re-download rpms if they exist on disk

Added by jsherril@redhat.com over 7 years ago. Updated over 3 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
High
Assignee:
mhrivnak
Sprint/Milestone:
-
Start date:
Due date:
% Done:

100%

Estimated time:
Platform Release:
2.9.3
Groomed:
Yes
Sprint Candidate:
Yes
Tags:
Documentation, Pulp 2
Sprint:
Sprint 7
Quarter:

Description

If a content unit exists on disk but is not on the DB, Pulp re-downloads the content at sync time.

Pulp should instead recognize that a rpm plugin unit (rpm, srpm, drpm, distribution) is on disk and use that to create the unit in the database from. The result would be that content which exists on disk is not re-downloaded.

Steps to Reproduce:
1. Sync a large repo
2. Watch it take a while
3. Clear your mongo db
4. rerun pulp-manage-db
5. Sync the same repo
6. Watch it take the same amount of time (all the files are on the file system, so it should take the same amount of time)

Related issues

Related to Pulp - Issue #2177: download_repo task fails to mark some units as downloadedCLOSED - WONTFIXActions
Blocked by Pulp - Task #1600: Store content using consistent and deterministic pathsCLOSED - CURRENTRELEASE

Actions
Blocked by Pulp - Task #1601: Migrate /var/lib/pulp/content to new 2.8 storage paths.CLOSED - CURRENTRELEASEjortel@redhat.com

Actions
Actions
Copy link
 #1

Updated by mhrivnak almost 7 years ago

  • Platform Release set to 2.8.0
  • Groomed set to No
  • Sprint Candidate set to Yes
Actions
Copy link
 #3

Updated by bmbouter over 6 years ago

  • Subject changed from RFE: Don't re-download rpms if they exist on disk to Don't re-download rpms if they exist on disk
Actions
Copy link
 #4

Updated by mhrivnak over 6 years ago

  • Priority changed from High to Normal
  • Groomed changed from No to Yes
  • Tags Documentation added

This is a documentation task with the checklist items above.

Document what to backup from mongodb, but we should probably avoid documenting specific commands that can change over time.

Actions
Copy link
 #5

Updated by jortel@redhat.com over 6 years ago

  • Priority changed from Normal to High
  • Platform Release deleted (2.8.0)
Actions
Copy link
 #6

Updated by bmbouter over 6 years ago

  • Blocked by Task #1600: Store content using consistent and deterministic paths added
Actions
Copy link
 #7

Updated by bmbouter over 6 years ago

  • Blocked by Task #1601: Migrate /var/lib/pulp/content to new 2.8 storage paths. added
Actions
Copy link
 #8

Updated by bmbouter over 6 years ago

  • Description updated (diff)
  • Private changed from Yes to No
Actions
Copy link
 #9

Updated by bmbouter over 6 years ago

I want to know if there is a way this could be a platform functionality. Perhaps platform could provide a hook which plugin writers could call.

Actions
Copy link
 #11

Updated by bmbouter over 6 years ago

These checklist items have been moved to #1603.

Actions
Copy link
 #13

Updated by mhrivnak over 6 years ago

  • Sprint Candidate changed from Yes to No
Actions
Copy link
 #14

Updated by Anonymous about 6 years ago

  • Sprint/Milestone set to 24
  • Sprint Candidate changed from No to Yes
Actions
Copy link
 #15

Updated by mhrivnak about 6 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to mhrivnak
Actions
Copy link
 #16

Updated by mhrivnak almost 6 years ago

  • Sprint/Milestone changed from 24 to 25
Actions
Copy link
 #17

Updated by mhrivnak almost 6 years ago

  • Related to Issue #2177: download_repo task fails to mark some units as downloaded added
Actions
Copy link
 #18

Updated by mhrivnak almost 6 years ago

  • Status changed from ASSIGNED to POST

Added by mhrivnak almost 6 years ago

Revision 3dd7cefc

Adds docs for re-using files on disk when DB is lost

fixes #236 https://pulp.plan.io/issues/236

Added by mhrivnak almost 6 years ago

Revision 3dd7cefc

Adds docs for re-using files on disk when DB is lost

fixes #236 https://pulp.plan.io/issues/236

Actions
Copy link
 #19

Updated by mhrivnak almost 6 years ago

  • Status changed from POST to MODIFIED
  • % Done changed from 0 to 100
Actions
Copy link
 #20

Updated by semyers almost 6 years ago

  • Platform Release set to 2.9.3
Actions
Copy link
 #21

Updated by semyers almost 6 years ago

  • Status changed from MODIFIED to 5
Actions
Copy link
 #22

Updated by semyers almost 6 years ago

  • Status changed from 5 to CLOSED - CURRENTRELEASE
Actions
Copy link
 #25

Updated by bmbouter over 4 years ago

  • Sprint set to Sprint 7
Actions
Copy link
 #26

Updated by bmbouter over 4 years ago

  • Sprint/Milestone deleted (25)
Actions
Copy link
 #27

Updated by bmbouter over 3 years ago

  • Tags Pulp 2 added
Actions
Send by e-mail Copy link

Also available in: Atom PDF