Issue #8044: no index for _last_updated on content models causes a fatal error when ordered result is queried - Pulp

Actions

Send by e-mail Copy link

Issue #8044

closed

no index for _last_updated on content models causes a fatal error when ordered result is queried

Added by ttereshc almost 4 years ago. Updated almost 4 years ago.

Status:

CLOSED - CURRENTRELEASE

Priority:

Normal

Assignee:

ggainey

Category:

Sprint/Milestone:

Start date:

Due date:

Estimated time:

Severity:

2. Medium

Version:

Platform Release:

2.21.5

OS:

Triaged:

Yes

Groomed:

Sprint Candidate:

Tags:

Sprint:

Sprint 88

Quarter:

Description

To ensure data correctness, Migration plugin requires fetching content in ordered way. For this _last_updated field is used.

Without index, the query ordered by that field fails due to lack of memory and complains that no index is present.

Related issues

Actions

Copy link

Updated by ttereshc almost 4 years ago

Related to Issue #7781: In case of any issues in the middle of pre-migration, migration re-run doesn't pick up all the needed content. added

Actions

Copy link

Updated by ggainey almost 4 years ago

Example:

> db.units_rpm.find().sort( { _last_updated: -1 } )                                          
Error: error: {                                                                              
        "ok" : 0,                                                                            
        "errmsg" : "Executor error during find command: OperationFailed: Sort operation used more than the maximum 33554432 bytes of RAM. Add an index, or specify a smaller limit.",
        "code" : 96,                                                                         
        "codeName" : "OperationFailed"                                                       
}

Actions

Copy link

Updated by ggainey almost 4 years ago

Performance note: adding index (last_updated, -1) to all units collections, in an installation with 274 sync'd repositories comprising 259738 RPMs, took 4m30s to complete.

Actions

Copy link