Issue #1938: force_full is not supported by export_distributor - RPM Support - Pulp

Actions

Send by e-mail Copy link

Issue #1938

closed

force_full is not supported by export_distributor

Added by ipanova@redhat.com over 8 years ago. Updated over 5 years ago.

Status:

CLOSED - CURRENTRELEASE

Priority:

High

Assignee:

ttereshc

Sprint/Milestone:

Start date:

Due date:

Estimated time:

Severity:

3. High

Version:

Master

Platform Release:

2.9.0

OS:

Triaged:

Yes

Groomed:

Sprint Candidate:

Tags:

Pulp 2

Sprint:

Sprint 3

Quarter:

Description

$ pulp-admin -vv rpm repo export run --repo-id ina --force-full

+----------------------------------------------------------------------+
                      Publishing Repository [ina]
+----------------------------------------------------------------------+

The following publish configuration options will be used:

Force Full:  True

This command may be exited via ctrl+c without affecting the request.

Task Failed

Configuration key 'force_full' is not supported

2016-05-23 19:25:44,207 - INFO - GET request to /pulp/api/v2/tasks/32cb3161-df45-49f6-8f8b-a82fb469e030/ with parameters None
2016-05-23 19:25:44,208 - INFO - Response status : 200 

2016-05-23 19:25:44,208 - INFO - Response body :
 {
  "exception": null, 
  "task_type": "pulp.server.managers.repo.publish.publish", 
  "_href": "/pulp/api/v2/tasks/32cb3161-df45-49f6-8f8b-a82fb469e030/", 
  "task_id": "32cb3161-df45-49f6-8f8b-a82fb469e030", 
  "tags": [
    "pulp:repository:ina", 
    "pulp:action:publish"
  ], 
  "finish_time": "2016-05-23T17:25:43Z", 
  "_ns": "task_status", 
  "start_time": "2016-05-23T17:25:43Z", 
  "traceback": "Traceback (most recent call last):\n  File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 240, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File \"/home/ipanova/pulp_development/pulp/server/pulp/server/async/tasks.py\", line 473, in __call__\n    return super(Task, self).__call__(*args, **kwargs)\n  File \"/home/ipanova/pulp_development/pulp/server/pulp/server/async/tasks.py\", line 103, in __call__\n    return super(PulpTask, self).__call__(*args, **kwargs)\n  File \"/usr/lib/python2.7/site-packages/celery/app/trace.py\", line 437, in __protected_call__\n    return self.run(*args, **kwargs)\n  File \"/home/ipanova/pulp_development/pulp/server/pulp/server/controllers/repository.py\", line 971, in publish\n    result = check_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)\n  File \"/home/ipanova/pulp_development/pulp/server/pulp/server/controllers/repository.py\", line 1030, in check_publish\n    result = _do_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)\n  File \"/home/ipanova/pulp_development/pulp/server/pulp/server/controllers/repository.py\", line 1082, in _do_publish\n    publish_report = publish_repo(transfer_repo, conduit, call_config)\n  File \"/home/ipanova/pulp_development/pulp/server/pulp/server/async/tasks.py\", line 658, in wrap_f\n    return f(*args, **kwargs)\n  File \"/home/ipanova/pulp_development/pulp_rpm/plugins/pulp_rpm/plugins/distributors/export_distributor/distributor.py\", line 130, in publish_repo\n    raise PulpDataException(msg)\nPulpDataException: Configuration key 'force_full' is not supported\n", 
  "spawned_tasks": [], 
  "progress_report": {}, 
  "queue": "reserved_resource_worker-0@ina.usersys.redhat.com.dq", 
  "state": "error", 
  "worker_name": "reserved_resource_worker-0@ina.usersys.redhat.com", 
  "result": null, 
  "error": {
    "code": "PLP0000", 
    "data": {}, 
    "description": "Configuration key 'force_full' is not supported", 
    "sub_errors": []
  }, 
  "_id": {
    "$oid": "57433d17dd83eaa0e018b5a2"
  }, 
  "id": "57433d17dd83eaa0e018b5a2"
}

Task Failed

Configuration key 'force_full' is not supported

Actions

Copy link

Updated by bmbouter over 8 years ago

Priority changed from Normal to High
Severity changed from 2. Medium to 3. High
Platform Release set to 2.9.0

Actions

Copy link

Updated by bmbouter over 8 years ago

Triaged changed from No to Yes

Added by ttereshc over 8 years ago

Revision 2d3472f7 | View on GitHub

Fix force_full option for export distributor

closes #1938 https://pulp.plan.io/issues/1938

Actions

Copy link

Updated by ttereshc over 8 years ago

Status changed from NEW to POST
Assignee set to ttereshc

https://github.com/pulp/pulp_rpm/pull/884

Actions

Copy link

Updated by ttereshc over 8 years ago

Status changed from POST to MODIFIED
% Done changed from 0 to 100

Applied in changeset 2d3472f7065b6e86d9d045d7f3ee6a800f725a57.

Actions

Copy link

Updated by ttereshc over 8 years ago

Sprint/Milestone set to 21

Actions

Copy link

Updated by pthomas@redhat.com over 8 years ago

Added the pulp-smash issue
https://github.com/PulpQE/pulp-smash/issues/301

Actions

Copy link

Updated by pthomas@redhat.com over 8 years ago

Status changed from MODIFIED to 6

verified


[root@ibm-x3550m3-09 ~]#  pulp-admin -vv rpm repo export run --repo-id rpm --force-full
+----------------------------------------------------------------------+
                      Publishing Repository [rpm]
+----------------------------------------------------------------------+

The following publish configuration options will be used:

Force Full:  True

2016-06-29 16:27:05,586 - DEBUG - sending POST request to /pulp/api/v2/tasks/search/
2016-06-29 16:27:05,779 - INFO - POST request to /pulp/api/v2/tasks/search/ with parameters {"criteria": {"filters": {"state": {"$nin": ["finished", "error", "canceled", "skipped"]}, "tags": {"$all": ["pulp:repository:rpm", "pulp:action:publish"]}}}}
2016-06-29 16:27:05,779 - INFO - Response status : 200 

2016-06-29 16:27:05,780 - INFO - Response body :
 []

2016-06-29 16:27:05,780 - DEBUG - sending POST request to /pulp/api/v2/repositories/rpm/actions/publish/
2016-06-29 16:27:05,922 - INFO - POST request to /pulp/api/v2/repositories/rpm/actions/publish/ with parameters {"override_config": {"force_full": true}, "id": "export_distributor"}
2016-06-29 16:27:05,922 - INFO - Response status : 202 

2016-06-29 16:27:05,922 - INFO - Response body :
 {
  "spawned_tasks": [
    {
      "_href": "/pulp/api/v2/tasks/858c4ca1-f42d-4cbe-a7a2-65d796b1779d/", 
      "task_id": "858c4ca1-f42d-4cbe-a7a2-65d796b1779d"
    }
  ], 
  "result": null, 
  "error": null
}

This command may be exited via ctrl+c without affecting the request.

2016-06-29 16:27:06,924 - DEBUG - sending GET request to /pulp/api/v2/tasks/858c4ca1-f42d-4cbe-a7a2-65d796b1779d/
2016-06-29 16:27:07,066 - INFO - GET request to /pulp/api/v2/tasks/858c4ca1-f42d-4cbe-a7a2-65d796b1779d/ with parameters None
2016-06-29 16:27:07,066 - INFO - Response status : 200 

2016-06-29 16:27:07,068 - INFO - Response body :
 {
  "exception": null, 
  "task_type": "pulp.server.managers.repo.publish.publish", 
  "_href": "/pulp/api/v2/tasks/858c4ca1-f42d-4cbe-a7a2-65d796b1779d/", 
  "task_id": "858c4ca1-f42d-4cbe-a7a2-65d796b1779d", 
  "tags": [
    "pulp:repository:rpm", 
    "pulp:action:publish"
  ], 
  "finish_time": "2016-06-29T14:27:06Z", 
  "_ns": "task_status", 
  "start_time": "2016-06-29T14:27:05Z", 
  "traceback": null, 
  "spawned_tasks": [], 
  "progress_report": {
    "export_distributor": [
      {
        "num_success": 1, 
        "description": "Initializing repo metadata", 
        "step_type": "initialize_repo_metadata", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "78816eac-bd06-445c-96da-810e782e9c5b", 
        "num_processed": 1
      }, 
      {
        "num_success": 0, 
        "description": "Publishing Distribution files", 
        "step_type": "distribution", 
        "items_total": 0, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "b736d725-3d42-42ac-a0ff-d9b2f927e82d", 
        "num_processed": 0
      }, 
      {
        "num_success": 32, 
        "description": "Publishing RPMs", 
        "step_type": "rpms", 
        "items_total": 32, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "f6e66e75-11c7-4a16-8286-14505cc0777d", 
        "num_processed": 32
      }, 
      {
        "num_success": 0, 
        "description": "Publishing Delta RPMs", 
        "step_type": "drpms", 
        "items_total": 1, 
        "state": "SKIPPED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "fed0c259-cdaa-4a8a-bb16-fa259bcf2aa4", 
        "num_processed": 0
      }, 
      {
        "num_success": 4, 
        "description": "Publishing Errata", 
        "step_type": "errata", 
        "items_total": 4, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "87fe4f67-182b-4b21-b599-9296bdeb420c", 
        "num_processed": 4
      }, 
      {
        "num_success": 4, 
        "description": "Publishing Comps file", 
        "step_type": "comps", 
        "items_total": 4, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "68d3ca3f-e7a2-4880-945f-7f53c22ac185", 
        "num_processed": 4
      }, 
      {
        "num_success": 0, 
        "description": "Publishing Metadata.", 
        "step_type": "metadata", 
        "items_total": 0, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "1c1179c7-5761-4a33-8519-5c90aad8caad", 
        "num_processed": 0
      }, 
      {
        "num_success": 1, 
        "description": "Closing repo metadata", 
        "step_type": "close_repo_metadata", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "0d98de0d-0486-4612-9123-156139ee8835", 
        "num_processed": 1
      }, 
      {
        "num_success": 0, 
        "description": "Generating sqlite files", 
        "step_type": "generate sqlite", 
        "items_total": 1, 
        "state": "SKIPPED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "079fc160-dcc1-4ce4-aac6-05377c1e394e", 
        "num_processed": 0
      }, 
      {
        "num_success": 1, 
        "description": "Copying files", 
        "step_type": "save_tar", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "e38a2f6c-3cbb-4ca3-9df2-2f7251f39d31", 
        "num_processed": 1
      }, 
      {
        "num_success": 1, 
        "description": "Writing Listings File", 
        "step_type": "initialize_repo_metadata", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "1898118b-9cd1-4a7d-afba-6d3691121c28", 
        "num_processed": 1
      }, 
      {
        "num_success": 1, 
        "description": "Exporting ISO", 
        "step_type": "save_iso", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "b92a6ac9-ceae-41ca-938f-66be2459d180", 
        "num_processed": 1
      }, 
      {
        "num_success": 1, 
        "description": "Moving ISO to final location", 
        "step_type": "publish_directory", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "e473d784-7cdf-4e29-9f27-d69211363239", 
        "num_processed": 1
      }
    ]
  }, 
  "queue": "reserved_resource_worker-15@ibm-x3550m3-09.lab.eng.brq.redhat.com.dq", 
  "state": "finished", 
  "worker_name": "reserved_resource_worker-15@ibm-x3550m3-09.lab.eng.brq.redhat.com", 
  "result": {
    "exception": null, 
    "repo_id": "rpm", 
    "started": "2016-06-29T14:27:05Z", 
    "_ns": "repo_publish_results", 
    "completed": "2016-06-29T14:27:06Z", 
    "traceback": null, 
    "distributor_type_id": "export_distributor", 
    "error_message": null, 
    "summary": {
      "generate sqlite": "SKIPPED", 
      "initialize_repo_metadata": "FINISHED", 
      "rpms": "FINISHED", 
      "close_repo_metadata": "FINISHED", 
      "drpms": "SKIPPED", 
      "comps": "FINISHED", 
      "errata": "FINISHED", 
      "distribution": "FINISHED", 
      "metadata": "FINISHED", 
      "publish_directory": "FINISHED", 
      "save_iso": "FINISHED", 
      "save_tar": "FINISHED"
    }, 
    "result": "success", 
    "distributor_id": "export_distributor", 
    "id": "5773dabacce1890a9547e8d1", 
    "details": [
      {
        "num_success": 1, 
        "description": "Initializing repo metadata", 
        "step_type": "initialize_repo_metadata", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "78816eac-bd06-445c-96da-810e782e9c5b", 
        "num_processed": 1
      }, 
      {
        "num_success": 0, 
        "description": "Publishing Distribution files", 
        "step_type": "distribution", 
        "items_total": 0, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "b736d725-3d42-42ac-a0ff-d9b2f927e82d", 
        "num_processed": 0
      }, 
      {
        "num_success": 32, 
        "description": "Publishing RPMs", 
        "step_type": "rpms", 
        "items_total": 32, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "f6e66e75-11c7-4a16-8286-14505cc0777d", 
        "num_processed": 32
      }, 
      {
        "num_success": 0, 
        "description": "Publishing Delta RPMs", 
        "step_type": "drpms", 
        "items_total": 1, 
        "state": "SKIPPED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "fed0c259-cdaa-4a8a-bb16-fa259bcf2aa4", 
        "num_processed": 0
      }, 
      {
        "num_success": 4, 
        "description": "Publishing Errata", 
        "step_type": "errata", 
        "items_total": 4, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "87fe4f67-182b-4b21-b599-9296bdeb420c", 
        "num_processed": 4
      }, 
      {
        "num_success": 4, 
        "description": "Publishing Comps file", 
        "step_type": "comps", 
        "items_total": 4, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "68d3ca3f-e7a2-4880-945f-7f53c22ac185", 
        "num_processed": 4
      }, 
      {
        "num_success": 0, 
        "description": "Publishing Metadata.", 
        "step_type": "metadata", 
        "items_total": 0, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "1c1179c7-5761-4a33-8519-5c90aad8caad", 
        "num_processed": 0
      }, 
      {
        "num_success": 1, 
        "description": "Closing repo metadata", 
        "step_type": "close_repo_metadata", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "0d98de0d-0486-4612-9123-156139ee8835", 
        "num_processed": 1
      }, 
      {
        "num_success": 0, 
        "description": "Generating sqlite files", 
        "step_type": "generate sqlite", 
        "items_total": 1, 
        "state": "SKIPPED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "079fc160-dcc1-4ce4-aac6-05377c1e394e", 
        "num_processed": 0
      }, 
      {
        "num_success": 1, 
        "description": "Copying files", 
        "step_type": "save_tar", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "e38a2f6c-3cbb-4ca3-9df2-2f7251f39d31", 
        "num_processed": 1
      }, 
      {
        "num_success": 1, 
        "description": "Writing Listings File", 
        "step_type": "initialize_repo_metadata", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "1898118b-9cd1-4a7d-afba-6d3691121c28", 
        "num_processed": 1
      }, 
      {
        "num_success": 1, 
        "description": "Exporting ISO", 
        "step_type": "save_iso", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "b92a6ac9-ceae-41ca-938f-66be2459d180", 
        "num_processed": 1
      }, 
      {
        "num_success": 1, 
        "description": "Moving ISO to final location", 
        "step_type": "publish_directory", 
        "items_total": 1, 
        "state": "FINISHED", 
        "error_details": [], 
        "details": "", 
        "num_failures": 0, 
        "step_id": "e473d784-7cdf-4e29-9f27-d69211363239", 
        "num_processed": 1
      }
    ]
  }, 
  "error": null, 
  "_id": {
    "$oid": "5773dab9d64f88dea1e3df33"
  }, 
  "id": "5773dab9d64f88dea1e3df33"
}

Initializing repo metadata
[-]
... completed

Publishing Distribution files
[-]
... completed

Publishing RPMs
[==================================================] 100%
32 of 32 items
... completed

Publishing Delta RPMs
... skipped

Publishing Errata
[==================================================] 100%
4 of 4 items
... completed

Publishing Comps file
[==================================================] 100%
4 of 4 items
... completed

Publishing Metadata.
[-]
... completed

Closing repo metadata
[-]
... completed

Generating sqlite files
... skipped

Copying files
[-]
... completed

Writing Listings File
[-]
... completed

Exporting ISO
[-]
... completed

Moving ISO to final location
[-]
... completed

Task Succeeded

Actions

Copy link