Project

Profile

Help

Actions
Send by e-mail Copy link

Issue #4175

closed

Checksum did not match during Ubuntu repo sync

Added by SoR over 5 years ago. Updated almost 5 years ago.

Status:
CLOSED - NOTABUG
Priority:
Normal
Assignee:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
2. Medium
Version - Debian:
Platform Release:
Target Release - Debian:
OS:
CentOS 7
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

Hello,

I have an issue during Ubuntu repo synchronization:

lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) Task pulp.server.managers.repo.sync.sync[3001b05f-f9fd-4799-a512-69e03f907a97] raised unexpected: Exception(u'Checksum did not match',)
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) Traceback (most recent call last):
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 367, in trace_task
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) R = retval = fun(*args, **kwargs)
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in call
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) return super(Task, self).__call__(*args, **kwargs)
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in call
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) return super(PulpTask, self).__call__(*args, **kwargs)
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 622, in protected_call
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) return self.run(*args, **kwargs)
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 769, in sync
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) sync_report = sync_repo(transfer_repo, conduit, call_config)
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 737, in wrap_f
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) return f(*args, **kwargs)
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/pulp_deb/plugins/importers/importer.py", line 135, in sync_repo
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) report = self._current_sync.process_lifecycle()
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 572, in process_lifecycle
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) super(PluginStep, self).process_lifecycle()
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 163, in process_lifecycle
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) step.process()
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 256, in process
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) self._process_block()
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 303, in _process_block
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) self.process_main()
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/pulp_deb/plugins/importers/sync.py", line 272, in process_main
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) if dlr.url in self.parent.packages_urls[release]])
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) File "/usr/lib/python2.7/site-packages/debpkgr/aptrepo.py", line 302, in validate_component_arch_packages_downloads
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) raise Exception("Checksum did not match")
lis 21 09:02:54 pulp.localhost pulp[2811]: celery.app.trace:ERROR: [3001b05f] (2811-43200) Exception: Checksum did not match

My pulp server is running on CentOS 7.5.1804 with pulp packages installed:
python-pulp-python-common-2.0.3-1.el7.noarch
python-pulp-repoauth-2.17.1-1.el7.noarch
python-pulp-puppet-common-2.17.1-1.el7.noarch
pulp-selinux-2.17.1-1.el7.noarch
pulp-rpm-plugins-2.17.1-1.el7.noarch
pulp-rpm-admin-extensions-2.17.1-1.el7.noarch
pulp-python-plugins-2.0.3-1.el7.noarch
python-pulp-deb-common-1.8.0-1.el7.noarch
python-pulp-bindings-2.17.1-1.el7.noarch
pulp-deb-plugins-1.8.0-1.el7.noarch
pulp-docker-admin-extensions-3.2.1-1.el7.noarch
python-pulp-docker-common-3.2.1-1.el7.noarch
python-pulp-oid_validation-2.17.1-1.el7.noarch
pulp-admin-client-2.17.1-1.el7.noarch
pulp-puppet-admin-extensions-2.17.1-1.el7.noarch
python-pulp-common-2.17.1-1.el7.noarch
python-pulp-rpm-common-2.17.1-1.el7.noarch
python-pulp-client-lib-2.17.1-1.el7.noarch
pulp-server-2.17.1-1.el7.noarch
pulp-docker-plugins-3.2.1-1.el7.noarch
pulp-deb-admin-extensions-1.8.0-1.el7.noarch
python2-debpkgr-1.1.0-1.el7.noarch

pulp repo info:
pulp-admin deb repo list --details --repo-id ubuntu
--------------------------------------------------------------------
Debian Repositories
--------------------------------------------------------------------

Id: ubuntu
Display Name: Ubuntu test repo
Description: None
Content Unit Counts:
Deb: 53837
Deb Component: 4
Deb Release: 1
Notes:
Scratchpad:
Importers:
Config:
Architectures: amd64
Feed: http://ftp.icm.edu.pl/pub/linux/dist/ubuntu/
Max Downloads: 4
Releases: xenial,xenial-security,xenial-updates,xenial-proposed,xenial
-backports
Remove Missing: True
Validate: False
Id: deb_importer
Importer Type Id: deb_importer
Last Override Config:
Last Sync: 2018-11-21T08:02:54Z
Last Updated: 2018-11-20T10:57:17Z
Repo Id: ubuntu
Scratchpad: None
Distributors:
Auto Publish: True
Config:
Http: True
Https: True
Relative URL: ubuntu
Distributor Type Id: deb_distributor
Id: deb_distributor
Last Override Config:
Last Publish: 2018-10-12T11:00:40Z
Last Updated: 2018-10-12T12:55:49Z
Repo Id: ubuntu
Scratchpad:

I've also tried other ubuntu mirrors, same issue. I've no issue during debian repo synchronisation from same mirror.

Greetings
Daniel Kubiak

Actions
Copy link
 #1

Updated by ipanova@redhat.com over 5 years ago

  • Project changed from Pulp to Debian Support
  • Category changed from 15 to 16
Actions
Copy link
 #2

Updated by ipanova@redhat.com over 5 years ago

  • Sprint/Milestone deleted (2.17.0)
Actions
Copy link
 #3

Updated by N2banjos over 5 years ago

I have also run into this issue. I've tried creating a combined repo of xenial and bionic base, updates, security with main and universe and tried just only xenial release/components and get the "Task Failed\n\nChecksum did not match". Here's the repo creates...

pulp-admin deb repo create --repo-id 'pub-ubuntu' --relative-url 'pub/ubuntu' --feed 'http://archive.ubuntu.com/ubuntu' --releases 'bionic,bionic-updates,bionic-security,xenial,xenial-updates,xenial-security' --components 'main,universe' --architectures 'amd64' --serve-http true

pulp-admin deb repo create --repo-id 'pub-xenial' --relative-url 'pub/xenial' --feed 'http://archive.ubuntu.com/ubuntu' --releases 'xenial,xenial-updates,xenial-security' --components 'main,universe' --architectures 'amd64' --serve-http true

I'm running from CentOS Linux release 7.6.1810 (Core) using these pulp rpm pkgs...

python-pulp-oid_validation-2.18.0-2.el7.noarch
pulp-docker-plugins-3.2.2-1.el7.noarch
pulp-docker-admin-extensions-3.2.2-1.el7.noarch
python-pulp-common-2.18.0-2.el7.noarch
python-pulp-deb-common-1.8.0-1.el7.noarch
pulp-selinux-2.18.0-2.el7.noarch
pulp-deb-admin-extensions-1.8.0-1.el7.noarch
python-pulp-puppet-common-2.18.0-1.el7.noarch
pulp-admin-client-2.18.0-2.el7.noarch
pulp-deb-plugins-1.8.0-1.el7.noarch
pulp-rpm-admin-extensions-2.18.0-1.el7.noarch
python-pulp-docker-common-3.2.2-1.el7.noarch
pulp-server-2.18.0-2.el7.noarch
pulp-puppet-plugins-2.18.0-1.el7.noarch
pulp-puppet-admin-extensions-2.18.0-1.el7.noarch
python-pulp-bindings-2.18.0-2.el7.noarch
python-pulp-repoauth-2.18.0-2.el7.noarch
pulp-rpm-plugins-2.18.0-1.el7.noarch
python-pulp-rpm-common-2.18.0-1.el7.noarch
python-pulp-client-lib-2.18.0-2.el7.noarch

Actions
Copy link
 #4

Updated by SoR about 5 years ago

Another test:
CentOS Linux release 7.6.1810 (Core)

Pulp packages installed:
python-pulp-rpm-common-2.18.0-1.el7.noarch
python-pulp-repoauth-2.18.0-2.el7.noarch
pulp-server-2.18.0-2.el7.noarch
pulp-puppet-admin-extensions-2.18.0-1.el7.noarch
python-pulp-common-2.18.0-2.el7.noarch
python-pulp-oid_validation-2.18.0-2.el7.noarch
pulp-deb-plugins-1.8.0-1.el7.noarch
python-pulp-bindings-2.18.0-2.el7.noarch
python-pulp-client-lib-2.18.0-2.el7.noarch
pulp-docker-admin-extensions-3.2.2-1.el7.noarch
libsolv-0.6.34-2.pulp.el7.x86_64
pulp-rpm-plugins-2.18.0-1.el7.noarch
python-pulp-docker-common-3.2.2-1.el7.noarch
pulp-admin-client-2.18.0-2.el7.noarch
pulp-deb-admin-extensions-1.8.0-1.el7.noarch
python-pulp-deb-common-1.8.0-1.el7.noarch
pulp-selinux-2.18.0-2.el7.noarch
python2-solv-0.6.34-2.pulp.el7.x86_64
python-pulp-puppet-common-2.18.0-1.el7.noarch
pulp-rpm-admin-extensions-2.18.0-1.el7.noarch

Repo configuration:
pulp-admin deb repo create --repo-id=ubuntu-main --releases=bionic --architectures=i386,amd64 --components=main --feed=http://mirror.vutbr.cz/ubuntu/archive/

Sync repo:
pulp-admin -vvv deb repo sync run --repo-id=ubuntu-main
"queue": "reserved_resource_worker-0@pulp.local.bofh.xxxx.pl.dq2",
"state": "error",
"worker_name": "",
"result": null,
"error": {
"code": "DEBSYNC002",
"data": {
"checksum_actual": "d9d5bdf8465975dc1f677450cf55b6b3a2598e1e1b21123b8bd94ed5adc0f482",
"repo_id": "ubuntu-main",
"checksum_expected": "a564500bf4884170ce8e27bc9c444309e700e37e5713a455c2d65a8884fff944",
"feed_url": "http://mirror.vutbr.cz/ubuntu/archive",
"filename": "libclang1-6.0_6.0-1ubuntu2_i386.deb"
},
"description": "Unable to sync ubuntu-main from http://mirror.vutbr.cz/ubuntu/archive: mismatching checksums for libclang1-6.0_6.0-1ubuntu2_i386.deb: expected a564500bf4884170ce8e27bc9c444309e700e37e5713a455c2d65a8884fff944, actual d9d5bdf8465975dc1f677450cf55b6b3a2598e1e1b21123b8bd94ed5adc0f482",
"sub_errors": []
},
"_id": {
"$oid": "5c4b43cfd528eee1937bd7f3"
},
"id": "5c4b43cfd528eee1937bd7f3"
}

Task Failed

Unable to sync ubuntu-main from http://mirror.vutbr.cz/ubuntu/archive:
mismatching checksums for libclang1-6.0_6.0-1ubuntu2_i386.deb: expected
a564500bf4884170ce8e27bc9c444309e700e37e5713a455c2d65a8884fff944, actual
d9d5bdf8465975dc1f677450cf55b6b3a2598e1e1b21123b8bd94ed5adc0f482

I've downloaded http://mirror.vutbr.cz/ubuntu/archive/pool/main/l/llvm-toolchain-6.0/libclang1-6.0_6.0-1ubuntu2_i386.deb and it's sha256 checksum is: a564500bf4884170ce8e27bc9c444309e700e37e5713a455c2d65a8884fff944
same as in Packages.xz definition:
Package: libclang1-6.0
Architecture: i386
Version: 1:6.0-1ubuntu2
Multi-Arch: same
Priority: optional
Section: devel
Source: llvm-toolchain-6.0
Origin: Ubuntu
Maintainer: Ubuntu Developers <>
Original-Maintainer: LLVM Packaging Team <>
Bugs: https://bugs.launchpad.net/ubuntu/+filebug
Installed-Size: 30931
Depends: libc6 (>= 2.4), libgcc1 (>= 1:7), libllvm6.0 (>= 1:6.0~svn298832-1~), libstdc++6 (>= 6)
Filename: pool/main/l/llvm-toolchain-6.0/libclang1-6.0_6.0-1ubuntu2_i386.deb
Size: 8131460
MD5sum: c3af84e20c166e0394307291b0e2ad56
SHA1: 284a97afc941cf225d4f900248fad92ad525b3d6
SHA256: a564500bf4884170ce8e27bc9c444309e700e37e5713a455c2d65a8884fff944
Homepage: http://www.llvm.org/
Description: C interface to the clang library
Description-md5: 87298a16bf7fd99987a7ab1850749f1f
Supported: 5y

Actions
Copy link
 #5

Updated by bmbouter about 5 years ago

  • Tags Pulp 2 added
Actions
Copy link
 #6

Updated by mdellweg almost 5 years ago

  • Status changed from NEW to CLOSED - NOTABUG
  • Triaged changed from No to Yes

We believe, this is a transient error due to a failed download.

Actions
Send by e-mail Copy link

Also available in: Atom PDF