RPM Support

Try to sync or migrate a distribution tree which has is_layered set in its .treeinfo and it would lead to this error:

Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: Traceback (most recent call last):
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/worker.py", line 975, in perform_job
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: rv = job.perform()
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 696, in perform
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: self._result = self._execute()
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/rq/job.py", line 719, in _execute
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: return self.func(*self.args, **self.kwargs)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/tasks/migrate.py", line 81, in migrate_from_pulp2
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: migrate_content(plan, skip_corrupted=skip_corrupted)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/migration.py", line 47, in migrate_content
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: plugin.migrator.migrate_content_to_pulp3(skip_corrupted=skip_corrupted)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/plugin/rpm/migrator.py", line 145, in migrate_content_to_pulp3
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: loop.run_until_complete(dm.create())
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: return future.result()
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/home/vagrant/devel/pulp-2to3-migration/pulp_2to3_migration/app/plugin/content.py", line 90, in create
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: await pipeline
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/api.py", line 225, in create_pipeline
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: await asyncio.gather(*futures)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/api.py", line 43, in __call__
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: await self.run()
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/home/vagrant/devel/pulpcore/pulpcore/plugin/stages/content_stages.py", line 95, in run
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: d_content.content.save()
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/home/vagrant/devel/pulpcore/pulpcore/app/models/base.py", line 149, in save
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: return super().save(*args, **kwargs)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django_lifecycle/mixins.py", line 129, in save
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: save(*args, **kwargs)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/base.py", line 744, in save
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: force_update=force_update, update_fields=update_fields)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/base.py", line 782, in save_base
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: force_update, using, update_fields,
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/base.py", line 873, in _save_table
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: result = self._do_insert(cls._base_manager, using, fields, update_pk, raw)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/base.py", line 911, in _do_insert
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: using=using, raw=raw)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/manager.py", line 82, in manager_method
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: return getattr(self.get_queryset(), name)(*args, **kwargs)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/query.py", line 1186, in _insert
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: return query.get_compiler(using=using).execute_sql(return_id)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1376, in execute_sql
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: for sql, params in self.as_sql():
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django_readonly_field/compiler.py", line 31, in as_sql
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: return super(ReadonlySQLCompilerMixin, self).as_sql()
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1320, in as_sql
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: for obj in self.query.objs
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1320, in <listcomp>
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: for obj in self.query.objs
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1319, in <listcomp>
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: [self.prepare_value(field, self.pre_save_val(field, obj)) for field in fields]
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/sql/compiler.py", line 1260, in prepare_value
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: value = field.get_db_prep_save(value, connection=self.connection)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/fields/__init__.py", line 793, in get_db_prep_save
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: return self.get_db_prep_value(value, connection=connection, prepared=False)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/fields/__init__.py", line 788, in get_db_prep_value
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: value = self.get_prep_value(value)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/fields/__init__.py", line 1024, in get_prep_value
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: return self.to_python(value)
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/django/db/models/fields/__init__.py", line 1017, in to_python
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: params={'value': value},
Feb 11 18:54:31 pulp2-nightly-pulp3-source-centos7.rhgoose.example.com rq[2338]: django.core.exceptions.ValidationError: ["'true' value must be either True or False."]

We are not using the main parser in pulp_rpm because we need to do a lot of data rejuggling ourselves. Main parser in productmd turned out to work fine, it's the one we use is not supposed to convert filed to their correct types.

A solution would be to handle this configuration parameter separately.