Project

Profile

Help

Actions
Send by e-mail Copy link

Issue #1137

closed

fix dev-setup.sh script

Added by igulina@redhat.com over 9 years ago. Updated over 5 years ago.

Status:
CLOSED - CURRENTRELEASE
Priority:
Normal
Assignee:
rbarlow
Category:
-
Sprint/Milestone:
-
Start date:
Due date:
Estimated time:
Severity:
1. Low
Version:
Master
Platform Release:
2.8.0
OS:
Triaged:
Yes
Groomed:
No
Sprint Candidate:
No
Tags:
Pulp 2
Sprint:
Quarter:

Description

When we had talked about removing dev-setup.sh I had forgotten that Vagrant will only work for developers who are working on physical hosts with virtualization extensions. Since some developers may use Openstack or EC2 for development, there may[0] still be a place for a dev-setup.sh script.

It's been reported by igulina that our dev-setup.sh script fails in some way (I am not sure what the issue is). We should fix the dev-setup.sh script so that it works again.

It would be wise to also refactor it so that it uses the same Ansible code that is used by Vagrant so we can benefit from some code sharing. The dev-setup.sh script does do a little more than the Vagrant setup so it will still need to be a separate thing, but if we can get it down to just checking out the code and calling Ansible that would be a win, and would decrease the chance of future breakage.

[0] I say "may", because technically I think Vagrant can also provision EC2 and Openstack environments, though our current implementation of the Vagrantfile does not support this.

Actions
Copy link
 #1

Updated by rbarlow over 9 years ago

  • Subject changed from remove dev-setup.sh script and relevant docs to fix dev-setup.sh script
Actions
Copy link
 #2

Updated by rbarlow over 9 years ago

  • Description updated (diff)
Actions
Copy link
 #3

Updated by igulina@redhat.com over 9 years ago

So far testing docs [1] on RHEL7 I faced several issues:

1) Add to the docs [1] that Extras should be enabled on RHEL7, otherwise a command

curl -O https://raw.githubusercontent.com/pulp/pulp/master/playpen/dev-setup.sh && bash -e dev-setup.sh

fails with

--> Finished Dependency Resolution
Error: Package: python-mongoengine-0.8.4-3.el7.noarch (epel)
           Requires: python-blinker
 You could try using --skip-broken to work around the problem
 You could try running: rpm -Va --nofiles --nodigest

[1] https://github.com/pulp/pulp/blob/master/docs/dev-guide/contributing/dev_setup.rst#provisioning-script

This issue was also mentioned here #1024

2)
After enabling EXTRAS:

Loaded plugin docker_distributor_export for types: docker_image
Loaded plugin openstack_distributor_web for types: openstack_image
Applying migration pulp_rpm.plugins.migrations.0016_new_yum_distributor failed.

Halting migrations due to a migration failure.
No module named keystoneclient.v2_0.client
Traceback (most recent call last):
  File "/home/ec2-user/devel/pulp/server/pulp/server/db/manage.py", line 144, in main
    return _auto_manage_db(options)
  File "/home/ec2-user/devel/pulp/server/pulp/server/db/manage.py", line 205, in _auto_manage_db
    migrate_database(options)
  File "/home/ec2-user/devel/pulp/server/pulp/server/db/manage.py", line 94, in migrate_database
    update_current_version=not options.test)
  File "/home/ec2-user/devel/pulp/server/pulp/server/db/migrate/models.py", line 157, in apply_migration
    migration.migrate()
  File "/home/ec2-user/devel/pulp_rpm/plugins/pulp_rpm/plugins/migrations/0016_new_yum_distributor.py", line 42, in migrate
    api.initialize()
  File "/home/ec2-user/devel/pulp/server/pulp/plugins/loader/api.py", line 55, in initialize
    loading.load_plugins_from_entry_point(*entry_point)
  File "/home/ec2-user/devel/pulp/server/pulp/plugins/loader/loading.py", line 60, in load_plugins_from_entry_point
    cls, cfg = entry_point.load()()
  File "/usr/lib/python2.7/site-packages/pkg_resources.py", line 2260, in load
    entry = __import__(self.module_name, globals(),globals(), ['__name__'])
  File "/home/ec2-user/devel/pulp_openstack/plugins/pulp_openstack/plugins/distributors/distributor_glance.py", line 10, in <module>
    from pulp_openstack.plugins.distributors.glance_publish_steps import GlancePublisher
  File "/home/ec2-user/devel/pulp_openstack/plugins/pulp_openstack/plugins/distributors/glance_publish_steps.py", line 8, in <module>
    from pulp_openstack.common import openstack_utils
  File "/home/ec2-user/devel/pulp_openstack/common/pulp_openstack/common/openstack_utils.py", line 3, in <module>
    import keystoneclient.v2_0.client as ksclient
ImportError: No module named keystoneclient.v2_0.client

3)
If in /etc/yum.repos.d/rhel-pulp.repo I have

Version 2.x Production Releases
[pulp-2-stable]
name=Pulp 2 Production Releases
baseurl=https://repos.fedorapeople.org/repos/pulp/pulp/stable/2/$releasever/$basearch/
enabled=1
skip_if_unavailable=1
gpgcheck=1
gpgkey=https://repos.fedorapeople.org/repos/pulp/pulp/GPG-RPM-KEY-pulp-2

Then I have an error:

>> sudo yum install @pulp-server-qpid @pulp-admin @pulp-consumer

--> Finished Dependency Resolution
Error: Package: python-pulp-bindings-2.6.2-1.el7.noarch (pulp-2-stable)
           Requires: python-oauth2 >= 1.5.170-2.pulp
Error: Package: python-webpy-0.37-3.el7.noarch (pulp-2-stable)
           Requires: python-cherrypy
Error: Package: python-mongoengine-0.7.10-2.el7.noarch (pulp-2-stable)
           Requires: python-pymongo-gridfs
Error: Package: python-pulp-client-lib-2.6.2-1.el7.noarch (pulp-2-stable)
           Requires: python-okaara >= 1.0.32
Error: Package: pulp-rpm-plugins-2.6.2-1.el7.noarch (pulp-2-stable)
           Requires: createrepo_c >= 0.4.1-1
Error: Package: python-celery-3.1.11-1.el7.noarch (pulp-2-stable)
           Requires: python-anyjson
Error: Package: pulp-server-2.6.2-1.el7.noarch (pulp-2-stable)
           Requires: python-httplib2
Error: Package: 1:python-kombu-3.0.24-7.pulp.el7.noarch (pulp-2-stable)
           Requires: python-anyjson >= 0.3.3
Error: Package: python-mongoengine-0.7.10-2.el7.noarch (pulp-2-stable)
           Requires: python-pymongo >= 2.1.1
Error: Package: pulp-server-2.6.2-1.el7.noarch (pulp-2-stable)
           Requires: python-oauth2 >= 1.5.211
Error: Package: pulp-server-2.6.2-1.el7.noarch (pulp-2-stable)
           Requires: python-pymongo >= 2.5.2
 You could try using --skip-broken to work around the problem
 You could try running: rpm -Va --nofiles --nodigest

4) If instead I have 2.6-testing enabled, there is an error:

>> sudo yum install @pulp-server-qpid @pulp-admin @pulp-consumer

--> Finished Dependency Resolution
Error: Package: python-mongoengine-0.7.10-2.el7.noarch (pulp-2.6-beta)
           Requires: python-pymongo-gridfs
Error: Package: python-mongoengine-0.7.10-2.el7.noarch (pulp-2.6-beta)
           Requires: python-pymongo >= 2.1.1
Error: Package: pulp-server-2.6.3-0.2.beta.el7.noarch (pulp-2.6-beta)
           Requires: python-httplib2
Error: Package: python-webpy-0.37-3.el7.noarch (pulp-2.6-beta)
           Requires: python-cherrypy
Error: Package: python-celery-3.1.11-1.el7.noarch (pulp-2.6-beta)
           Requires: python-anyjson
Error: Package: 1:python-kombu-3.0.24-8.pulp.el7.noarch (pulp-2.6-beta)
           Requires: python-anyjson >= 0.3.3
Error: Package: python-pulp-client-lib-2.6.3-0.2.beta.el7.noarch (pulp-2.6-beta)
           Requires: python-okaara >= 1.0.32
Error: Package: pulp-server-2.6.3-0.2.beta.el7.noarch (pulp-2.6-beta)
           Requires: python-oauth2 >= 1.5.211
Error: Package: pulp-rpm-plugins-2.6.3-0.2.beta.el7.noarch (pulp-2.6-beta)
           Requires: createrepo_c >= 0.4.1-1
Error: Package: pulp-server-2.6.3-0.2.beta.el7.noarch (pulp-2.6-beta)
           Requires: python-pymongo >= 2.5.2
Error: Package: python-pulp-bindings-2.6.3-0.2.beta.el7.noarch (pulp-2.6-beta)
           Requires: python-oauth2 >= 1.5.170-2.pulp
 You could try using --skip-broken to work around the problem
 You could try running: rpm -Va --nofiles --nodigest

5) If I enable 2.7, it's the same:

--> Finished Dependency Resolution
Error: Package: pulp-server-2.7.0-0.4.beta.el7.noarch (pulp-2.7-beta)
           Requires: python-oauth2 >= 1.5.211
Error: Package: python-pulp-client-lib-2.7.0-0.4.beta.el7.noarch (pulp-2.7-beta)
           Requires: python-okaara >= 1.0.32
Error: Package: pulp-rpm-plugins-2.7.0-0.4.beta.el7.noarch (pulp-2.7-beta)
           Requires: createrepo_c >= 0.4.1-1
Error: Package: 1:python-kombu-3.0.24-8.pulp.el7.noarch (pulp-2.7-beta)
           Requires: python-anyjson >= 0.3.3
Error: Package: pulp-server-2.7.0-0.4.beta.el7.noarch (pulp-2.7-beta)
           Requires: python-httplib2
Error: Package: python-celery-3.1.11-1.el7.noarch (pulp-2.7-beta)
           Requires: python-anyjson
Error: Package: pulp-server-2.7.0-0.4.beta.el7.noarch (pulp-2.7-beta)
           Requires: python-django >= 1.4.0
Error: Package: python-pulp-bindings-2.7.0-0.4.beta.el7.noarch (pulp-2.7-beta)
           Requires: python-oauth2 >= 1.5.170-2.pulp
 You could try using --skip-broken to work around the problem
 You could try running: rpm -Va --nofiles --nodigest

I used https://repos.fedorapeople.org/repos/pulp/pulp/rhel-pulp.repo.
Extras and Optional were enabled.

Actions
Copy link
 #4

Updated by igulina@redhat.com over 9 years ago

The were no issues 3, 4, 5 on F20.

Actions
Copy link
 #5

Updated by mhrivnak over 9 years ago

  • Severity changed from 2. Medium to 1. Low
  • Triaged changed from No to Yes
Actions
Copy link
 #6

Updated by rbarlow over 9 years ago

  • Status changed from NEW to ASSIGNED
  • Assignee set to rbarlow
  • Version set to Master

Added by rbarlow over 9 years ago

Revision 9c88c731 | View on GitHub

Rework the dev-setup.sh script to use Ansible.

This commit reworks the dev-setup.sh script to use the same code that Vagrant uses to provision the dev box.

https://pulp.plan.io/issues/1137

fixes #1137

Added by rbarlow over 9 years ago

Revision 9c88c731 | View on GitHub

Rework the dev-setup.sh script to use Ansible.

This commit reworks the dev-setup.sh script to use the same code that Vagrant uses to provision the dev box.

https://pulp.plan.io/issues/1137

fixes #1137

Actions
Copy link
 #7

Updated by rbarlow over 9 years ago

  • Status changed from ASSIGNED to MODIFIED
  • % Done changed from 0 to 100
Actions
Copy link
 #8

Updated by rbarlow about 9 years ago

  • Platform Release set to master
Actions
Copy link
 #9

Updated by rbarlow about 9 years ago

  • Platform Release changed from master to 2.8.0
Actions
Copy link
 #10

Updated by dkliban@redhat.com over 8 years ago

  • Status changed from MODIFIED to 5
Actions
Copy link
 #11

Updated by rbarlow over 8 years ago

  • Status changed from 5 to 6

I can testify that this script works.

Actions
Copy link
 #13

Updated by dkliban@redhat.com over 8 years ago

  • Status changed from 6 to CLOSED - CURRENTRELEASE
Actions
Copy link
 #15

Updated by bmbouter over 5 years ago

  • Tags Pulp 2 added
Actions
Send by e-mail Copy link

Also available in: Atom PDF