platformlayer / openstack-jenkins

Jenkins support for Openstack

PlatformLayer: Everything-as-a-service

Introduction

PlatformLayer is open-source platform-as-a-service software. Instead of tying you in to one stack though, you can build your platform from whatever components you want (pick your own database, webserver, load balancer etc).

PlatformLayer builds machines on clouds running OpenStack.

Because there are so many choices of software you could make, PlatformLayer makes it super-easy to build a new service if one doesn't already exist. That's why we say PlatformLayer is everything-as-a-service.

Right now it's early days, so please do contribute if your favorite service isn't yet available. Have a look in the services directory at the services we're working on. To build a service, you create a java classes which define the 'model' which the service will expose; you create a 'controller' for each model which describes how to build the model; you also create a service class which ties it all together.

The intention is to have a lot of simple services which work together, rather than a complex design. Services build on each other to produce complex systems.

There's lots of code for lots of different services in the tree, much of which is still fairly experimental (it's early days).

These are good ones to try out first:

• memcache: Runs memcache, which is the simplest service (Cache-aaS)
• solr: Runs solr, allowing full-text indexing & search (Search-aaS)

Check the wiki for more information!

Installation

Please see the wiki

openstack-jenkins's Issues

Be able to terminate the host machine after a job

For OpenStack gating, "We need disposable machines that are only used for one test"

I'm thinking a checkbox on the job properties which will shutdown the slave machine after the run will do the trick here.

Maintain a pool of machines

For OpenStack gating "We need to pull nodes from a pool of machines that have been spun up ahead of time for speed."

This sounds like a custom NodeProvisioner implementation. The current implementation is optimized around minimizing CPU hours, by doing load prediction. OpenStack has a different criteria, based on minimizing launch latency. It looks like it should be relatively easy to implement a new algorithm, although perhaps a bit tricky to figure out how to plug it in.

Better image selection

Currently images must be selected by GUID. That is not very user friendly.

It also doesn't allow attribute selection. e.g. OpenStack gating rebuilds its images each day, so each day we want the latest image with certain attributes.

Container creation failed due to token expiration.

After two successful daily artifact publish to swift including container creation action, the third one got failure as below:

Aug 27, 2012 12:06:08 AM hudson.model.Run execute
INFO: StoragePoC #31 main build action completed: SUCCESS
Aug 27, 2012 12:06:08 AM hudson.model.AbstractBuild?$AbstractBuildExecution? performAllBuildSteps
WARNING: Publisher jenkins.plugins.openstack.storage.OpenstackBucketPublisher? aborted due to exception
org.openstack.client.OpenstackAuthenticationException?: Not authorized
at org.openstack.client.transport.ExceptionMapping?.mapResponse(ExceptionMapping?.java:56)
at org.openstack.client.transport.jersey1.Jersey1OpenstackSession$JerseyRequestBuilder?$1.handle(Jersey1OpenstackSession.java:79)
at com.sun.jersey.api.client.WebResource?$Builder.head(WebResource?.java:488)
at org.openstack.client.transport.jersey1.Jersey1OpenstackSession$JerseyRequestBuilder?.head(Jersey1OpenstackSession.java:107)
at org.openstack.client.storage.ContainerResource?.get(ContainerResource?.java:18)
at jenkins.plugins.openstack.storage.OpenstackStorage?.ensureBucket(OpenstackStorage?.java:22)
at jenkins.plugins.openstack.storage.OpenstackBucketPublisher?.perform(OpenstackBucketPublisher?.java:120)
at hudson.tasks.BuildStepMonitor?$2.perform(BuildStepMonitor?.java:27)
at hudson.model.AbstractBuild?$AbstractBuildExecution?.perform(AbstractBuild?.java:717)
at hudson.model.AbstractBuild?$AbstractBuildExecution?.performAllBuildSteps(AbstractBuild?.java:692)
at hudson.maven.MavenModuleSetBuild?$MavenModuleSetBuildExecution?.post2(MavenModuleSetBuild?.java:994)
at hudson.model.AbstractBuild?$AbstractBuildExecution?.post(AbstractBuild?.java:639)
at hudson.model.Run.execute(Run.java:1513)
at hudson.maven.MavenModuleSetBuild?.run(MavenModuleSetBuild?.java:477)
at hudson.model.ResourceController?.execute(ResourceController?.java:88)
at hudson.model.Executor.run(Executor.java:236)
Aug 27, 2012 12:06:08 AM

I guess the token did not get updated after the original token expired.
Work around: After saving the jenkins system configuration to trigger a configuration update, the container creation during artifact publish came back to normal.

Should the SSH private key be plaintext?

The SSH private key is currently mangled after it is generated. What are the use cases for using the private key? Should we continue to hide it (and make the field a password field) or should it just be plaintext and rely on jenkins security?

Not able to build, Please help. How to build

Hi,

I followed README.markdown. Added dotm2_settings.xml into settings. Below I have pasted my complete settings.xml.

Being in the openstack-jenkins-master, I use "mvn" or "mvn install" I am repeatedly getting error as below. Please help me, My proxy settings are correct in maven. I am sure.

[INFO] Copying 32 resources
Downloading: http://repo.jenkins-ci.org/public//org/platformlayer/openstack-api/0.1-SNAPSHOT/openstack-api-0.1-SNAPSHOT.pom
[INFO] Unable to find resource 'org.platformlayer:openstack-api:pom:0.1-SNAPSHOT' in repository repo.jenkins-ci.org (http://repo.jenkins-ci.org/public/)
Downloading: http://repo.jenkins-ci.org/public//org/platformlayer/openstack-api/0.1-SNAPSHOT/openstack-api-0.1-SNAPSHOT.jar
[INFO] Unable to find resource 'org.platformlayer:openstack-api:jar:0.1-SNAPSHOT' in repository repo.jenkins-ci.org (http://repo.jenkins-ci.org/public/)
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD ERROR
[INFO] ------------------------------------------------------------------------
[INFO] Failed to resolve artifact.

Missing:

1. org.platformlayer:openstack-api:jar:0.1-SNAPSHOT

Try downloading the file manually from the project website.

~/.m2/settings.xml

true http proxy1.xxxx.com 8080 domain\username password org.jenkins-ci.tools jenkins true repo.jenkins-ci.org http://repo.jenkins-ci.org/public/ repo.jenkins-ci.org http://repo.jenkins-ci.org/public/