Builds fail (endlessly queued) on any build triggered by Jira

[EddieW]

remote agents triggered by SCM or manually - PASS

We have been using remote agents to handle our builds, and have been consistently running without error.

Remote agents with jira release - FAIL

However once we try triggering the same plan from Jira (using release management) the build just says in Queued state endlessly, even ignoring the queue timeout setting reduced to 1 minute.

The logs on the remote server seem to dump a large XML file, then fail with a missing class exception related to the jira plugin.

Local agent with manual trigger - PASS

SO i though perhaps the remote agents were missing required binaries (even though from their perspective all they shouldnt care who triggered the build).

SO I added a single local agent, and ensured it had all capabilities. Triggered a manual build and that went fine.

Local agent with jira release - FAIL

SO then I triggered again from Jira, and the plan once again stayed in queued state, and never started.

2011-10-21 11:27:09,045 ERROR [4-BAM::MYDOMAIN (2)::Agent:pool-6-thread-1] [BuildAgentControllerImpl] Unknown exception occurred on 'MYDOMAIN (2)'. Agent will attempt to recover its normal operation...
com.thoughtworks.xstream.converters.ConversionException: com.atlassian.bamboo.plugins.jira.release.JIRAReleaseTriggerReason : com.atlassian.bamboo.plugins.jira.release.JIRAReleaseTriggerReason
---- Debugging information ----
message             : com.atlassian.bamboo.plugins.jira.release.JIRAReleaseTriggerReason
cause-exception     : com.thoughtworks.xstream.mapper.CannotResolveClassException
cause-message       : com.atlassian.bamboo.plugins.jira.release.JIRAReleaseTriggerReason
class               : com.atlassian.bamboo.v2.build.BuildContextImpl
required-type       : com.atlassian.bamboo.v2.build.BuildContextImpl
converter-type      : com.atlassian.bamboo.serialization.xstream.BuildContextXStreamConverter
path                : /com.atlassian.bamboo.v2.build.BuildContextImpl/parentBuildContext/triggerReason
line number         : 23
version             : null
-------------------------------
        at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:79)
        at com.thoughtworks.xstream.core.AbstractReferenceUnmarshaller.convert(AbstractReferenceUnmarshaller.java:65)
        at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
        at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshallField(AbstractReflectionConverter.java:351)
        at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:302)
        at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:230)
        at com.atlassian.bamboo.serialization.xstream.BuildContextXStreamConverter.unmarshal(BuildContextXStreamConverter.java:125)
        at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
        at com.thoughtworks.xstream.core.AbstractReferenceUnmarshaller.convert(AbstractReferenceUnmarshaller.java:65)
        at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:66)
        at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50)
        at com.thoughtworks.xstream.core.TreeUnmarshaller.start(TreeUnmarshaller.java:134)
        at com.thoughtworks.xstream.core.AbstractTreeMarshallingStrategy.unmarshal(AbstractTreeMarshallingStrategy.java:32)
        at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1035)
        at com.thoughtworks.xstream.XStream.unmarshal(XStream.java:1019)
        at com.thoughtworks.xstream.XStream.fromXML(XStream.java:895)
        at com.thoughtworks.xstream.XStream.fromXML(XStream.java:886)
        at com.atlassian.bamboo.v2.build.queue.XStreamMessageConverter.fromMessage(XStreamMessageConverter.java:73)
        at org.springframework.jms.core.JmsTemplate.doConvertFromMessage(JmsTemplate.java:763)
        at org.springframework.jms.core.JmsTemplate.receiveSelectedAndConvert(JmsTemplate.java:742)
        at com.atlassian.bamboo.v2.build.queue.AgentQueueAccessorImpl.takeBuildContext(AgentQueueAccessorImpl.java:31)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:304)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:182)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)
        at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:106)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at $Proxy0.takeBuildContext(Unknown Source)
        at com.atlassian.bamboo.v2.build.agent.BuildAgentControllerImpl.getBuildContextFromQueue(BuildAgentControllerImpl.java:180)
        at com.atlassian.bamboo.v2.build.agent.BuildAgentControllerImpl.waitAndPerformBuild(BuildAgentControllerImpl.java:73)
        at com.atlassian.bamboo.v2.build.agent.DefaultBuildAgent$1.run(DefaultBuildAgent.java:107)
        at com.atlassian.bamboo.build.pipeline.concurrent.NamedThreadFactory$2.run(NamedThreadFactory.java:50)
        at java.lang.Thread.run(Thread.java:662)
Caused by: com.thoughtworks.xstream.mapper.CannotResolveClassException: com.atlassian.bamboo.plugins.jira.release.JIRAReleaseTriggerReason
        at com.thoughtworks.xstream.mapper.DefaultMapper.realClass(DefaultMapper.java:56)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.DynamicProxyMapper.realClass(DynamicProxyMapper.java:55)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.PackageAliasingMapper.realClass(PackageAliasingMapper.java:88)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.ClassAliasingMapper.realClass(ClassAliasingMapper.java:79)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.ArrayMapper.realClass(ArrayMapper.java:74)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.CGLIBMapper.realClass(CGLIBMapper.java:55)
        at com.thoughtworks.xstream.mapper.MapperWrapper.realClass(MapperWrapper.java:30)
        at com.thoughtworks.xstream.mapper.CachingMapper.realClass(CachingMapper.java:45)
        at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.determineType(AbstractReflectionConverter.java:454)
        at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.doUnmarshal(AbstractReflectionConverter.java:290)
        at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:230)
        at com.atlassian.bamboo.serialization.xstream.BuildContextXStreamConverter.unmarshal(BuildContextXStreamConverter.java:125)
        at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72)
        ... 36 more
2011-10-21 11:27:09,365 FATAL [4-BAM::vxpip-elfbam02.lmig.com (2)::Agent:pool-6-thread-1] [DefaultBuildAgent] Maximum number of errors has been reached (10). Agent will now stop.

[Przemek Bruski · Accepted solution]

It's a bug.

1. In your installation find the atlassian-bamboo-core-3.3.X.jar file.
2. Open it and find the file com/atlassian/bamboo/agent/classserver/agent-bootstrap-blacklist.txt
3. Remove the line *bamboo-plugin-jira* and save the file.
4. Restart the Bamboo server.

[EddieW]

Builds are humming along now. Thanks for the quick fix Przemek

[ReneR]

This sounds like you should grab the server and agent logs and report to support at jira.atlassian.com. Also you should include info as to how you deploy your remote agents (jar only, using the provided installer, etc...)