Jenkins:批量自动将 Maven 类型 Job 迁移到自由风格类型

为什么要迁移?

近期进行 Jenkins 从1.X到2.X的升级演练
Jenkins2 最新版本只能在 JDK8 或 JDK11 版本下运行,我所使用的 JDK 版本为 JDK8
在构建 Maven Job,Job 配置的 JDK 版本为 JDK7时,构建报错

1$ /usr/local/java/bin/java -cp /data/jenkins/maven31-agent.jar:/usr/local/maven/boot/plexus-classworlds-2.5.2.jar:/usr/local/maven/conf/logging jenkins.maven3.agent.Maven31Main /usr/local/maven /data/jenkins/slave.jar /data/jenkins/maven31-interceptor.jar /data/jenkins/maven3-interceptor-commons.jar 45631 2Exception in thread "main" java.lang.UnsupportedClassVersionError: hudson/remoting/Launcher : Unsupported major.minor version 52.0 3 at java.lang.ClassLoader.defineClass1(Native Method) 4 at java.lang.ClassLoader.defineClass(ClassLoader.java:800) 5 at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) 6 at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) 7 at java.net.URLClassLoader.access$100(URLClassLoader.java:71) 8 at java.net.URLClassLoader$1.run(URLClassLoader.java:361) 9 at java.net.URLClassLoader$1.run(URLClassLoader.java:355) 10 at java.security.AccessController.doPrivileged(Native Method) 11 at java.net.URLClassLoader.findClass(URLClassLoader.java:354) 12 at org.codehaus.plexus.classworlds.realm.ClassRealm.loadClassFromSelf(ClassRealm.java:401) 13 at org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy.loadClass(SelfFirstStrategy.java:42) 14 at org.codehaus.plexus.classworlds.realm.ClassRealm.unsynchronizedLoadClass(ClassRealm.java:271) 15 at org.codehaus.plexus.classworlds.realm.ClassRealm.loadClass(ClassRealm.java:247) 16 at org.codehaus.plexus.classworlds.realm.ClassRealm.loadClass(ClassRealm.java:239) 17 at jenkins.maven3.agent.Maven31Main.main(Maven31Main.java:138) 18 at jenkins.maven3.agent.Maven31Main.main(Maven31Main.java:67)

经定位,原来 Maven 类型 Job 与 JDK 版本有一定兼容性,部分说明如下:

Maven jobs and Java versions compatibility : Because java serialized classes are exchanged between Jenkins master and Maven Jobs it is required that the JVM used to launch Maven is superior or equal to the version of Java for which Jenkins Master is built for.

  • Jenkins >= 1.520 requires Java 6 thus Maven jobs must be launched with Java >= 6.

  • Jenkins >= 1.612 requires Java 7 thus Maven jobs must be launched with Java >= 7.

  • Jenkins >= 2.54 requires Java 8 thus Maven jobs must be launched with Java >= 8.

详见:https://wiki.jenkins.io/display/JENKINS/Maven+Project+Plugin

而我们的这些 Job 必须使用指定 JDK 版本构建,不能随意修改 JDK 版本
而自由风格类型的 Job,不会出现这个问题
所以,计划将 Maven 类型 Job 迁移到自由风格类型

如何迁移?

那么如何迁移呢?
统计了下 Maven 类型的 Job,有数百个,手动迁移不现实的
通过 google 发现有前人写的 grovvy 脚本:https://github.com/akomakom/jenkins-scripts/blob/master/maven-to-freestyle.groovy
尝试运行该脚本,可能与环境有关,它会报错
由于对 groovy 不太熟悉,解决起来比较麻烦
所以参考它的逻辑,使用 python 脚本实现了迁移的功能

python 脚本如下所示,有需要的可以自行修改:

1# -*- coding:utf-8 -*- 2import xml.etree.ElementTree as ET 3 4import sys 5from jenkinsapi.jenkins import Jenkins 6 7reload(sys) 8sys.setdefaultencoding('utf8') 9 10 11def get_jenkins_server(): 12 JENKINS_URL = "http://127.0.0.1:8080/" 13 JENKINS_USERNAME = "jenkins" 14 JENKINS_PASSWORD = "jenkins" 15 return Jenkins(JENKINS_URL, username=JENKINS_USERNAME, password=JENKINS_PASSWORD, timeout=30) 16 17 18def get_modified_xml(job_config_xml_tree): 19 # create builders node 20 builders_element = ET.Element("builders") 21 job_config_xml_tree.append(builders_element) 22 23 # Move prebuilders to builders 24 prebuilders_node = job_config_xml_tree.find("prebuilders") 25 if prebuilders_node is not None and prebuilders_node.getchildren() is not None: 26 for pre_builder in prebuilders_node.getchildren(): 27 builders_element.append(pre_builder) 28 job_config_xml_tree.remove(prebuilders_node) 29 30 # Create a maven block 31 maven_node = ET.Element("hudson.tasks.Maven") 32 builders_element.append(maven_node) 33 move(job_config_xml_tree.find("goals"), job_config_xml_tree, maven_node, "targets") 34 maven_name_node = job_config_xml_tree.find("mavenName") 35 if maven_name_node: 36 move(maven_name_node, job_config_xml_tree, maven_node) 37 else: 38 maven_name_node = ET.Element("mavenName") 39 maven_name_node.text = "Maven" 40 maven_node.append(maven_name_node) 41 move(job_config_xml_tree.find("rootPOM"), job_config_xml_tree, maven_node) 42 move(job_config_xml_tree.find("mavenOpts"), job_config_xml_tree, maven_node) 43 move(job_config_xml_tree.find("settings"), job_config_xml_tree, maven_node) 44 move(job_config_xml_tree.find("globalSettings"), job_config_xml_tree, maven_node) 45 46 # items that don't exist in maven step: 47 remove(job_config_xml_tree, [ 48 'resolveDependencies', 49 'processPlugins', 50 'siteArchivingDisabled', 51 'archivingDisabled', 52 'mavenValidationLevel', 53 'disableTriggerDownstreamProjects', 54 'blockTriggerWhenBuilding', 55 'fingerprintingDisabled', 56 'incrementalBuild', 57 'processPlugins', 58 'siteArchivingDisabled', 59 'ignoreUpstremChanges', 60 'rootModule' 61 ]) 62 63 # Move postbuilders to builders 64 postbuilders_node = job_config_xml_tree.find("postbuilders") 65 if postbuilders_node is not None and postbuilders_node.getchildren() is not None: 66 for post_builder in postbuilders_node.getchildren(): 67 builders_element.append(post_builder) 68 job_config_xml_tree.remove(postbuilders_node) 69 70 # rename top-level element 71 # new parent node 72 new_job_config_xml_tree = ET.Element("project") 73 for child_node in job_config_xml_tree.getchildren(): 74 new_job_config_xml_tree.append(child_node) 75 76 return new_job_config_xml_tree 77 78 79def move(from_node, from_parent_node, to_node, to_name=None): 80 if from_node is not None: 81 if to_name: 82 tmp_element_node = ET.Element(to_name) 83 tmp_element_node.text = from_node.text 84 tmp_element_node.attrib = from_node.attrib 85 to_node.append(tmp_element_node) 86 from_parent_node.remove(from_node) 87 else: 88 to_node.append(from_node) 89 from_parent_node.remove(from_node) 90 91 92def remove(from_node, name_list): 93 for name in name_list: 94 tmp_node = from_node.find(name) 95 if tmp_node is not None: 96 from_node.remove(tmp_node) 97 98 99def main(): 100 jenkins_server = get_jenkins_server() 101 102 job_list = jenkins_server.get_jobs_list() 103 for job_name in job_list: 104 if not job_name.endswith("-DEPRECATED"): 105 job_obj = jenkins_server.get_job(job_name) 106 config_text = job_obj.get_config() 107 config_xml_tree = ET.fromstring(config_text) 108 if config_xml_tree.tag == "maven2-moduleset": 109 new_config_xml_tree = get_modified_xml(config_xml_tree) 110 new_config_xml = ET.tostring(new_config_xml_tree) 111 jenkins_server.rename_job(job_name, job_name + "-DEPRECATED") 112 jenkins_server.create_job(job_name, new_config_xml) 113 print("migrate job from Maven Type to FreeStyle Type: " + job_name) 114 115 116if __name__ == "__main__": 117 main()

参考

https://github.com/akomakom/jenkins-scripts/blob/master/maven-to-freestyle.groovy

点赞
收藏

评论区

加载中...

相关推荐

MySQL:[Err] 1292 - Incorrect datetime value: ‘0000-00-00 00:00:00‘ for column ‘CREATE_TIME‘ at row 1

文章目录问题用navicat导入数据时,报错:原因这是因为当前的MySQL不支持datetime为0的情况。解决修改sql\mode:sql\mode:SQLMode定义了MySQL应支持的SQL语法、数据校验等,这样可以更容易地在不同的环境中使用MySQL。全局s

Oracle 分组与拼接字符串同时使用

SELECTT.,ROWNUMIDFROM(SELECTT.EMPLID,T.NAME,T.BU,T.REALDEPART,T.FORMATDATE,SUM(T.S0)S0,MAX(UPDATETIME)CREATETIME,LISTAGG(TOCHAR(

MySQL部分从库上面因为大量的临时表tmp_table造成慢查询

背景描述Time:20190124T00:08:14.70572408:00User@Host:@Id:Schema:sentrymetaLast_errno:0Killed:0Query_time:0.315758Lock_

皕杰报表之UUID

​在我们用皕杰报表工具设计填报报表时,如何在新增行里自动增加id呢?能新增整数排序id吗?目前可以在新增行里自动增加id,但只能用uuid函数增加UUID编码,不能新增整数排序id。uuid函数说明:获取一个UUID,可以在填报表中用来创建数据ID语法:uuid()或uuid(sep)参数说明:sep布尔值,生成的uuid中是否包含分隔符'',缺省为

手写Java HashMap源码

HashMap的使用教程HashMap的使用教程HashMap的使用教程HashMap的使用教程HashMap的使用教程22

2020年前端实用代码段,为你的工作保驾护航

有空的时候,自己总结了几个代码段,在开发中也经常使用,谢谢。1、使用解构获取json数据let jsonData  id: 1,status: "OK",data: 'a', 'b';let  id, status, data: number   jsonData;console.log(id, status, number )