###1、需求
1、intellij idea打开多个项目
2、每个同学开发一个项目，相互之前独立不影响
3、通过一个入口可以调用所有项目类、方法、属性，达到同时开发且检测代码
4、dependency只需要写一份，其余项目不用写，便可全部依赖
###2、注意事项（非常重要）
6个坑：
1、<groupid>com.yh.bi</groupid>
项目中所有的groupid要一样
2、避免循环依赖，导致程序报错
3、<scope>provided</scope>
打包的服务器运行时候需要provided，本机调试的时候，需要注释
在一个maven项目中，如果存在编译需要而发布不需要的jar包，可以用scope标签，值设为provided
4、项目、module建好之后需要添加scala的框架支持
5、在yhproject中，可以统一对所有的module进行清理、编译、打包
6、要运行依赖中的module，则必须要将module中的jar包，打到maven中，需要使用install
下面，是我将所有module中的jar打到maven中的路径：
###3、建立project和建立module
1、只需要建立一个项目，其他项目由module建立，所有module且放在项目中。
2、本文项目为yhproject，其余都为module，分别是：mainentrance、yhutils、yhapp、yhweb、yhgame
项目建立步鄹：
module建立步鄹：
项目、所有module、部分module代码展示：
###4、项目之前的依赖关系
###5、代码展示
mainentrance
package com.yh.bi.dag
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
|
package com.yh.bi.dag/** * created by yuhui on 2017/2/10. */import java.time.{duration, localdate}import com.yh.bi._import com.yh.bi.{userapp, usergame, userweb}import org.slf4j.loggerfactoryimport scala.collection.immutable.{listmap, listset}/** * created by yuhui on 2016/8/25. * task --> node --> dag --> dagexecutor */case class node[t](task: t, parent: t*) { override def tostring: string = { s"$task(${parent.mkstring(",")})" }}case class dag[t](nodes: node[t]*)case class dagexecutor[t](dag: dag[t]) { private val log = loggerfactory.getlogger(this.getclass) private val _nodes: map[t, seq[t]] = dag.nodes.map(node => (node.task, node.parent.filter(_ != null))).tomap private var _pending: set[t] = listset() private var _fails = listmap[t, string]() private var _success = seq[t]() //判断node的task节点的父节点运行状态（flase ，true） private def getpending: option[t] = { _pending.find { name => val parents = _nodes(name) !parents.exists(name => !_success.contains(name)) } } private def fail(name: t, message: string): unit = { _pending -= name _fails += name -> message for (child <- _pending.filter(child => _nodes(child).contains(name))) { fail(child, s"依赖的任务无法执行: $name") } } private def success(name: t): unit = { _pending -= name _success = _success :+ name } def execute(func: t => unit): unit = { _pending = _nodes.keyset _fails = listmap() _success = seq() var running = true while (running) { val taskopt = getpending if (taskopt.nonempty) { val task = taskopt.get val startmills = system.currenttimemillis() log.info("start task {}", task) try { println("=============") func(task) //执行executor方法 println("+++++++++++++") val time = duration.ofmillis(system.currenttimemillis() - startmills) log.info(s"end task $task time=$time") success(task) } catch { case e: throwable => fail(task, e.getmessage) log.error(e.getmessage, e) log.info(s"fail task $task") } } else { running = false } } for (name <- _success) { log.info(s"success task: $name") } for (name <- _fails) { log.info(s"fail task: ${name._1} - ${name._2}") } }}object dag { val allsdkdag = new dag[task]( node(userapp), node(usergame), node(userweb) ) def main(args: array[string]): unit = { dagexecutor(allsdkdag).execute { task =>task.executor("appkey": string, localdate.now(), localdate.now())} }} |
yhutils
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
|
package com.yh.bi/** * created by yuhui on 2017/2/10. */import java.time.localdateimport org.apache.spark.sql.sqlcontextimport org.slf4j.loggerfactoryabstract class executor extends task with sqlcontextaware { override def run(appkey: string, startday: localdate, endday: localdate)={}}trait sqlcontextaware { implicit var ctx: sqlcontext = _}abstract class task { protected val log = loggerfactory.getlogger(this.getclass) def executor(appkey: string, startday: localdate, endday: localdate): unit def run(appkey: string, startday: localdate, endday: localdate): unit = { executor(appkey, startday, endday) }} |
yhapp
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
|
package com.yh.bi/** * created by yuhui on 2017/2/10. */import java.time.localdateobject userapp extends executor{ override def executor(appkey: string, startday: localdate, endday: localdate): unit = { println("++++我的userapp的执行过程++++") }} |
yhweb
|
1
2
3
4
5
6
7
8
9
10
11
12
13
|
package com.yh.biimport java.time.localdateobject userweb extends executor{ override def executor(appkey: string, startday: localdate, endday: localdate): unit = { println("++++我的userweb的执行过程++++") }} |
yhgame
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
|
package com.yh.bi/** * created by yuhui on 2017/2/10. */import java.time.localdateobject usergame extends executor{ override def executor(appkey: string, startday: localdate, endday: localdate): unit = { println("++++我的usergame的执行过程++++") }} |
###6、项目中pom依赖展示
yhproject中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelversion>4.0.0</modelversion> <groupid>com.yh.bi</groupid> <artifactid>yhproject</artifactid> <packaging>pom</packaging> <version>1.0</version> <modules> <module>mainentrance</module> <module>yhapp</module> <module>yhweb</module> <module>yhgame</module> <module>yhutils</module> </modules></project> |
mainentrance中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelversion>4.0.0</modelversion> <artifactid>mainentrance</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <dependencies> <dependency> <artifactid>yhutils</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <!--<scope>provided</scope> //本机调试则注释， 集群运行则解开--> </dependency> <dependency> <artifactid>yhapp</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <!--<scope>provided</scope>--> </dependency> <dependency> <artifactid>yhgame</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <!--<scope>provided</scope>--> </dependency> <dependency> <artifactid>yhweb</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <!--<scope>provided</scope>--> </dependency> </dependencies> <build> <plugins> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-compiler-plugin</artifactid> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-shade-plugin</artifactid> <version>2.4</version> <configuration> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/log4j2.*</exclude> <exclude>meta-inf/*.sf</exclude> <exclude>meta-inf/*.dsa</exclude> <exclude>meta-inf/*.rsa</exclude> </excludes> </filter> </filters> <!-- put your configurations here --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <outputfile>${project.build.directory}/${project.artifactid}.jar </outputfile> </configuration> </execution> </executions> </plugin> </plugins> <sourcedirectory>src/main/scala</sourcedirectory> <resources> <resource> <directory>${basedir}/src/main/resources</directory> <includes> <include>**/*</include> </includes> </resource> </resources> </build></project> |
yhutils中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <parent> <artifactid>yhproject</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> </parent> <modelversion>4.0.0</modelversion> <artifactid>yhutils</artifactid> <dependencies> <dependency> <groupid>org.apache.spark</groupid> <artifactid>spark-hive_2.11</artifactid> <version>1.6.1</version> </dependency> </dependencies> <build> <plugins> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-compiler-plugin</artifactid> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-shade-plugin</artifactid> <version>2.4</version> <configuration> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/log4j2.*</exclude> <exclude>meta-inf/*.sf</exclude> <exclude>meta-inf/*.dsa</exclude> <exclude>meta-inf/*.rsa</exclude> </excludes> </filter> </filters> <!-- put your configurations here --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <outputfile>${project.build.directory}/${project.artifactid}.jar </outputfile> </configuration> </execution> </executions> </plugin> </plugins> <sourcedirectory>src/main/scala</sourcedirectory> <resources> <resource> <directory>${basedir}/src/main/resources</directory> <includes> <include>**/*</include> </includes> </resource> </resources> </build></project> |
yhapp中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelversion>4.0.0</modelversion> <groupid>com.yh.bi</groupid> <artifactid>yhapp</artifactid> <version>1.0</version> <dependencies> <dependency> <artifactid>yhutils</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <scope>provided</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-compiler-plugin</artifactid> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-shade-plugin</artifactid> <version>2.4</version> <configuration> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/log4j2.*</exclude> <exclude>meta-inf/*.sf</exclude> <exclude>meta-inf/*.dsa</exclude> <exclude>meta-inf/*.rsa</exclude> </excludes> </filter> </filters> <!-- put your configurations here --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <outputfile>${project.build.directory}/${project.artifactid}.jar </outputfile> </configuration> </execution> </executions> </plugin> </plugins> <sourcedirectory>src/main/scala</sourcedirectory> <resources> <resource> <directory>${basedir}/src/main/resources</directory> <includes> <include>**/*</include> </includes> </resource> </resources> </build></project> |
yhweb中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelversion>4.0.0</modelversion> <groupid>com.yh.bi</groupid> <artifactid>yhweb</artifactid> <version>1.0</version> <dependencies> <dependency> <artifactid>yhutils</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <scope>provided</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-compiler-plugin</artifactid> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-shade-plugin</artifactid> <version>2.4</version> <configuration> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/log4j2.*</exclude> <exclude>meta-inf/*.sf</exclude> <exclude>meta-inf/*.dsa</exclude> <exclude>meta-inf/*.rsa</exclude> </excludes> </filter> </filters> <!-- put your configurations here --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <outputfile>${project.build.directory}/${project.artifactid}.jar </outputfile> </configuration> </execution> </executions> </plugin> </plugins> <sourcedirectory>src/main/scala</sourcedirectory> <resources> <resource> <directory>${basedir}/src/main/resources</directory> <includes> <include>**/*</include> </includes> </resource> </resources> </build></project> |
yhgame中pom文件展示：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
|
<?xml version="1.0" encoding="utf-8"?><project xmlns="http://maven.apache.org/pom/4.0.0" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="http://maven.apache.org/pom/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelversion>4.0.0</modelversion> <groupid>com.yh.bi</groupid> <artifactid>yhgame</artifactid> <version>1.0</version> <dependencies> <dependency> <artifactid>yhutils</artifactid> <groupid>com.yh.bi</groupid> <version>1.0</version> <scope>provided</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-compiler-plugin</artifactid> <configuration> <source>1.8</source> <target>1.8</target> </configuration> </plugin> <plugin> <groupid>org.apache.maven.plugins</groupid> <artifactid>maven-shade-plugin</artifactid> <version>2.4</version> <configuration> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/log4j2.*</exclude> <exclude>meta-inf/*.sf</exclude> <exclude>meta-inf/*.dsa</exclude> <exclude>meta-inf/*.rsa</exclude> </excludes> </filter> </filters> <!-- put your configurations here --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> <configuration> <outputfile>${project.build.directory}/${project.artifactid}.jar </outputfile> </configuration> </execution> </executions> </plugin> </plugins> <sourcedirectory>src/main/scala</sourcedirectory> <resources> <resource> <directory>${basedir}/src/main/resources</directory> <includes> <include>**/*</include> </includes> </resource> </resources> </build></project> |
###7、运行结果展示
注意：我在mainentrance执行dag中的main文件，可以调用且执行了yhutils、yhapp、yhweb、yhgame中的代码
###8、如果建立java 的module
以上就是本文的全部内容，希望对大家的学习有所帮助，也希望大家多多支持服务器之家。
原文链接：https://blog.csdn.net/silentwolfyh/article/details/54970108?utm_source=blogxgwz2
