[barquero] Complex Event Processing

[grammarware]

Submitted by @lolybc88 to https://github.com/modelsconf2018/artifact-evaluation/tree/master/barquero

Paper: http://www.lcc.uma.es/%7Eloli/downloads/MODELS18_2.pdf

[zolotas4]

Hi,

1. I was able to run in test/development mode the first example (motorbikeProject) but when I export the jar and try to run I receive the following exception:

Caused by: java.io.FileNotFoundException: class path resource [application-context.xml] cannot be opened because it does not exist at org.springframework.core.io.ClassPathResource.getInputStream(ClassPathResource.java:180) at org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:329)

Both the config.properties and the motorbike.csv files are in the same directory as the jar.

2. I was not able to run in test/development mode for 2 and 3 examples (I haven't tried the 4th). I set the Scala compiler version to 2.11 as suggested, I then try to follow the Maven dependencies build as suggested but although Run As ... -> Maven Clean executes successfully, I receive the following Build Failure message when I do Run As ... -> Maven Install

[INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for com.cor.motorbike:motorbike4Graphx:jar:0.0.1-SNAPSHOT [WARNING] 'build.plugins.plugin.version' for org.scala-tools:maven-scala-plugin is missing. @ line 63, column 12 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building graphframes 0.0.1-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] Downloading: http://scala-tools.org/repo-releases/org/scala-tools/maven-scala-plugin/maven-metadata.xml [WARNING] Could not transfer metadata org.scala-tools:maven-scala-plugin/maven-metadata.xml from/to scala-tools.org (http://scala-tools.org/repo-releases): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target [INFO] Downloading: http://scala-tools.org/repo-releases/commons-codec/commons-codec/maven-metadata.xml [WARNING] Could not transfer metadata commons-codec:commons-codec/maven-metadata.xml from/to scala-tools.org (http://scala-tools.org/repo-releases): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target [INFO] Downloading: http://scala-tools.org/repo-releases/commons-codec/commons-codec/2.0-SNAPSHOT/maven-metadata.xml [WARNING] Could not transfer metadata commons-codec:commons-codec:2.0-SNAPSHOT/maven-metadata.xml from/to scala-tools.org (http://scala-tools.org/repo-releases): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target [WARNING] Failure to transfer commons-codec:commons-codec:2.0-SNAPSHOT/maven-metadata.xml from http://scala-tools.org/repo-releases was cached in the local repository, resolution will not be reattempted until the update interval of scala-tools.org has elapsed or updates are forced. Original error: Could not transfer metadata commons-codec:commons-codec:2.0-SNAPSHOT/maven-metadata.xml from/to scala-tools.org (http://scala-tools.org/repo-releases): sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ motorbike4Graphx --- [WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent! [INFO] skip non existing resourceDirectory /Users/Thanos/Downloads/AEModels/graphCEP-master/motorbike4Graphx/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ motorbike4Graphx --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-scala-plugin:2.15.2:compile (default) @ motorbike4Graphx --- [INFO] Checking for multiple versions of scala [WARNING] Expected all dependencies to require Scala version: 2.11.12 [WARNING] com.cor.motorbike:motorbike4Graphx:0.0.1-SNAPSHOT requires scala version: 2.11.12 [WARNING] com.twitter:chill_2.11:0.8.4 requires scala version: 2.11.8 [WARNING] Multiple versions of scala libraries detected! [INFO] includes = [**/*.java,**/*.scala,] [INFO] excludes = [] [INFO] /Users/Thanos/Downloads/AEModels/graphCEP-master/motorbike4Graphx/src/main/java:-1: info: compiling [INFO] Compiling 14 source files to /Users/Thanos/Downloads/AEModels/graphCEP-master/motorbike4Graphx/target/classes at 1531817465829 [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] /Users/Thanos/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar: invalid LOC header (bad signature) [INFO] java.lang.reflect.InvocationTargetException [INFO] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [INFO] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [INFO] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [INFO] at java.lang.reflect.Method.invoke(Method.java:498) [INFO] at org_scala_tools_maven_executions.MainHelper.runMain(MainHelper.java:161) [INFO] at org_scala_tools_maven_executions.MainWithArgsInFile.main(MainWithArgsInFile.java:26) [ERROR] Caused by: java.lang.NoClassDefFoundError: scala/collection/mutable/IndexedSeq [INFO] at scala.util.PropertiesTrait$class.$init$(Properties.scala:31) [INFO] at scala.tools.nsc.Properties$.<init>(Properties.scala:12) [INFO] at scala.tools.nsc.Properties$.<clinit>(Properties.scala) [INFO] at scala.tools.nsc.Driver.<init>(Driver.scala:10) [INFO] at scala.tools.nsc.MainClass.<init>(Main.scala:13) [INFO] at scala.tools.nsc.Main$.<init>(Main.scala:27) [INFO] at scala.tools.nsc.Main$.<clinit>(Main.scala) [INFO] at scala.tools.nsc.Main.main(Main.scala) [INFO] ... 6 more [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 7.169 s [INFO] Finished at: 2018-07-17T09:51:06+01:00 [INFO] Final Memory: 26M/460M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.scala-tools:maven-scala-plugin:2.15.2:compile (default) on project motorbike4Graphx: wrap: org.apache.commons.exec.ExecuteException: Process exited with an error: 240(Exit value: 240) -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
Any idea?

[stsauer]

zolotas4, have you increased the heap size as indicated?

[zolotas4]

Yes, I did.

[lolybc88]

Hi,
The code was developed by Gala Barquero, I've asked her and this is her reply:

1. There is an error in the deployment paragraph of the first example. You should do:
   To export a jar file:
   Right Click on ‘motorbikeProject’ project and select Run As...->Maven Install.
   When Maven Install finishs the jar file will be created in /motorbikeProject/target/.
   Note that to run the jar file you have to copy ‘motorbike.csv’ and ‘config.properties’ (of ‘motorbikeProject’ project) files in the same folder as the jar.
   Sorry for the inconvenience.

2. That is not a real problem, this step is needed only to force to re-download all dependencies. You can continue with 'Update project' step. So, you can skip the error message.

---

If the problem persist, could you contact her directly by adding her as collaborator: @galabarquerom or by email at gala@lcc.uma.es?

Thanks

[zolotas4]

Hi @lolybc88

Thanks but the projects do not compile at all so I am not able to run them. I thought the reason for not compiling would be the fact the maven dependencies were not installed. In any case I sent an email to Gala with the errors I get and we will discuss this offline until @grammarware adds her to the repo.

Cheers,
Thanos

[grammarware]

@galabarquerom has been added. Welcome to the discussion!

[stsauer]

Summary
The artifact provides the implementation code for the case studies described in the paper entitled "Extending Complex Event Processing to Graph-structured Information", which proposes an extension of CEP systems that permits dealing with graph-structured information, in addition to their timed-events stream processing capabilities, and its implementation using graph technologies based on cluster computing platforms.

Assessment
Consistency
The artifact is consistent with the paper. All the presented case studies (Motorbike and Social Network) with their variations and performance results in the paper are represented in the artifact.

Completeness
The artifact is complete in the sense that everything which is needed to setup the environment and execute the case studies is provided.

Documentation
In general there is sufficient documentation of the artifact as there is a project web site and a readme file included in the github repository. However, the documentation can be optimized regarding consistency and appropriateness of the description.
Following hints could be helpful to further improve the readme file:

1. Motorbike4Esper Project: Import project into workspace: please add the concrete project name here, so that the user can quickly decide between „motorbikeProject“, „MotorbikeGraph“ or „motorbike4Graphx“.
2. It would be also helpful to notice the users to make use of the Maven import function: Import->Maven->Existing Maven Projects.
3. It is a little bit annoying and not really clear when to update the maven dependencies.
4. In some cases Spark's default log4j profile is used and in other cases you use a standard console output. Why?

Reusability
The case studies can be easily reused, parameterized and extended. As we have run the case studies in a different hardware setting, we could not verify the performance results of the cases studies (see table 2 and 3). However it was possible to reproduce results with a similar trend.