Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migration of unmigrated content due to installation of a new plugin

...

Anchortoptop

Running SPECjAppServer2004 benchmark on Geronimo

...

Issues still exist that prevent SPECjAppServer2004 from running on Geronimo.

This article is not a success story, but a collection of notes on the progress that has been made in this direction.

Current issue that requires your help is: #Running the benchmark

...

...

Disclaimer: This article is created to write down the existing experience and to make it reproducible. It is not targeted to be a comprehensive guide on either product or on merging them together. It's not also a replacement to the products' documentation, but just a step-by-step guide on how to make things work in a simple configuration, as it worked for me. Make sure you at least look through the documentation on both products before you proceed.

...

...

SPECjAppServer is a trademark of the Standard Performance Evaluation Corp. (SPEC). The official web site for SPECjAppServer2004 is located at http://www.spec.org/jAppServer2004/.

SPECjAppServer2004 version 1.08 introduces a reduced workload called EAStress2004 that relaxes run and reporting rules, enabling informal results to be shared more easily in open-source research and development projects.

The EAStress2004 workload in SPECjAppServer2004 v1.08 can be used as a tool to optimize performance of products under development and to share results in public forums. Unlike SPECjAppServer2004 results, testing results from the EAStress2004 workload do not need to be reviewed by SPEC prior to being made public.

Results from the EAStress2004 workload cannot be used for marketing purposes, and comparisons to other SPECjAppServer2004 results are not permitted.

See full press release on SPECjAppServer2004/EAStress2004 v1.08 here: http://www.spec.org/jAppServer2004/jAppServer2004v108.html.

All logs, stacks and result files in this article are extracted from EAStress2004 v1.08 runs.

...

Sharing geronimo.host with emulator.host or driver.host is contradicting with the SPECjAppServer2004 documentation and would impact the performance severely and invalidate the benchmark results. However technically this is possible.

...

  • <DUMP> – directory at the driver.host where the SPECjAppServer2004 Driver will store its temporal files.
    note

    On Windows some components may work incorrectly if working paths are too long or contain spaces. So it's recommended that you avoid long paths and spaces in them.

Back to Top

Installing products

...

Installing SPECjAppServer2004

Run:

...

...

java -jar SPECjAppServer2004-Kit-v1.08.jar

...

Click Next, read and accept the license agreement, and type in the directory you want the SPECjAppServer2004 to be installed to. This directory will be your <SPEC> directory.

...

java -Djava.endorsed.dirs=lib/endorsed -javaagent:bin/jpa.jar -Dopenejb.jndiname.failoncollision=true -Dopenejb.jndiname.format={ejbName} -jar bin/server.jar

...

Please note the two OpenEJB settings, they're necessary to tune Geronimo to the simple format of EJB JNDI names SPECjAppServer2004 uses.

See details at http://cwiki.apache.org/GMOxDOC21/client-jndi-names.html and http://cwiki.apache.org/OPENEJB/service-locator.html.

...

Geronimo v2.1 needs access to Internet for SPECjAppServer2004 application to be deployed – it tries to fetch XML schemas from http://java.sun.com site.

So if you're behind a firewall, add the appropriate proxy options to the Geronimo startup line:

-Dhttp.proxyHost=PROXY_HOST -Dhttp.proxyPort=PROXY_PORT -Dhttp.nonProxyHosts="127.0.0.1|localhost|geronimo.host|emulator.host"

This problem is caused by OPENEJB-700 bug which is already fixed and the fix should make it to Geronimo v2.1.1.

If your installation of Geronimo has no access to Internet at all, or your proxy requires authentication, you may use the following workarounds (thanks to Konstantin Malynkin for describing them). You may download the necessary DTDs to your local drive and specify the local path to them in your deployment descriptors (see <SPEC>/src/deploy/geronimo directory). For example, you could use <!DOCTYPE ejb-jar SYSTEM "C:/DTD/ejb-jar_2_0.dtd"> instead of <!DOCTYPE ejb-jar PUBLIC '-//Sun Microsystems, Inc.//DTD Enterprise JavaBeans 2.0//EN' 'http://java.sun.com/dtd/ejb-jar_2_0.dtd'>. Another way is to omit verification at all by deleting or commenting out the references to DTDs in the deployment descriptors. Note that in both cases you would have to rebuild and redeploy the SPECjAppServer2004 application for the changes to take effect.

...

It will take some time to start. After that, you will see: No FormatbgColor

blackborderStylesolid Booting Geronimo Kernel (in Java 1.5.0_11)... Starting Geronimo Application Server v2.1 [****************************************] 100% 25s Startup complete Listening on Ports: 0 0.0.0.0 Derby Connector 1050 127.0.0.1 CORBA Naming Service 1099 0.0.0.0 RMI Naming 2001 127.0.0.1 OpenEJB ORB Adapter 4201 0.0.0.0 OpenEJB Daemon 6882 127.0.0.1 OpenEJB ORB Adapter 8009 0.0.0.0 Jetty Connector AJP13 8080 0.0.0.0 Jetty SelectChannel Connector HTTP 8443 0.0.0.0 Jetty SelectChannel Connector HTTPS 9999 0.0.0.0 JMX Remoting Connector 61613 0.0.0.0 ActiveMQ Transport Connector 61616 0.0.0.0 ActiveMQ Transport Connector Started Application Modules: EAR: org.apache.geronimo.configs/uddi-jetty6/2.1/car EAR: org.apache.geronimo.plugins/agent/2.1/car EAR: org.apache.geronimo.plugins/console-jetty/2.1/car EAR: org.apache.geronimo.plugins/mconsole-jetty/2.1/car JAR: org.apache.geronimo.configs/mejb/2.1/car RAR: org.apache.geronimo.configs/activemq-ra/2.1/car RAR: org.apache.geronimo.configs/system-database/2.1/car RAR: org.apache.geronimo.plugins/agent-ds/2.1/car RAR: org.apache.geronimo.plugins/mconsole-ds/2.1/car WAR: WAR: org.apache.geronimo.configs/ca-helper-jetty/2.1/car WAR: org.apache.geronimo.configs/dojo-jetty6/2.1/car WAR: org.apache.geronimo.configs/dojo-legacy-jetty6/2.1/car WAR: org.apache.geronimo.configs/remote-deploy-jetty/2.1/car WAR: org.apache.geronimo.configs/welcome-jetty/2.1/car WAR: org.apache.geronimo.plugins/activemq-console-jetty/2.1/car WAR: org.apache.geronimo.plugins/debugviews-console-jetty/2.1/car WAR: org.apache.geronimo.plugins/plancreator-console-jetty/2.1/car WAR: org.apache.geronimo.plugins/plugin-console-jetty/2.1/car WAR: org.apache.geronimo.plugins/sysdb-console-jetty/2.1/car Web Applications: / /CAHelper /activemq /console /console /console-base /debug-views /dojo /dojo/0.4 /juddi /monitoring /plan-creator /plugin /remote-deploy /system-database Geronimo Application Server started

If you get a different result, particularly, if network errors show up, then something has gone wrong.

...

...

Sometimes, the startup fails because some local network addresses are inaccessible. This could happen, for example, if you have used a VPN interface that is disconnected now. By default, Geronimo uses the first local address it comes across to access its components, and may try to use a stale address, causing startup errors.

You may try disabling and then re-enabling the unused network interfaces to resolve such issues.

...

Accessing the console

Open your web browser and connect to the Geronimo Console at http://geronimo.host:8080/console/

...

JAS_HOME=<SPEC>
JAVA_HOME=<JAVA_HOME>
J2EE_HOME=<GERONIMO>
JAS_HOST=geronimo.host
EMULATOR_HOST=emulator.host

...

...

Use forward slashes ( / ) as directory separators!

...

You may leave the other variables intact.

...

Clean-up your installation:

...

...

ant/bin/ant clean

...

Build the application and configure it for Geronimo:

...

ant/bin/ant -Dappserver=geronimo

...

ant/bin/ant -Dappserver=geronimo loaddb

...

At this stage you need to deploy the configured components to Geronimo.

...

...

Note that if your geronimo.host and your driver.host are the same machine, and you changed the port number of the Geronimo RMI Registry, you should specify that port number in all deployer commands, like this:

...


...

java -jar bin/deployer.jar -port 1199 ...

Logging in

To avoid specifying login credentials on any call to deployer, you can login first:

...

java -jar bin/deployer.jar -u system -p manager login

...

java -jar bin/deployer.jar deploy repository/org/tranql/tranql-connector-derby-embed-xa/1.3/tranql-connector-derby-embed-xa-1.3.rar <KIT>/sjas-db.xml

...

java -jar bin/deployer.jar deploy repository/org/apache/geronimo/modules/geronimo-activemq-ra/2.1/geronimo-activemq-ra-2.1.rar <KIT>/sjas-jms.xml

...

Go to the <GERONIMO> directory and run:

...

...

java -jar bin/deployer.jar deploy <SPEC>/jars/SPECjAppServer.ear <KIT>/sjas-app.xml

...

You will get the SPECjAppServer2004/Application/1.08/ear diagnostic.

...

Go to the page http://geronimo.host:8080/Supplier/DeliveryServlet. You should see a page with text like this:

...

...

Servlet seems to work OK
Number of Transactions : 0
Servlet invoked without command specified

...

Manual transactions

Open the deployed SPECjAppServer2004 page: http://geronimo.host:8080/SPECjAppServer/

...

The Geronimo built-in servlet container (in case the emulator.host and the geronimo.host are the same machine); or a stand-alone servlet container on the emulator.host.

...

...

Note that SPECjAppServer2004 documentation requires that the Supplier Emulator servlet container should have the keep-alive option turned off. You can ignore this requirement, but that would impact the performance severely.

...

Using the Geronimo servlet container

...

java -jar bin/deployer.jar deploy <SPEC>/jars/Emulator.war <KIT>/sjas-emulator.xml

...

Do not bother editing <SPEC>/config/tomcat.env file or running ant/bin/ant -f tomcat.xml.

Both files are obsolete, they generate the Emulator.war file, which has already been created at #Building the application phase.

...

bin/catalina run

...

Go to the page http://emulator.host:8080/Emulator/EmulatorServlet. You should see a page with text like this:

...

...

Emulator Servlet seems to work OK
JAS_HOST : geronimo.host
JAS_PORT : 8080
Servlet URL : Supplier/DeliveryServlet

Number of Transactions : 0
Servlet invoked without command specified

...

Back to Top

Running the benchmark

...

Go to the <DRIVER> directory on the driver.host and run:

...

...

bin/setenv.bat

...

This configures the environment to run the Driver.

...

bin/driver.bat

...

bin/driver.bat master.host

...

After starting the Driver, you should see the output like this: No FormatbgColor

blackborderStylesolid The following environment settings are in effect: * ========================= * JAVA_HOME=<JAVA_HOME> JAS_HOME=<DRIVER> CONFIGCONFIG_DIR=<DRIVER>\config APPSSERVER=geronimo ENVFILE=<DRIVER>\config\geronimo.env * ========================= * Driver Host: <driver.host> This result was created using EAStress2004, a research workload utilizing a subset of the SPECjAppServer2004 benchmark with a unique metric. It is provided only as a tool for research testing and experimentation in situations where the benchmark run rules cannot be met due to technical reasons (e. g., usage of projects under development, usage of experimental platforms). EAStress2004 results are not reviewed by SPEC and can in no way be compared with SPECjAppServer2004 results. Because EAStress results are not compliant with the benchmark run rules, the use of EAStress results in competitive comparisons between vendors is prohibited. Public use of SPECjAppServer2004 benchmark results, including the EAStress workload, are bound by the SPEC OSSC Fair Use Guidelines and the SPECjAppServer2004 specific Run and Reporting Rules. All publications must clearly state that these results have not been reviewed or accepted by SPEC using text equivalent to this: SPECjAppServer is a trademark of the Standard Performance Evaluation Corp. (SPEC). The EAStress workload results or findings in this publication have not been reviewed or accepted by SPEC, therefore no comparison nor performance inference can be made against any published SPEC result. The official web site for SPECjAppServer2004 is located at http://www.spec.org/osg/jAppServer2004. Binding controller to //<driver.host>/Controller DriverDebug: DealerAgent <propsFile> <agentName> <masterMachine> Controller: Registering M1 on machine <driver.host IP address> Controller: Registering O1 on machine <driver.host IP address> Controller: Registering L1 on machine <driver.host IP address> Calling switchLog as master RunID for this run is : 75 Output directory for this run is : <OUTPUT>\75 TTF1 = 93 ttf = 93 Configuring 1 DealerAgent(s)... DealerAgent O1, Thread 0 started DealerAgent O1, Thread 1 started DealerAgent O1, Thread 2 started DealerAgent O1, Thread 3 started DealerAgent O1, Thread 4 started DealerAgent O1, Thread 5 started DealerAgent O1, Thread 6 started DealerAgent O1, Thread 7 started DealerAgent O1, Thread 8 started DealerAgent O1, Thread 9 started Configuring 1 MfgAgent(s)... MfgAgent M1, Thread 0 started MfgAgent M1, Thread 1 started MfgAgent M1, Thread 2 started Configuring 1 LargeOLAgent(s)... MfgAgent L1, Thread 0 started Rampup = Fri May 12 20:49:51 MSD 2006 SteadyState = Fri May 12 20:59:51 MSD 2006 Rampdown = Fri May 12 21:59:51 MSD 2006 Finish = Fri May 12 22:04:51 MSD 2006 sleeptime is 28417 note this is time in excess needed for trigger Starting Ramp Up...

This means the Driver started normally.

Note the times for Rampup, SteadyState, Rampdown and Finish to figure out the time needed for the benchmark to complete.

...

...

You can interrupt the run at any time with Ctrl-C.

...

Sometimes binding exceptions or other problems may occur at the Driver startup. In such a case, interrupt the test run with Ctrl-C and rerun it again. Sometimes it helps.

...

...

It's recommended to reload the database tables before each run, particularly if previous run was not finished correctly. Otherwise, errors like this may occur:

...

...

black

...

solid

...

java.rmi.RemoteException:

...

Failure

...

in

...

calling

...

validateInitialValues()

...

java.rmi.RemoteException:

...

Invalid

...

initial

...

Order

...

DB

...

State

...

at

...

org.spec.jappserver.driver.Auditor.validateInitialValues(Auditor.java:201)

...

at

...

org.spec.jappserver.driver.Driver.configure(Driver.java:330)

...

at

...

org.spec.jappserver.driver.Driver.<init>(Driver.java:160)

...

at

...

org.spec.jappserver.driver.Driver.main(Driver.java:1137)

...

During the run, the diagnostics like these may appear in the Driver output and Geronimo shell: No FormatbgColor

blackborderStylesolid AbstractSJASLoad> Application error have already been sold wrong format in chunk size field b=70 The transaction has been marked rollback only because the bean encountered a non-application exception: A lock could not be obtained due to a deadlock, cycle of locks and waiters is:

...

These diagnostics are probably caused by the fact that TranQL version 1.3 used in Geronimo v2.1 does not provide the necessary transaction isolation level. Hopefully, this problem will be fixed in future versions.

...

After the run has completed successfuly, you will see the output like this:noformat

bgColorblackborderStylesolid Gathering DealerStats ... Gathering MfgStats ... summary file is <OUTPUT>\75\EAStress.summary EAStress2004 v1.08 Results EAStress2004 HASOPM: 0.574 Dealer Response Times Purchase...2.3000000000000003 Manage.....10.0 Browse.....4.0 Manufacturing Response Times Mfg........0.25 Calling getLog as master

The number of HASOPM is a final EAStress benchmark metric. You would get a JOPS result instead if you attempt a full SPECjAppServer2004 run.

...

For now these values for Geronimo are terribly low, and don't depend on the hardware being used. Probably this is due to some configuration issues that still exist or due to the TranQL issue mentioned above.

...

Run the following command to generate an HTML benchmark report, it would be named Your_Submission.report.html:

...

...

java -cp reporter.jar reporter Your_Submission.txt

...

Run the following command to generate a text-only benchmark report, it would be named Your_Submission.report.txt:

...

...

java -cp reporter.jar reporter -a Your_Submission.txt

...

For the details on how yo submit your results, see SPECjAppServer2004 User's Guide :: Section 5.3 – Submitting the Results

...