...
- Clean up from any previous runs
- Remove tika-app-X-Y.jar from /data1/tools/tika/batch/bin – make sure to leave in the other "optional" jars:
jai-imageio-jpeg2000-1.4.0.jar, sqlite-jdbc-3.4546.30.0.jar and zstd-jni-1.5.56-114.jar
- Remove or rename
/data1/tools/tika/batch/logs
- Remove or rename
/data1/tools/tika/batch/nohup.out
- Remove tika-app-X-Y.jar from /data1/tools/tika/batch/bin – make sure to leave in the other "optional" jars:
- Run the current "A" version
- Place the "A" version of tika-app-X.Y.jar in
/data1/tools/tika/batch/bin
- Modify
appBatchExecutor.sh
to- put the output in a new output directory
-o /data1/extracts/pdfboxA
- if using a file list, confirm that the correct file list is specified
-fileList fileLists/ccAndBugTracker_pdfs.txt
- put the output in a new output directory
- Execute:
nohup ./appBatchExecutor.sh &
- Wait for the "A" version to complete before starting the "B" version
- Place the "A" version of tika-app-X.Y.jar in
- Build and run the "B" version
- Update PDFBox from SVN,
mvn clean install
- Update the PDFBox, Fontbox and jbig2-imageio versions in the Tika project tika-parsers/pom.xml
- Run
mvn clean
on the whole Tika project and make sure that your IDE has picked up the changes - Run the PDFParser tests in tika-parsers/src/test/java/o.a.t.parsers.pdf.* to make sure that at least the Tika unit tests work.
- Build the entire Tika project (even though you'll only use tika-app.jar):
mvn clean install
- On the VM, remove the tika.app-A.jar from
/data1/tools/tika/batch/bin
, rename the existingnohup.out
tonohup-A.out
, renamelogs/
tologs-A/
- Drop the new tika-app-B.jar into (you guessed it!):
/data1/tools/tika/batch/bin
- Modify
appBatchExecutor.sh
to- put the output in a new output directory
-o /data1/extracts/pdfboxB
- if using a file list, confirm that the correct file list is specified
-fileList fileLists/ccAndBugTracker_pdfs.txt
- put the output in a new output directory
- Execute:
nohup ./appBatchExecutor.sh &
- Wait for the "B" version to complete before starting the comparisons and reports
- Update PDFBox from SVN,
- Make the comparisons and report
- In
/data1/tools/tika/eval
, remove the existing db filepdfboxAvsB.mv.db
if you don't want to rename it. nohup java -jar tika-eval-app-X.Y.jar Compare -extractsA /data1/extracts/pdfboxA -extractsB /data1/extracts/pdfboxB -db pdfboxAvsB&
- When that completes,
- Remove any files left over from the last run in
reports/
:rm -r reports
- Write the reports
java -Djava.io.tmpdir=tmp -jar tika-eval-app-X.Y.jar Report -db pdfboxAvsB
– Note the -Djava.io.tmpdir=tmp – need to set the tmp directory to something writeable by 'collab'
- Remove any files left over from the last run in
- In
...