Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-uncompress.xml
chartType: barchart
dateTime: 03 Dec 2019/22:43:05 CST
hostName: arlab182
inputDir: testdata/calgary
numberOfCpus: 72
numberOfThreads: 1
osArchitecture: amd64
osName: Linux
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Private Build 25.222-b10
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	2797.048	53.753	2788.601	50.881	2779.882	47.133	n/a
LZ4 (Java+Unsafe)/block	1242.187	53.909	1156.239	51.128	1093.638	47.408	n/a
Snappy(JNI)/block	1350.271	53.415	1260.809	50.708	1187.13	47.351	true
Snappy(iq80)/block	904.445	54.646	842.381	52.052	803.386	48.678	n/a
LZF/block	905.931	52.406	892.491	49.898	878.587	46.429	n/a
LZF/stream	847.763	52.406	834.724	49.898	821.448	46.429	n/a
LZO-java/block	349.711	52.669	322.31	49.904	304.026	46.405	n/a
LZ4 HC (JNI)/block	2958.48	43.324	2957.164	40.516	2955.789	37.092	n/a
QuickLZ/L3/block	306.939	43.566	300.197	41.12	294.989	38.154	n/a
Gzip/JDK/stream	250.04	35.042	241.351	32.894	234.327	30.274	n/a
BZip2/stream	26.079	31.604	25.085	29.668	24.402	27.289	n/a
LZMA-orig/block	37.234	30.89	34.131	28.822	31.853	25.945	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	934551	29.974	2999.9	50.954
U:book1	103687	29.972	2536.349	68.006
U:book2	143590	29.97	2791.068	54.596
U:geo	2916324	29.982	2999.9	95.999
U:news	221283	29.979	2654.619	59.074
U:obj1	6182946	29.978	2999.9	60.124
U:obj2	374133	29.978	2937.571	47.705
U:paper1	1489097	29.983	2517.885	54.433
U:paper2	1135683	29.978	2969.723	58.186
U:paper3	1569955	29.979	2323.605	60.822
U:paper4	6313967	29.98	2668.486	63.789
U:paper5	7171275	29.966	2728.205	62.406
U:paper6	2119065	29.979	2568.69	54.095
U:pic	233044	29.979	2999.9	16.93
U:progc	2104117	29.979	2651.358	52.781
U:progl	1656296	29.981	2999.9	37.671
U:progp	2051892	29.979	2999.9	37.913
U:trans	1483696	29.981	2999.9	32.061

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	219798	29.987	777.751	52.188
U:book1	32486	29.978	794.497	66.935
U:book2	42123	29.982	818.473	55.369
U:geo	1119936	29.984	2999.9	94.88
U:news	75591	29.979	906.811	57.691
U:obj1	2898393	29.978	1982.781	60.124
U:obj2	123911	29.979	972.877	48.723
U:paper1	548411	29.978	927.475	54.433
U:paper2	316972	29.98	828.82	59.109
U:paper3	594265	29.965	879.955	60.822
U:paper4	3366315	29.978	1422.826	63.789
U:paper5	3919179	29.979	1490.343	62.406
U:paper6	857163	29.98	1038.987	54.095
U:pic	107709	29.984	1758.189	16.821
U:progc	833227	29.979	1049.942	52.781
U:progl	480947	29.98	1096.125	39.459
U:progp	795623	29.975	1249.954	37.913
U:trans	457536	29.98	1363.661	32.833

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	308589	29.975	1092.366	52.256
U:book1	28975	29.983	708.515	66.224
U:book2	44174	29.979	858.394	54.734
U:geo	2878961	29.982	2999.9	97.698
U:news	75102	29.977	901.008	57.983
U:obj1	2694735	29.978	1843.433	61.658
U:obj2	133986	29.98	1051.97	49.091
U:paper1	580232	29.979	981.248	52.935
U:paper2	328268	29.981	858.311	57.305
U:paper3	595832	29.983	881.757	59.932
U:paper4	3361010	29.984	1420.287	61.561
U:paper5	3802754	29.98	1446.015	61.151
U:paper6	994841	29.981	1205.85	52.851
U:pic	126408	29.982	2063.527	18.115
U:progc	983800	29.984	1239.469	51.006
U:progl	640372	29.982	1459.374	36.993
U:progp	1059911	29.982	1664.736	35.523
U:trans	546488	29.981	1628.71	34.449

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	212688	29.97	753.004	55.445
U:book1	23344	29.981	570.865	68.25
U:book2	35148	29.979	683.004	56.758
U:geo	763429	29.975	2487.193	95.636
U:news	58489	29.98	701.64	59.775
U:obj1	1670747	29.983	1142.742	61.221
U:obj2	96482	29.979	757.519	49.794
U:paper1	410946	29.98	694.935	55.332
U:paper2	239782	29.98	626.982	59.339
U:paper3	429732	29.971	636.195	62.006
U:paper4	1757292	29.98	742.693	61.749
U:paper5	1988149	29.98	756.007	60.842
U:paper6	608628	29.979	737.766	53.906
U:pic	83821	29.978	1368.495	18.21
U:progc	589098	29.984	742.194	52.258
U:progl	400301	29.98	912.32	37.93
U:progp	630609	29.985	990.356	37.121
U:trans	327462	29.977	976.095	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	224323	29.981	793.916	53.879
U:book1	31510	29.979	770.603	62.646
U:book2	41044	29.98	797.542	54.603
U:geo	178785	29.977	582.437	90.913
U:news	61376	29.977	736.348	56.899
U:obj1	1500150	29.983	1026.062	61.142
U:obj2	98441	29.981	772.847	49.693
U:paper1	526129	29.98	889.708	52.725
U:paper2	310138	29.984	810.832	56.491
U:paper3	562147	29.98	831.976	57.918
U:paper4	2611945	29.98	1103.9	58.513
U:paper5	3008218	29.974	1144.133	58.357
U:paper6	770946	29.98	934.489	51.815
U:pic	57823	29.978	944.053	16.283
U:progc	742198	29.978	935.261	50.307
U:progl	463334	29.972	1056.274	37.134
U:progp	744995	29.983	1170.113	35.77
U:trans	337612	29.98	1006.257	38.221

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	214116	29.966	758.164	53.879
U:book1	30393	29.982	743.201	62.646
U:book2	36973	29.976	718.54	54.603
U:geo	171156	29.984	557.439	90.913
U:news	55782	29.979	669.17	56.899
U:obj1	1460995	29.981	999.352	61.142
U:obj2	89952	29.979	706.248	49.693
U:paper1	492480	29.987	832.634	52.725
U:paper2	281924	29.981	737.15	56.491
U:paper3	519898	29.978	769.507	57.918
U:paper4	2353320	29.973	994.807	58.513
U:paper5	2652571	29.981	1008.629	58.357
U:paper6	756912	29.979	917.508	51.815
U:pic	54893	29.979	896.196	16.283
U:progc	735060	29.974	926.391	50.307
U:progl	425510	29.978	969.844	37.134
U:progp	740822	29.979	1163.7	35.77
U:trans	298998	29.977	891.246	38.221

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	72865	29.965	258.019	52.3
U:book1	9115	29.982	222.888	64.587
U:book2	12226	29.976	237.601	54.299
U:geo	280205	29.979	912.762	98.392
U:news	21136	29.976	253.578	57.396
U:obj1	780268	29.981	533.733	60.114
U:obj2	37688	29.978	295.914	47.691
U:paper1	142610	29.977	241.188	53.024
U:paper2	87762	29.977	229.501	56.682
U:paper3	158351	29.972	234.425	58.363
U:paper4	848473	29.977	358.627	60.477
U:paper5	1012970	29.976	385.242	59.637
U:paper6	215964	29.981	261.769	51.382
U:pic	36295	29.978	592.577	16.991
U:progc	213452	29.982	268.938	49.966
U:progl	135153	29.977	308.059	37.346
U:progp	218271	29.981	342.837	34.899
U:trans	119825	29.98	357.139	34.505

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	971170	29.983	2999.9	36.085
U:book1	109466	29.979	2677.111	47.237
U:book2	157284	29.981	2999.9	38.865
U:geo	870256	29.979	2834.821	83.654
U:news	238049	29.984	2855.202	43.994
U:obj1	6887171	29.982	2999.9	57.436
U:obj2	398807	29.982	2999.9	39.325
U:paper1	1870710	29.981	2999.9	43.534
U:paper2	1153034	29.978	2999.9	43.839
U:paper3	1950763	29.983	2886.905	49.22
U:paper4	7343271	29.969	2999.9	56.255
U:paper5	8040569	29.968	2999.9	56.266
U:paper6	2656234	29.979	2999.9	44.821
U:pic	383282	29.977	2999.9	13.013
U:progc	2640605	29.984	2999.9	43.543
U:progl	1891445	29.983	2999.9	28.945
U:progp	2945622	29.978	2999.9	29.069
U:trans	1755971	29.975	2999.9	24.739

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	78981	29.982	279.513	39.534
U:book1	10612	29.983	259.485	53.581
U:book2	14700	29.982	285.627	42.955
U:geo	74315	29.975	242.113	79.199
U:news	22937	29.979	275.16	45.733
U:obj1	426614	29.979	291.838	54.157
U:obj2	37290	29.976	292.807	39.541
U:paper1	156412	29.983	264.473	44.164
U:paper2	102021	29.981	266.755	47.04
U:paper3	169928	29.983	251.472	50.217
U:paper4	670562	29.979	283.414	52.928
U:paper5	761662	29.981	289.617	52.434
U:paper6	225055	29.979	272.807	43.923
U:pic	34174	29.979	557.935	14.781
U:progc	224481	29.98	282.859	42.041
U:progl	154345	29.977	351.805	28.846
U:progp	236246	29.974	371.165	28.237
U:trans	136224	29.977	406.046	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	70322	29.979	248.897	31.657
U:book1	8599	29.982	210.271	40.789
U:book2	12017	29.977	233.53	33.831
U:geo	45723	29.983	148.922	66.823
U:news	17452	29.98	209.354	38.396
U:obj1	282736	29.976	193.43	47.949
U:obj2	30225	29.98	237.303	33.02
U:paper1	136274	29.979	230.454	34.898
U:paper2	85575	29.977	223.785	36.198
U:paper3	145540	29.977	215.423	38.843
U:paper4	505385	29.977	213.615	41.48
U:paper5	570873	29.97	217.154	41.576
U:paper6	187646	29.98	227.452	34.893
U:pic	30204	29.98	493.098	11.001
U:progc	179085	29.975	225.695	33.67
U:progl	135642	29.979	309.154	22.68
U:progp	196970	29.98	309.397	22.726
U:trans	118692	29.978	353.785	20.32

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	6748	29.981	23.882	24.615
U:book1	836	29.964	20.455	33.322
U:book2	1185	29.998	23.013	28.307
U:geo	5773	29.978	18.806	55.537
U:news	1775	29.973	21.298	33.564
U:obj1	29238	29.981	20	50.219
U:obj2	3218	29.986	25.26	31.825
U:paper1	15111	29.98	25.554	31.156
U:paper2	8922	29.979	23.329	30.506
U:paper3	16069	29.979	23.783	34.086
U:paper4	49471	29.981	20.908	39.049
U:paper5	53902	29.979	20.497	40.43
U:paper6	20572	29.987	24.93	32.295
U:pic	3642	29.982	59.454	9.696
U:progc	20458	29.979	25.778	31.648
U:progl	13377	29.979	30.489	21.743
U:progp	19823	29.981	31.136	21.748
U:trans	10352	29.983	30.851	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	10507	29.977	37.191	27.453
U:book1	1418	29.998	34.656	33.96
U:book2	1882	29.979	36.572	27.794
U:geo	4864	29.984	15.842	51.952
U:news	2519	29.983	30.214	31.514
U:obj1	32793	29.981	22.431	43.694
U:obj2	4736	29.983	37.18	24.871
U:paper1	18223	29.981	30.815	32.43
U:paper2	12214	29.976	31.941	33.086
U:paper3	19405	29.976	28.723	36.61
U:paper4	57966	29.979	24.499	40.351
U:paper5	64651	29.98	24.584	40.572
U:paper6	25713	29.978	31.17	32.712
U:pic	6418	29.982	104.77	7.96
U:progc	25227	29.985	31.782	31.597
U:progl	20613	29.98	46.978	20.829
U:progp	29761	29.977	46.752	20.881
U:trans	18154	29.982	54.104	17.76

Results Per Test

Generated using Japex version 1.2.2