Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-uncompress.xml
chartType: barchart
dateTime: 13 May 2019/02:05:58 CDT
hostName: arlab182
inputDir: testdata/calgary
numberOfCpus: 72
numberOfThreads: 1
osArchitecture: amd64
osName: Linux
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 25.191-b12
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	2769.526	53.753	2758.425	50.881	2746.871	47.133	n/a
LZ4 (Java+Unsafe)/block	1279.575	53.909	1188.555	51.128	1121.905	47.408	n/a
Snappy(JNI)/block	1399.393	53.415	1324.878	50.708	1266.214	47.351	true
Snappy(iq80)/block	899.078	54.646	837.169	52.052	797.643	48.678	n/a
LZF/block	878.689	52.406	861.497	49.898	843.964	46.429	n/a
LZF/stream	850.351	52.406	836.562	49.898	822.395	46.429	n/a
LZO-java/block	360.259	52.669	330.831	49.904	311.453	46.405	n/a
LZ4 HC (JNI)/block	2913.884	43.324	2910.551	40.516	2907.034	37.092	n/a
QuickLZ/L3/block	314.604	43.566	307.783	41.12	302.461	38.154	n/a
Gzip/JDK/stream	246.995	35.042	238.102	32.894	230.896	30.274	n/a
BZip2/stream	26.606	31.604	25.573	29.668	24.864	27.289	n/a
LZMA-orig/block	37.607	30.89	34.643	28.822	32.555	25.945	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	928987	29.983	2999.9	50.954
U:book1	103983	29.977	2543.116	68.006
U:book2	142899	29.969	2777.724	54.596
U:geo	2972399	29.982	2999.9	95.999
U:news	217572	29.981	2609.897	59.074
U:obj1	6126161	29.983	2999.9	60.124
U:obj2	373957	29.98	2936.031	47.705
U:paper1	1431729	29.964	2422.454	54.433
U:paper2	1125377	29.984	2942.204	58.186
U:paper3	1500149	29.986	2219.812	60.822
U:paper4	6022554	29.983	2545.065	63.789
U:paper5	7101864	29.971	2701.371	62.406
U:paper6	2090300	29.984	2533.395	54.095
U:pic	236797	29.98	2999.9	16.93
U:progc	2079457	29.97	2621.096	52.781
U:progl	1599807	29.979	2999.9	37.671
U:progp	1931757	29.983	2999.9	37.913
U:trans	1336342	29.984	2999.9	32.061

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	225022	29.987	796.214	52.188
U:book1	31629	29.978	773.533	66.935
U:book2	43556	29.967	846.714	55.369
U:geo	1098167	29.982	2999.9	94.88
U:news	78185	29.987	937.678	57.691
U:obj1	3340440	29.976	2285.31	60.124
U:obj2	130550	29.985	1024.797	48.723
U:paper1	559125	29.984	945.381	54.433
U:paper2	325196	29.985	850.163	59.109
U:paper3	607768	29.983	899.405	60.822
U:paper4	3399581	29.982	1436.655	63.789
U:paper5	3897916	29.985	1482.001	62.406
U:paper6	885058	29.983	1072.701	54.095
U:pic	109128	29.985	1781.287	16.821
U:progc	873461	29.981	1100.542	52.781
U:progl	497680	29.978	1134.342	39.459
U:progp	840000	29.981	1319.382	37.913
U:trans	451763	29.983	1346.346	32.833

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	306804	29.975	1086.036	52.256
U:book1	33923	29.983	829.49	66.224
U:book2	50507	29.98	981.421	54.734
U:geo	3249656	29.982	2999.9	97.698
U:news	83991	29.981	1007.511	57.983
U:obj1	2991788	29.978	2046.695	61.658
U:obj2	151295	29.985	1187.663	49.091
U:paper1	653892	29.983	1105.684	52.935
U:paper2	379794	29.985	992.918	57.305
U:paper3	680475	29.983	1007.006	59.932
U:paper4	3305434	29.978	1397.058	61.561
U:paper5	3672376	29.982	1396.38	61.151
U:paper6	967774	29.983	1172.951	52.851
U:pic	124831	29.981	2037.859	18.115
U:progc	969563	29.983	1221.547	51.006
U:progl	629124	29.971	1434.241	36.993
U:progp	1065849	29.981	1674.115	35.523
U:trans	540223	29.971	1610.595	34.449

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	209648	29.971	742.215	55.445
U:book1	23641	29.972	578.294	68.25
U:book2	35346	29.984	686.736	56.758
U:geo	747304	29.986	2433.745	95.636
U:news	58136	29.98	697.398	59.775
U:obj1	1703530	29.984	1165.13	61.221
U:obj2	97453	29.977	765.195	49.794
U:paper1	394110	29.977	666.542	55.332
U:paper2	231060	29.977	604.233	59.339
U:paper3	415362	29.979	614.756	62.006
U:paper4	1775019	29.98	750.184	61.749
U:paper5	2010856	29.977	764.726	60.842
U:paper6	603979	29.982	732.05	53.906
U:pic	85816	29.98	1400.977	18.21
U:progc	587494	29.982	740.213	52.258
U:progl	398933	29.984	909.091	37.93
U:progp	615411	29.982	966.597	37.121
U:trans	323921	29.983	965.328	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	221243	29.983	782.943	53.879
U:book1	25121	29.985	614.227	62.646
U:book2	38101	29.983	740.283	54.603
U:geo	177683	29.976	578.855	90.913
U:news	57590	29.981	690.824	56.899
U:obj1	1582715	29.981	1082.63	61.142
U:obj2	92577	29.982	726.807	49.693
U:paper1	512213	29.986	866.026	52.725
U:paper2	289328	29.979	756.557	56.491
U:paper3	552073	29.981	817.047	57.918
U:paper4	2425017	29.98	1024.902	58.513
U:paper5	2844659	29.983	1081.596	58.357
U:paper6	802970	29.977	973.416	51.815
U:pic	57582	29.982	939.984	16.283
U:progc	767337	29.983	966.787	50.307
U:progl	448359	29.984	1021.7	37.134
U:progp	775905	29.982	1218.676	35.77
U:trans	313106	29.982	933.137	38.221

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	212527	29.976	752.294	53.879
U:book1	29784	29.982	728.317	62.646
U:book2	36194	29.971	703.528	54.603
U:geo	169539	29.982	552.21	90.913
U:news	55119	29.984	661.117	56.899
U:obj1	1470252	29.979	1005.749	61.142
U:obj2	89771	29.981	704.792	49.693
U:paper1	499839	29.981	845.245	52.725
U:paper2	285416	29.981	746.275	56.491
U:paper3	532578	29.978	788.269	57.918
U:paper4	2285218	29.982	965.737	58.513
U:paper5	2695163	29.977	1024.973	58.357
U:paper6	770583	29.983	933.97	51.815
U:pic	54634	29.983	891.85	16.283
U:progc	736832	29.984	928.317	50.307
U:progl	437020	29.977	996.111	37.134
U:progp	737339	29.983	1158.085	35.77
U:trans	308529	29.982	919.485	38.221

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	72614	29.968	257.103	52.3
U:book1	9284	29.983	227.02	64.587
U:book2	12605	29.987	244.875	54.299
U:geo	294945	29.98	960.732	98.392
U:news	21929	29.984	263.02	57.396
U:obj1	801703	29.982	548.363	60.114
U:obj2	39057	29.982	306.622	47.691
U:paper1	150127	29.981	253.867	53.024
U:paper2	88569	29.975	231.627	56.682
U:paper3	160555	29.981	237.614	58.363
U:paper4	861622	29.979	364.157	60.477
U:paper5	1022669	29.982	388.853	59.637
U:paper6	218323	29.98	264.639	51.382
U:pic	37965	29.981	619.776	16.991
U:progc	217225	29.979	273.72	49.966
U:progl	141418	29.982	322.282	37.346
U:progp	223111	29.983	350.414	34.899
U:trans	124106	29.973	369.98	34.505

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	928488	29.986	2999.9	36.085
U:book1	103173	29.982	2522.918	47.237
U:book2	148866	29.977	2892.986	38.865
U:geo	882654	29.983	2874.881	83.654
U:news	222336	29.977	2667.433	43.994
U:obj1	6467758	29.981	2999.9	57.436
U:obj2	382087	29.98	2999.884	39.325
U:paper1	1759623	29.982	2975.406	43.534
U:paper2	1063792	29.984	2781.252	43.839
U:paper3	1877201	29.983	2778.027	49.22
U:paper4	7132336	29.981	2999.9	56.255
U:paper5	7777845	29.976	2958.029	56.266
U:paper6	2545463	29.978	2999.9	44.821
U:pic	368843	29.985	2999.9	13.013
U:progc	2428342	29.98	2999.9	43.543
U:progl	1694369	29.99	2999.9	28.945
U:progp	2804192	29.983	2999.9	29.069
U:trans	1442311	29.987	2999.9	24.739

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	81809	29.984	289.499	39.534
U:book1	10970	29.98	268.268	53.581
U:book2	14880	29.98	289.137	42.955
U:geo	75324	29.975	245.402	79.199
U:news	23083	29.977	276.932	45.733
U:obj1	449671	29.981	307.59	54.157
U:obj2	37723	29.98	296.175	39.541
U:paper1	161812	29.977	273.66	44.164
U:paper2	101713	29.98	265.954	47.04
U:paper3	173897	29.983	257.343	50.217
U:paper4	718968	29.982	303.84	52.928
U:paper5	841125	29.981	319.833	52.434
U:paper6	227291	29.984	275.474	43.923
U:pic	34981	29.979	571.1	14.781
U:progc	224264	29.968	282.693	42.041
U:progl	157085	29.981	357.997	28.846
U:progp	236426	29.984	371.318	28.237
U:trans	137805	29.985	410.661	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	70313	29.985	248.816	31.657
U:book1	8540	29.983	208.823	40.789
U:book2	11996	29.985	233.06	33.831
U:geo	44565	29.983	145.15	66.823
U:news	17079	29.984	204.851	38.396
U:obj1	279110	29.98	190.927	47.949
U:obj2	29892	29.984	234.658	33.02
U:paper1	134132	29.977	226.851	34.898
U:paper2	85843	29.977	224.483	36.198
U:paper3	142171	29.983	210.391	38.843
U:paper4	481923	29.981	203.672	41.48
U:paper5	555730	29.98	211.32	41.576
U:paper6	183105	29.971	222.015	34.893
U:pic	30137	29.984	491.939	11.001
U:progc	179585	29.973	226.338	33.67
U:progl	135338	29.984	308.409	22.68
U:progp	196786	29.987	309.031	22.726
U:trans	115819	29.982	345.17	20.32

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	6954	29.98	24.612	24.615
U:book1	837	29.99	20.462	33.322
U:book2	1188	29.996	23.072	28.307
U:geo	5896	29.985	19.202	55.537
U:news	1733	29.988	20.784	33.564
U:obj1	30152	29.98	20.625	50.219
U:obj2	3270	29.986	25.669	31.825
U:paper1	15384	29.971	26.023	31.156
U:paper2	9120	29.979	23.848	30.506
U:paper3	16710	29.984	24.728	34.086
U:paper4	51428	29.984	21.732	39.049
U:paper5	55325	29.977	21.04	40.43
U:paper6	21202	29.985	25.695	32.295
U:pic	3732	29.98	60.928	9.696
U:progc	20513	29.986	25.842	31.648
U:progl	13664	29.983	31.138	21.743
U:progp	20379	29.98	32.011	21.748
U:trans	10570	29.987	31.497	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	10259	29.982	36.306	27.453
U:book1	1400	29.984	34.233	33.96
U:book2	2054	29.985	39.906	27.794
U:geo	5541	29.982	18.048	51.952
U:news	2779	29.985	33.331	31.514
U:obj1	33716	29.984	23.061	43.694
U:obj2	4724	29.988	37.079	24.871
U:paper1	18652	29.98	31.541	32.43
U:paper2	12300	29.972	32.171	33.086
U:paper3	19167	29.988	28.359	36.61
U:paper4	58332	29.988	24.647	40.351
U:paper5	64287	29.986	24.441	40.572
U:paper6	25263	29.981	30.621	32.712
U:pic	6456	29.985	105.38	7.96
U:progc	24830	29.98	31.287	31.597
U:progl	20385	29.987	46.448	20.829
U:progp	29541	29.981	46.401	20.881
U:trans	18012	29.986	53.674	17.76

Results Per Test

Generated using Japex version 1.2.2