Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-uncompress.xml
chartType: barchart
dateTime: 11 May 2019/15:17:38 CDT
hostName: arlab182
inputDir: testdata/calgary
numberOfCpus: 72
numberOfThreads: 1
osArchitecture: amd64
osName: Linux
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 25.191-b12
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	2581.579	53.753	2560.479	50.881	2539.557	47.133	n/a
LZ4 (Java+Unsafe)/block	1311.609	53.909	1224.76	51.128	1158.319	47.408	n/a
Snappy(JNI)/block	1398.923	53.415	1323.956	50.708	1264.825	47.351	true
Snappy(iq80)/block	906.061	54.646	843.182	52.052	803.117	48.678	n/a
LZF/block	878.576	52.406	861.688	49.898	844.483	46.429	n/a
LZF/stream	794.797	52.406	784.678	49.898	773.908	46.429	n/a
LZO-java/block	361.834	52.669	332.67	49.904	313.201	46.405	n/a
LZ4 HC (JNI)/block	2734.313	43.324	2722.123	40.516	2709.482	37.092	n/a
QuickLZ/L3/block	315.828	43.566	309.09	41.12	303.733	38.154	n/a
Gzip/JDK/stream	249.521	35.042	240.668	32.894	233.538	30.274	n/a
BZip2/stream	26.719	31.604	25.681	29.668	24.979	27.289	n/a
LZMA-orig/block	37.291	30.89	34.392	28.822	32.356	25.945	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	804946	29.979	2849.016	50.954
U:book1	90054	29.978	2202.442	68.006
U:book2	125865	29.968	2446.728	54.596
U:geo	2750411	29.954	2999.9	95.999
U:news	184252	29.975	2210.638	59.074
U:obj1	5465707	29.985	2999.9	60.124
U:obj2	313647	29.986	2462.053	47.705
U:paper1	1307620	29.974	2211.702	54.433
U:paper2	1007915	29.983	2635.246	58.186
U:paper3	1383986	29.984	2048.01	60.822
U:paper4	5518382	29.984	2331.924	63.789
U:paper5	6380141	29.97	2426.963	62.406
U:paper6	1944045	29.982	2356.324	54.095
U:pic	208362	29.982	2999.9	16.93
U:progc	1893416	29.975	2386.163	52.781
U:progl	1434569	29.981	2999.9	37.671
U:progp	1847613	29.985	2901.71	37.913
U:trans	1229405	29.983	2999.9	32.061

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	230063	29.984	814.139	52.188
U:book1	32922	29.977	805.189	66.935
U:book2	45442	29.983	882.91	55.369
U:geo	1325603	29.98	2999.9	94.88
U:news	75215	29.982	902.204	57.691
U:obj1	3216435	29.975	2200.573	60.124
U:obj2	125029	29.987	981.42	48.723
U:paper1	605672	29.984	1024.106	54.433
U:paper2	321243	29.987	839.795	59.109
U:paper3	645997	29.981	956.058	60.822
U:paper4	3375757	29.983	1426.569	63.789
U:paper5	3851294	29.983	1464.334	62.406
U:paper6	1011605	29.98	1226.2	54.095
U:pic	106444	29.983	1737.605	16.821
U:progc	978522	29.979	1233.008	52.781
U:progl	513441	29.986	1169.956	39.459
U:progp	1016499	29.984	1596.464	37.913
U:trans	452463	29.981	1348.529	32.833

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	305311	29.974	1080.794	52.256
U:book1	33395	29.987	816.493	66.224
U:book2	50831	29.984	987.594	54.734
U:geo	3095717	29.984	2999.9	97.698
U:news	84299	29.984	1011.123	57.983
U:obj1	2998366	29.979	2051.088	61.658
U:obj2	150166	29.982	1178.911	49.091
U:paper1	651813	29.986	1102.038	52.935
U:paper2	377426	29.981	986.85	57.305
U:paper3	683065	29.971	1011.245	59.932
U:paper4	3241403	29.978	1370.008	61.561
U:paper5	3720828	29.985	1414.668	61.151
U:paper6	991436	29.986	1201.522	52.851
U:pic	125914	29.983	2055.433	18.115
U:progc	962904	29.973	1213.575	51.006
U:progl	633839	29.982	1444.481	36.993
U:progp	1045595	29.988	1641.925	35.523
U:trans	541298	29.987	1612.959	34.449

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	210771	29.977	746.054	55.445
U:book1	23277	29.982	569.203	68.25
U:book2	34932	29.986	678.636	56.758
U:geo	759131	29.983	2472.495	95.636
U:news	57471	29.986	689.286	59.775
U:obj1	1682893	29.985	1150.995	61.221
U:obj2	97602	29.981	766.266	49.794
U:paper1	411091	29.984	695.091	55.332
U:paper2	237877	29.987	621.86	59.339
U:paper3	423812	29.983	627.18	62.006
U:paper4	1755952	29.974	742.282	61.749
U:paper5	1946133	29.984	739.935	60.842
U:paper6	609476	29.985	738.637	53.906
U:pic	84848	29.985	1384.951	18.21
U:progc	603110	29.986	759.803	52.258
U:progl	414328	29.982	944.229	37.93
U:progp	658689	29.976	1034.784	37.121
U:trans	317927	29.985	947.414	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	222314	29.974	786.981	53.879
U:book1	25245	29.98	617.36	62.646
U:book2	37939	29.977	737.288	54.603
U:geo	178051	29.979	579.997	90.913
U:news	57885	29.981	694.373	56.899
U:obj1	1572466	29.977	1075.751	61.142
U:obj2	91904	29.98	721.56	49.693
U:paper1	515309	29.982	871.379	52.725
U:paper2	294350	29.983	769.589	56.491
U:paper3	551362	29.98	816.033	57.918
U:paper4	2441535	29.976	1031.993	58.513
U:paper5	2821690	29.981	1072.938	58.357
U:paper6	790840	29.982	958.551	51.815
U:pic	56671	29.982	925.126	16.283
U:progc	762343	29.986	960.388	50.307
U:progl	447845	29.981	1020.656	37.134
U:progp	779961	29.983	1225	35.77
U:trans	318457	29.972	949.411	38.221

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	216407	29.984	765.818	53.879
U:book1	28810	29.98	704.533	62.646
U:book2	36456	29.981	708.366	54.603
U:geo	156557	29.985	509.888	90.913
U:news	54345	29.985	651.808	56.899
U:obj1	1282129	29.984	876.936	61.142
U:obj2	88562	29.983	695.244	49.693
U:paper1	462201	29.98	781.607	52.725
U:paper2	268962	29.983	703.216	56.491
U:paper3	483968	29.968	716.553	57.918
U:paper4	2240853	29.964	947.563	58.513
U:paper5	2607471	29.986	991.31	58.357
U:paper6	676383	29.979	819.9	51.815
U:pic	53390	29.988	871.377	16.283
U:progc	626818	29.986	789.654	50.307
U:progl	396936	29.982	904.598	37.134
U:progp	626251	29.985	983.53	35.77
U:trans	296777	29.983	884.451	38.221

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	75894	29.974	268.661	52.3
U:book1	9242	29.986	225.968	64.587
U:book2	12486	29.982	242.603	54.299
U:geo	290316	29.981	945.649	98.392
U:news	21906	29.982	262.77	57.396
U:obj1	815235	29.979	557.685	60.114
U:obj2	39222	29.971	308.03	47.691
U:paper1	149145	29.978	252.231	53.024
U:paper2	90584	29.985	236.819	56.682
U:paper3	160098	29.987	236.895	58.363
U:paper4	881084	29.983	372.337	60.477
U:paper5	1047698	29.981	398.391	59.637
U:paper6	220349	29.988	267.02	51.382
U:pic	38297	29.977	625.291	16.991
U:progc	216847	29.979	273.245	49.966
U:progl	140278	29.979	319.718	37.346
U:progp	222315	29.982	349.177	34.899
U:trans	124312	29.979	370.517	34.505

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	843493	29.985	2984.827	36.085
U:book1	93591	29.977	2288.952	47.237
U:book2	132407	29.986	2572.317	38.865
U:geo	682384	29.983	2222.578	83.654
U:news	202588	29.983	2430.026	43.994
U:obj1	5991030	29.984	2999.9	57.436
U:obj2	324101	29.98	2544.621	39.325
U:paper1	1646707	29.981	2784.64	43.534
U:paper2	992022	29.985	2593.473	43.839
U:paper3	1706256	29.977	2525.521	49.22
U:paper4	6407504	29.987	2707.344	56.255
U:paper5	7274573	29.983	2765.983	56.266
U:paper6	2370219	29.979	2873.144	44.821
U:pic	282386	29.98	2999.9	13.013
U:progc	2321397	29.983	2924.713	43.543
U:progl	1631230	29.976	2999.9	28.945
U:progp	2559515	29.982	2999.9	29.069
U:trans	1377735	29.981	2999.9	24.739

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	81133	29.986	287.094	39.534
U:book1	11022	29.989	269.459	53.581
U:book2	14912	29.986	289.709	42.955
U:geo	76726	29.984	249.896	79.199
U:news	22988	29.982	275.743	45.733
U:obj1	449521	29.988	307.418	54.157
U:obj2	37595	29.985	295.114	39.541
U:paper1	160834	29.983	271.951	44.164
U:paper2	101575	29.977	265.622	47.04
U:paper3	172232	29.983	254.88	50.217
U:paper4	759018	29.979	320.794	52.928
U:paper5	894433	29.98	340.12	52.434
U:paper6	227659	29.985	275.907	43.923
U:pic	34579	29.985	564.426	14.781
U:progc	220007	29.98	277.213	42.041
U:progl	158688	29.985	361.602	28.846
U:progp	234973	29.982	369.066	28.237
U:trans	137192	29.98	408.896	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	69607	29.984	246.324	31.657
U:book1	8546	29.984	208.963	40.789
U:book2	11980	29.981	232.784	33.831
U:geo	45672	29.982	148.762	66.823
U:news	17505	29.986	209.95	38.396
U:obj1	281199	29.984	192.331	47.949
U:obj2	29854	29.978	234.403	33.02
U:paper1	135963	29.978	229.935	34.898
U:paper2	87264	29.984	228.149	36.198
U:paper3	144812	29.983	214.303	38.843
U:paper4	496234	29.984	209.697	41.48
U:paper5	564207	29.979	214.554	41.576
U:paper6	184064	29.972	223.172	34.893
U:pic	30259	29.975	494.072	11.001
U:progc	179877	29.973	226.709	33.67
U:progl	137716	29.974	313.934	22.68
U:progp	197761	29.979	310.648	22.726
U:trans	118323	29.977	352.697	20.32

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	7019	29.984	24.839	24.615
U:book1	858	30.002	20.967	33.322
U:book2	1215	29.99	23.601	28.307
U:geo	5973	29.99	19.45	55.537
U:news	1777	29.995	21.306	33.564
U:obj1	30113	29.984	20.596	50.219
U:obj2	3231	29.98	25.368	31.825
U:paper1	15319	29.973	25.912	31.156
U:paper2	9118	29.979	23.842	30.506
U:paper3	16657	29.974	24.657	34.086
U:paper4	51088	29.975	21.595	39.049
U:paper5	55597	29.976	21.144	40.43
U:paper6	21124	29.983	25.602	32.295
U:pic	3784	29.992	61.751	9.696
U:progc	20515	29.985	25.846	31.648
U:progl	13470	29.98	30.699	21.743
U:progp	20207	29.988	31.732	21.748
U:trans	10746	29.978	32.03	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	9792	29.977	34.659	27.453
U:book1	1423	29.982	34.797	33.96
U:book2	2039	29.988	39.61	27.794
U:geo	5566	29.988	18.126	51.952
U:news	2777	29.991	33.301	31.514
U:obj1	33357	29.986	22.813	43.694
U:obj2	4717	29.982	37.031	24.871
U:paper1	18661	29.98	31.557	32.43
U:paper2	12077	29.986	31.572	33.086
U:paper3	19065	29.981	28.215	36.61
U:paper4	58465	29.987	24.704	40.351
U:paper5	63847	29.983	24.276	40.572
U:paper6	25273	29.974	30.64	32.712
U:pic	6376	29.977	104.101	7.96
U:progc	24678	29.982	31.093	31.597
U:progl	19864	29.984	45.265	20.829
U:progp	29155	29.983	45.791	20.881
U:trans	18017	29.987	53.687	17.76

Results Per Test

Generated using Japex version 1.2.2