Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-uncompress.xml
chartType: barchart
dateTime: 10 Jun 2021/03:14:31 UTC
hostName: reiperf-contrib-vsi1-dyiff
inputDir: testdata/calgary
numberOfCpus: 4
numberOfThreads: 1
osArchitecture: amd64
osName: Linux
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Ubuntu 11.0.11+9-Ubuntu-0ubuntu2.18.04
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	2490.328	53.753	2316.027	50.881	2217.513	47.133	n/a
LZ4 (Java+Unsafe)/block	910.898	53.909	830.745	51.128	778.5	47.408	n/a
Snappy(JNI)/block	1126.989	53.415	854.535	50.708	768.104	47.351	true
Snappy(iq80)/block	607.874	54.646	559.001	52.052	530.117	48.678	n/a
LZF/block	668.627	52.406	657.817	49.898	646.897	46.429	n/a
LZF/stream	533.47	52.406	525.535	49.898	517.3	46.429	n/a
LZO-java/block	278.609	52.669	254.265	49.904	238.697	46.405	n/a
LZ4 HC (JNI)/block	2529.605	43.324	2462.839	40.516	2409.645	37.092	n/a
QuickLZ/L3/block	254.86	43.566	248.244	41.12	243.036	38.154	n/a
Gzip/JDK/stream	183.524	35.042	176.903	32.894	171.563	30.274	n/a
BZip2/stream	20.346	31.604	19.492	29.668	18.9	27.289	n/a
LZMA-orig/block	26.138	30.89	24.482	28.822	23.182	25.945	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	716503	29.989	2535.161	50.954
U:book1	74607	29.99	1823.912	68.006
U:book2	102638	29.99	1993.764	54.596
U:geo	2297792	29.99	7482.41	95.999
U:news	159888	29.989	1917.407	59.074
U:obj1	4339048	29.989	2967.21	60.124
U:obj2	278574	29.99	2186.419	47.705
U:paper1	1076114	29.99	1819.185	54.433
U:paper2	846199	29.99	2211.895	58.186
U:paper3	1143147	29.99	1691.313	60.822
U:paper4	4489312	29.99	1896.702	63.789
U:paper5	5108971	29.99	1942.102	62.406
U:paper6	1536707	29.988	1862.205	54.095
U:pic	173831	29.99	2836.94	16.93
U:progc	1523673	29.991	1919.205	52.781
U:progl	1159350	29.99	2641.34	37.671
U:progp	1404806	29.991	2205.835	37.913
U:trans	970956	29.99	2892.899	32.061

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	177810	29.99	629.094	52.188
U:book1	20508	29.988	501.383	66.935
U:book2	28686	29.988	557.265	55.369
U:geo	824498	29.987	2685.046	94.88
U:news	49374	29.987	592.147	57.691
U:obj1	1987825	29.99	1359.312	60.124
U:obj2	82894	29.99	650.597	48.723
U:paper1	411017	29.99	694.821	54.433
U:paper2	218183	29.99	570.302	59.109
U:paper3	442512	29.99	654.698	60.822
U:paper4	2160721	29.99	912.874	63.789
U:paper5	2503920	29.989	951.871	62.406
U:paper6	676633	29.99	819.891	54.095
U:pic	75524	29.99	1232.555	16.821
U:progc	655159	29.99	825.248	52.781
U:progl	354158	29.991	806.866	39.459
U:progp	668521	29.99	1049.735	37.913
U:trans	302893	29.99	902.453	32.833

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	188421	29.987	666.714	52.256
U:book1	20805	29.991	508.593	66.224
U:book2	31471	29.991	611.313	54.734
U:geo	2115318	29.99	6887.988	97.698
U:news	54421	29.991	652.599	57.983
U:obj1	1959169	29.99	1339.703	61.658
U:obj2	98050	29.991	769.542	49.091
U:paper1	389564	29.991	658.547	52.935
U:paper2	230210	29.991	601.733	57.305
U:paper3	394601	29.991	583.808	59.932
U:paper4	1553326	29.99	656.263	61.561
U:paper5	1841958	29.99	700.18	61.151
U:paper6	564963	29.991	684.569	52.851
U:pic	86872	29.991	1417.738	18.115
U:progc	560675	29.991	706.222	51.006
U:progl	381525	29.991	869.22	36.993
U:progp	608890	29.99	956.091	35.523
U:trans	340628	29.987	1014.978	34.449

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	144639	29.988	511.784	55.445
U:book1	16155	29.989	394.951	68.25
U:book2	24301	29.988	472.08	56.758
U:geo	553637	29.988	1802.936	95.636
U:news	40451	29.99	485.081	59.775
U:obj1	1105837	29.99	756.196	61.221
U:obj2	65076	29.988	510.79	49.794
U:paper1	267053	29.988	451.492	55.332
U:paper2	155978	29.99	407.711	59.339
U:paper3	276633	29.99	409.286	62.006
U:paper4	1077041	29.988	455.071	61.749
U:paper5	1211987	29.99	460.721	60.842
U:paper6	386925	29.988	468.88	53.906
U:pic	59610	29.988	972.913	18.21
U:progc	382881	29.988	482.316	52.258
U:progl	267458	29.988	609.402	37.93
U:progp	412521	29.99	647.757	37.121
U:trans	215596	29.99	642.367	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	158498	29.99	560.777	53.879
U:book1	22140	29.992	541.223	62.646
U:book2	29605	29.991	575.064	54.603
U:geo	137416	29.99	447.465	90.913
U:news	44503	29.987	533.732	56.899
U:obj1	1177030	29.987	804.969	61.142
U:obj2	71969	29.987	564.913	49.693
U:paper1	386311	29.987	653.129	52.725
U:paper2	226327	29.987	591.663	56.491
U:paper3	412148	29.987	609.844	57.918
U:paper4	1912465	29.986	808.097	58.513
U:paper5	2218376	29.985	843.427	58.357
U:paper6	576317	29.99	698.347	51.815
U:pic	42488	29.991	693.391	16.283
U:progc	551176	29.99	694.266	50.307
U:progl	348956	29.99	795.03	37.134
U:progp	546498	29.99	858.131	35.77
U:trans	255688	29.99	761.811	38.221

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	153079	29.987	541.656	53.879
U:book1	15887	29.988	388.414	62.646
U:book2	23554	29.987	457.581	54.603
U:geo	111728	29.987	363.857	90.913
U:news	36607	29.987	439.04	56.899
U:obj1	912989	29.986	624.398	61.142
U:obj2	60934	29.989	478.267	49.693
U:paper1	301930	29.989	510.433	52.725
U:paper2	177167	29.989	463.11	56.491
U:paper3	317504	29.987	469.791	57.918
U:paper4	1421800	29.99	600.707	58.513
U:paper5	1661463	29.987	631.647	58.357
U:paper6	446194	29.989	540.68	51.815
U:pic	38464	29.988	627.773	16.283
U:progc	430509	29.986	542.357	50.307
U:progl	274601	29.99	625.64	37.134
U:progp	434169	29.989	681.766	35.77
U:trans	206527	29.99	615.347	38.221

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	56950	29.984	201.534	52.3
U:book1	6967	29.987	170.335	64.587
U:book2	9390	29.989	182.41	54.299
U:geo	239542	29.985	780.157	98.392
U:news	16496	29.985	197.851	57.396
U:obj1	610279	29.984	417.4	60.114
U:obj2	29824	29.985	234.115	47.691
U:paper1	115332	29.986	194.995	53.024
U:paper2	70093	29.986	183.24	56.682
U:paper3	120632	29.986	178.499	58.363
U:paper4	655312	29.983	276.927	60.477
U:paper5	795463	29.984	302.441	59.637
U:paper6	168285	29.985	203.953	51.382
U:pic	29421	29.984	480.25	16.991
U:progc	170528	29.985	214.839	49.966
U:progl	107218	29.985	244.32	37.346
U:progp	172308	29.984	270.618	34.899
U:trans	94321	29.984	281.083	34.505

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	678587	29.989	2400.949	36.085
U:book1	78997	29.99	1931.195	47.237
U:book2	109316	29.99	2123.467	38.865
U:geo	662483	29.989	2157.286	83.654
U:news	171524	29.99	2056.919	43.994
U:obj1	4848649	29.99	3315.629	57.436
U:obj2	286332	29.99	2247.307	39.325
U:paper1	1316036	29.99	2224.791	43.534
U:paper2	823092	29.988	2151.626	43.839
U:paper3	1406240	29.987	2080.753	49.22
U:paper4	5177293	29.987	2187.592	56.255
U:paper5	5678012	29.986	2158.666	56.266
U:paper6	1882824	29.985	2281.88	44.821
U:pic	281475	29.987	4594.231	13.013
U:progc	1873145	29.986	2359.746	43.543
U:progl	1276719	29.987	2909.119	28.945
U:progp	2042710	29.987	3207.907	29.069
U:trans	1055057	29.987	3143.821	24.739

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	66478	29.99	235.208	39.534
U:book1	7915	29.99	193.493	53.581
U:book2	10700	29.991	207.842	42.955
U:geo	60147	29.984	195.893	79.199
U:news	18367	29.986	220.283	45.733
U:obj1	390391	29.985	267	54.157
U:obj2	30657	29.983	240.67	39.541
U:paper1	129837	29.989	219.494	44.164
U:paper2	80708	29.983	211.012	47.04
U:paper3	139317	29.99	206.125	50.217
U:paper4	594429	29.983	251.197	52.928
U:paper5	693499	29.984	263.675	52.434
U:paper6	190770	29.985	231.199	43.923
U:pic	29398	29.984	479.881	14.781
U:progc	187876	29.983	236.705	42.041
U:progl	126711	29.983	288.757	28.846
U:progp	194846	29.983	306.03	28.237
U:trans	111754	29.985	333.019	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	51413	29.99	181.905	31.657
U:book1	6319	29.992	154.466	40.789
U:book2	8907	29.993	173.004	33.831
U:geo	33146	29.987	107.944	66.823
U:news	12838	29.99	153.951	38.396
U:obj1	205752	29.988	140.709	47.949
U:obj2	22102	29.99	173.469	33.02
U:paper1	99225	29.99	167.742	34.898
U:paper2	63676	29.99	166.445	36.198
U:paper3	105683	29.987	156.375	38.843
U:paper4	365414	29.99	154.386	41.48
U:paper5	414586	29.99	157.601	41.576
U:paper6	136825	29.989	165.798	34.893
U:pic	22487	29.988	367.017	11.001
U:progc	133153	29.99	167.723	33.67
U:progl	100671	29.99	229.362	22.68
U:progp	145037	29.99	227.745	22.726
U:trans	86518	29.988	257.798	20.32

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	5455	29.989	19.301	24.615
U:book1	638	29.993	15.595	33.322
U:book2	874	29.986	16.98	28.307
U:geo	4376	29.991	14.249	55.537
U:news	1336	30.007	16.012	33.564
U:obj1	22230	29.985	15.204	50.219
U:obj2	2394	29.995	18.787	31.825
U:paper1	11537	29.984	19.507	31.156
U:paper2	7022	29.994	18.353	30.506
U:paper3	12432	29.991	18.393	34.086
U:paper4	39017	29.984	16.488	39.049
U:paper5	42248	29.984	16.063	40.43
U:paper6	16289	29.983	19.742	32.295
U:pic	2883	29.991	47.05	9.696
U:progc	15765	29.987	19.86	31.648
U:progl	10659	29.99	24.285	21.743
U:progp	16098	29.991	25.277	21.748
U:trans	8416	29.989	25.076	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	7466	29.987	26.418	27.453
U:book1	959	29.996	23.44	33.96
U:book2	1432	29.991	27.816	27.794
U:geo	3993	29.984	13.005	51.952
U:news	1975	29.987	23.686	31.514
U:obj1	24199	29.985	16.551	43.694
U:obj2	3397	29.997	26.655	24.871
U:paper1	13325	29.99	22.526	32.43
U:paper2	8727	29.986	22.814	33.086
U:paper3	13688	29.988	20.253	36.61
U:paper4	41985	29.987	17.74	40.351
U:paper5	46300	29.989	17.601	40.572
U:paper6	18185	29.991	22.035	32.712
U:pic	3838	29.996	62.625	7.96
U:progc	17789	29.985	22.411	31.597
U:progl	14599	29.986	33.265	20.829
U:progp	21115	29.99	33.156	20.881
U:trans	12915	29.989	38.482	17.76

Results Per Test

Generated using Japex version 1.2.2