Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-uncompress.xml
chartType: barchart
dateTime: 07 Aug 2013/13:51:39 CEST
hostName: zreptik4
inputDir: testdata/calgary
numberOfCpus: 8
numberOfThreads: 1
osArchitecture: amd64
osName: Linux
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 5
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 23.21-b01
warmupTime: 2
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	1499.9	53.919	1499.9	51.136	1499.9	47.415	n/a
LZ4 (Java+Unsafe)/block	1097.383	53.919	1063.256	51.136	1029.35	47.415	n/a
Snappy(JNI)/block	1174.546	54.646	1154.637	52.052	1135.265	48.678	true
Snappy(iq80)/block	1024.152	54.646	995.713	52.052	969.113	48.678	n/a
LZF/block	924.96	52.406	911.659	49.898	898.382	46.429	n/a
LZF/stream	883.054	52.406	870.974	49.898	858.883	46.429	n/a
LZO-java/block	396.018	52.669	359.483	49.904	337.109	46.405	n/a
LZ4 HC (JNI)/block	1499.9	43.336	1499.9	40.538	1499.9	37.137	n/a
LZ4 HC (Java+Unsafe)/block	1216.057	43.336	1186.092	40.538	1154.934	37.137	n/a
QuickLZ/L3/block	256.845	43.566	248.717	41.12	242.416	38.154	n/a
Gzip/JDK/stream	258.611	35.042	248.511	32.894	240.533	30.274	n/a
BZip2/stream	29.444	31.604	28.525	29.668	27.868	27.289	n/a
LZMA-orig/block	36.125	30.89	33.524	28.822	31.593	25.945	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	102516	4.987	1499.9	52.188
U:book1	11649	4.986	1499.9	66.935
U:book2	15880	4.984	1499.9	55.37
U:geo	276402	4.987	1499.9	94.989
U:news	27688	4.983	1499.9	57.688
U:obj1	860120	4.984	1499.9	60.152
U:obj2	44551	4.988	1499.9	48.723
U:paper1	195296	4.984	1499.9	54.433
U:paper2	116779	4.984	1499.9	59.097
U:paper3	204060	4.974	1499.9	60.822
U:paper4	830554	4.985	1499.9	63.812
U:paper5	949574	4.984	1499.9	62.406
U:paper6	284488	4.984	1499.9	54.095
U:pic	30700	4.985	1499.9	16.822
U:progc	283528	4.99	1499.9	52.781
U:progl	172659	4.984	1499.9	39.459
U:progp	271308	4.988	1499.9	37.913
U:trans	153531	4.991	1499.9	32.864

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	39456	4.985	839.866	52.188
U:book1	4550	4.98	669.798	66.935
U:book2	6436	4.987	751.85	55.37
U:geo	160257	4.983	1499.9	94.989
U:news	11057	4.987	797.349	57.688
U:obj1	475374	4.985	1499.9	60.152
U:obj2	19160	4.984	904.803	48.723
U:paper1	93837	4.986	954.053	54.433
U:paper2	51562	4.983	811.12	59.097
U:paper3	100841	4.982	898.061	60.822
U:paper4	526729	4.981	1339.982	63.812
U:paper5	609395	4.986	1393.317	62.406
U:paper6	154905	4.984	1129.439	54.095
U:pic	14998	4.983	1473.199	16.822
U:progc	148549	4.984	1125.97	52.781
U:progl	80869	4.99	1107.3	39.459
U:progp	140176	4.985	1324.116	37.913
U:trans	68783	4.985	1232.868	32.864

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	49141	4.985	1045.921	55.445
U:book1	5527	4.986	812.729	68.25
U:book2	8202	4.985	958.41	56.758
U:geo	193971	4.984	1499.9	95.636
U:news	14250	4.985	1028.001	59.775
U:obj1	437267	4.98	1499.9	61.221
U:obj2	24988	4.986	1179.736	49.794
U:paper1	102638	4.983	1044.194	55.332
U:paper2	59588	4.984	937.162	59.339
U:paper3	105915	4.987	942.344	62.006
U:paper4	431589	4.981	1097.773	61.749
U:paper5	497565	4.986	1137.754	60.842
U:paper6	150874	4.985	1099.873	53.906
U:pic	20032	4.981	1499.9	18.21
U:progc	147720	4.988	1118.764	52.258
U:progl	97548	4.985	1337.155	37.93
U:progp	153700	4.986	1451.534	37.121
U:trans	80980	4.988	1450.772	38.058

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	40440	4.977	862.2	55.445
U:book1	4444	4.99	652.976	68.25
U:book2	6623	4.98	774.73	56.758
U:geo	156804	4.985	1499.9	95.636
U:news	11050	4.98	798.054	59.775
U:obj1	329624	4.985	1356.023	61.221
U:obj2	19472	4.981	920.218	49.794
U:paper1	86237	4.984	877.214	55.332
U:paper2	49677	4.987	780.899	59.339
U:paper3	89559	4.989	796.487	62.006
U:paper4	404740	4.985	1028.766	61.749
U:paper5	455352	4.981	1042.101	60.842
U:paper6	129381	4.982	943.762	53.906
U:pic	15970	4.987	1499.9	18.21
U:progc	128096	4.988	970.13	52.258
U:progl	84423	4.985	1157.091	37.93
U:progp	135713	4.987	1281.481	37.121
U:trans	66516	4.983	1192.804	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	37331	4.983	794.957	53.879
U:book1	5081	4.975	748.719	62.646
U:book2	6897	4.988	805.581	54.603
U:geo	32984	4.987	645.909	90.913
U:news	10224	4.985	737.646	56.899
U:obj1	270848	4.987	1113.71	61.142
U:obj2	16705	4.989	788.168	49.693
U:paper1	88803	4.984	903.336	52.725
U:paper2	53656	4.988	843.219	56.491
U:paper3	94751	4.987	842.964	57.918
U:paper4	449995	4.98	1145.005	58.513
U:paper5	533770	4.986	1220.487	58.357
U:paper6	130884	4.986	953.992	51.815
U:pic	10046	4.987	985.928	16.283
U:progc	124227	4.983	941.705	50.307
U:progl	76488	4.984	1048.65	37.134
U:progp	116426	4.983	1100.223	35.77
U:trans	57370	4.981	1029.079	38.221

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	35777	4.984	761.727	53.879
U:book1	4885	4.986	718.272	62.646
U:book2	6599	4.98	771.92	54.603
U:geo	31599	4.99	618.394	90.913
U:news	9862	4.976	712.723	56.899
U:obj1	253986	4.985	1044.832	61.142
U:obj2	16084	4.982	759.973	49.693
U:paper1	84454	4.984	859.01	52.725
U:paper2	51243	4.985	805.862	56.491
U:paper3	91056	4.984	810.657	57.918
U:paper4	430275	4.99	1092.557	58.513
U:paper5	503924	4.983	1152.777	58.357
U:paper6	122881	4.984	895.901	51.815
U:pic	9723	4.987	954.292	16.283
U:progc	118591	4.984	898.903	50.307
U:progl	72900	4.986	998.915	37.134
U:progp	111606	4.984	1054.575	35.77
U:trans	54868	4.984	983.678	38.221

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	13542	4.985	288.23	52.3
U:book1	1616	4.983	237.777	64.587
U:book2	2198	4.988	256.716	54.299
U:geo	59934	4.984	1174.262	98.392
U:news	3917	4.982	282.764	57.396
U:obj1	148558	4.987	610.943	60.114
U:obj2	6933	4.984	327.417	47.691
U:paper1	27224	4.983	276.995	53.024
U:paper2	16475	4.982	259.242	56.682
U:paper3	29015	4.976	258.743	58.363
U:paper4	148475	4.981	377.699	60.477
U:paper5	176224	4.984	403.055	59.637
U:paper6	40076	4.983	292.251	51.382
U:pic	6613	4.986	649.212	16.991
U:progc	39096	4.983	296.373	49.966
U:progl	25487	4.983	349.476	37.346
U:progp	40307	4.987	380.597	34.899
U:trans	22676	4.984	406.578	34.505

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	112383	4.99	1499.9	36.093
U:book1	13778	4.984	1499.9	47.247
U:book2	18856	4.984	1499.9	38.875
U:geo	117406	4.986	1499.9	83.655
U:news	29578	4.975	1499.9	44.002
U:obj1	912433	4.984	1499.9	57.445
U:obj2	49848	4.99	1499.9	39.334
U:paper1	247426	4.982	1499.9	43.538
U:paper2	147686	4.982	1499.9	43.846
U:paper3	253403	4.985	1499.9	49.222
U:paper4	943350	4.978	1499.9	56.255
U:paper5	1057758	4.981	1499.9	56.266
U:paper6	350559	4.98	1499.9	44.821
U:pic	43762	4.984	1499.9	13.094
U:progc	352763	4.986	1499.9	43.549
U:progl	204965	4.99	1499.9	28.953
U:progp	372036	4.986	1499.9	29.101
U:trans	167389	4.989	1499.9	24.753

Driver: LZ4 HC (Java+Unsafe)/block

LZ4 HC (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	47299	4.99	1005.84	36.093
U:book1	5270	4.983	775.407	47.247
U:book2	7286	4.976	853.001	38.875
U:geo	62130	4.987	1216.688	83.655
U:news	11787	4.99	849.527	44.002
U:obj1	462941	4.989	1499.9	57.445
U:obj2	22260	4.981	1051.911	39.334
U:paper1	106923	4.982	1088.062	43.538
U:paper2	57808	4.986	908.805	43.846
U:paper3	115898	4.983	1032.071	49.222
U:paper4	598823	4.99	1499.9	56.255
U:paper5	664983	4.985	1499.9	56.266
U:paper6	188691	4.985	1375.486	44.821
U:pic	21148	4.988	1499.9	13.094
U:progc	178490	4.984	1352.785	43.549
U:progl	100750	4.988	1380.043	28.953
U:progp	187777	4.985	1499.9	29.101
U:trans	88442	4.983	1499.9	24.753

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	12020	4.986	255.78	39.534
U:book1	1454	4.981	214.008	53.581
U:book2	2006	4.988	234.275	42.955
U:geo	8543	4.982	167.45	79.199
U:news	3130	4.986	225.78	45.733
U:obj1	49551	4.985	203.85	54.157
U:obj2	5146	4.986	242.936	39.541
U:paper1	22799	4.986	231.812	44.164
U:paper2	14263	4.984	224.332	47.04
U:paper3	24499	4.988	217.912	50.217
U:paper4	88438	4.981	224.946	52.928
U:paper5	99431	4.987	227.317	52.434
U:paper6	31898	4.979	232.806	43.923
U:pic	5165	4.979	507.768	14.781
U:progc	30957	4.987	234.485	42.041
U:progl	22125	4.984	303.325	28.846
U:progp	33818	4.984	319.5	28.237
U:trans	19804	4.986	354.921	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	11986	4.987	255.036	31.657
U:book1	1394	4.983	205.109	40.789
U:book2	2025	4.985	236.626	33.831
U:geo	7766	4.987	152.068	66.823
U:news	2979	4.987	214.842	38.396
U:obj1	50528	4.982	207.977	47.949
U:obj2	5208	4.984	245.975	33.02
U:paper1	23092	4.984	234.873	34.898
U:paper2	14478	4.983	227.759	36.198
U:paper3	24347	4.984	216.749	38.843
U:paper4	83863	4.984	213.195	41.48
U:paper5	94268	4.984	215.62	41.576
U:paper6	32267	4.985	235.225	34.893
U:pic	5389	4.984	529.2	11.001
U:progc	31715	4.987	240.26	33.67
U:progl	23889	4.983	327.548	22.68
U:progp	34655	4.988	327.183	22.726
U:trans	20624	4.984	369.76	20.32

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	1416	4.981	30.161	24.615
U:book1	172	4.992	25.26	33.322
U:book2	242	5.007	28.154	28.307
U:geo	1152	4.985	22.568	55.537
U:news	354	4.992	25.504	33.564
U:obj1	5279	4.98	21.738	50.219
U:obj2	612	4.995	28.837	31.825
U:paper1	2685	4.989	27.287	31.156
U:paper2	1744	4.988	27.408	30.506
U:paper3	2892	4.986	25.736	34.086
U:paper4	9397	4.989	23.864	39.049
U:paper5	10227	4.979	23.416	40.43
U:paper6	3740	4.986	27.26	32.295
U:pic	636	4.984	62.45	9.696
U:progc	3570	4.984	27.06	31.648
U:progl	2453	4.988	33.603	21.743
U:progp	3594	4.988	33.928	21.748
U:trans	1995	4.985	35.759	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	1696	4.991	36.054	27.453
U:book1	227	4.976	33.446	33.96
U:book2	326	4.99	38.063	27.794
U:geo	870	4.986	17.04	51.952
U:news	450	4.991	32.428	31.514
U:obj1	5566	4.987	22.889	43.694
U:obj2	769	4.989	36.282	24.871
U:paper1	3008	4.987	30.577	32.43
U:paper2	1955	4.987	30.73	33.086
U:paper3	3118	4.987	27.739	36.61
U:paper4	9536	4.982	24.254	40.351
U:paper5	10512	4.982	24.054	40.572
U:paper6	4082	4.983	29.772	32.712
U:pic	973	4.984	95.553	7.96
U:progc	4029	4.984	30.537	31.597
U:progl	3265	4.986	44.746	20.829
U:progp	4746	4.983	44.851	20.881
U:trans	2858	4.984	51.237	17.76

Results Per Test

Generated using Japex version 1.2.2