Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-uncompress.xml
chartType: barchart
dateTime: 26 Nov 2014/19:15:05 CET
hostName: zreptik4
inputDir: testdata/calgary
numberOfCpus: 8
numberOfThreads: 1
osArchitecture: amd64
osName: Linux
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 5
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 25.25-b02
warmupTime: 2
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	1499.9	53.909	1499.9	51.128	1499.9	47.408	n/a
LZ4 (Java+Unsafe)/block	1097.955	53.909	1067.418	51.128	1038.499	47.408	n/a
Snappy(JNI)/block	1156.397	54.646	1136.246	52.052	1116.86	48.678	true
Snappy(iq80)/block	960.444	54.646	931.432	52.052	905.647	48.678	n/a
LZF/block	928.831	52.406	914.328	49.898	899.668	46.429	n/a
LZF/stream	877.24	52.406	864.636	49.898	851.876	46.429	n/a
LZO-java/block	390.015	52.669	351.391	49.904	327.858	46.405	n/a
LZ4 HC (JNI)/block	1499.9	43.336	1499.9	40.538	1499.9	37.137	n/a
LZ4 HC (Java+Unsafe)/block	1189.68	43.336	1163.542	40.538	1137.995	37.137	n/a
QuickLZ/L3/block	256.23	43.566	247.995	41.12	241.692	38.154	n/a
Gzip/JDK/stream	255.843	35.042	245.691	32.894	237.616	30.274	n/a
BZip2/stream	29.615	31.604	28.577	29.668	27.854	27.289	n/a
LZMA-orig/block	37.859	30.89	35.321	28.822	33.426	25.945	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	105386	4.99	1499.9	52.188
U:book1	11868	4.989	1499.9	66.935
U:book2	16238	4.989	1499.9	55.369
U:geo	313622	4.991	1499.9	94.88
U:news	28730	4.981	1499.9	57.691
U:obj1	866577	4.989	1499.9	60.124
U:obj2	46590	4.99	1499.9	48.723
U:paper1	199804	4.984	1499.9	54.433
U:paper2	118989	4.989	1499.9	59.109
U:paper3	206233	4.983	1499.9	60.822
U:paper4	842986	4.989	1499.9	63.789
U:paper5	977542	4.984	1499.9	62.406
U:paper6	285005	4.988	1499.9	54.095
U:pic	32447	4.99	1499.9	16.821
U:progc	287699	4.988	1499.9	52.781
U:progl	184526	4.99	1499.9	39.459
U:progp	281405	4.988	1499.9	37.913
U:trans	170497	4.988	1499.9	32.833

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	41364	4.988	879.986	52.188
U:book1	4920	4.986	723.501	66.935
U:book2	6833	4.977	799.85	55.369
U:geo	159256	4.985	1499.9	94.88
U:news	12171	4.991	877.097	57.691
U:obj1	485861	4.988	1499.9	60.124
U:obj2	20455	4.99	964.948	48.723
U:paper1	89469	4.989	909.187	54.433
U:paper2	52943	4.99	831.681	59.109
U:paper3	96998	4.986	863.251	60.822
U:paper4	551616	4.988	1401.229	63.789
U:paper5	623786	4.981	1427.571	62.406
U:paper6	138130	4.982	1007.527	54.095
U:pic	15535	4.99	1499.9	16.821
U:progc	133351	4.985	1010.504	52.781
U:progl	80908	4.988	1108.228	39.459
U:progp	126422	4.984	1194.565	37.913
U:trans	70581	4.988	1264.37	32.833

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	48347	4.983	1029.423	55.445
U:book1	5442	4.984	800.51	68.25
U:book2	8071	4.989	942.505	56.758
U:geo	190556	4.988	1499.9	95.636
U:news	14014	4.989	1010.314	59.775
U:obj1	431256	4.991	1499.9	61.221
U:obj2	24580	4.991	1159.273	49.794
U:paper1	100983	4.989	1026.161	55.332
U:paper2	58804	4.988	924.103	59.339
U:paper3	104380	4.974	931.147	62.006
U:paper4	420290	4.988	1067.625	61.749
U:paper5	496533	4.99	1134.282	60.842
U:paper6	149444	4.984	1089.54	53.906
U:pic	19790	4.99	1499.9	18.21
U:progc	145577	4.988	1102.403	52.258
U:progl	89380	4.989	1224.185	37.93
U:progp	151966	4.982	1436.549	37.121
U:trans	80251	4.989	1437.432	38.058

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	38091	4.986	810.634	55.445
U:book1	4233	4.984	622.734	68.25
U:book2	6343	4.988	740.807	56.758
U:geo	145809	4.989	1499.9	95.636
U:news	10512	4.986	758.207	59.775
U:obj1	301475	4.989	1239.28	61.221
U:obj2	18442	4.989	870.174	49.794
U:paper1	80326	4.988	816.482	55.332
U:paper2	46872	4.987	736.757	59.339
U:paper3	82369	4.985	733.205	62.006
U:paper4	357425	4.983	908.889	61.749
U:paper5	405574	4.987	927.056	60.842
U:paper6	119363	4.987	869.704	53.906
U:pic	15370	4.982	1499.9	18.21
U:progc	117258	4.984	888.773	52.258
U:progl	78256	4.987	1072.223	37.93
U:progp	124135	4.988	1171.97	37.121
U:trans	62582	4.987	1121.299	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	37721	4.975	804.436	53.879
U:book1	4911	4.963	725.518	62.646
U:book2	6860	4.983	802.044	54.603
U:geo	32224	4.988	630.888	90.913
U:news	10378	4.99	747.943	56.899
U:obj1	271790	4.98	1119.317	61.142
U:obj2	16935	4.982	800.061	49.693
U:paper1	88292	4.988	897.317	52.725
U:paper2	52112	4.988	819.048	56.491
U:paper3	94029	4.987	836.627	57.918
U:paper4	441613	4.986	1122.158	58.513
U:paper5	515177	4.988	1177.42	58.357
U:paper6	131107	4.986	955.618	51.815
U:pic	10326	4.988	1013.139	16.283
U:progc	125670	4.987	951.856	50.307
U:progl	79056	4.988	1082.836	37.134
U:progp	123510	4.987	1166.214	35.77
U:trans	59540	4.988	1066.511	38.221

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	36310	4.986	772.68	53.879
U:book1	4794	4.986	704.943	62.646
U:book2	6617	4.988	772.873	54.603
U:geo	30291	4.981	593.827	90.913
U:news	9995	4.99	720.413	56.899
U:obj1	255010	4.989	1048.336	61.142
U:obj2	16226	4.99	765.349	49.693
U:paper1	82035	4.986	834.169	52.725
U:paper2	50047	4.988	786.555	56.491
U:paper3	88913	4.989	790.755	57.918
U:paper4	422856	4.991	1073.595	58.513
U:paper5	486891	4.984	1113.779	58.357
U:paper6	121806	4.99	887.054	51.815
U:pic	9714	4.986	953.623	16.283
U:progc	115708	4.986	876.718	50.307
U:progl	73990	4.989	1013.391	37.134
U:progp	114004	4.987	1076.529	35.77
U:trans	56149	4.989	1005.736	38.221

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	12864	4.974	274.405	52.3
U:book1	1547	4.979	227.812	64.587
U:book2	2111	4.989	246.512	54.299
U:geo	60074	4.989	1175.839	98.392
U:news	3796	4.988	273.703	57.396
U:obj1	149507	4.986	614.894	60.114
U:obj2	6784	4.987	320.184	47.691
U:paper1	26234	4.987	266.687	53.024
U:paper2	15703	4.989	246.732	56.682
U:paper3	28330	4.99	251.888	58.363
U:paper4	146468	4.987	372.105	60.477
U:paper5	179185	4.988	409.534	59.637
U:paper6	39020	4.988	284.272	51.382
U:pic	6740	4.99	661.142	16.991
U:progc	38678	4.985	293.09	49.966
U:progl	24298	4.989	332.782	37.346
U:progp	39448	4.987	372.477	34.899
U:trans	22108	4.986	396.207	34.505

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	129172	4.988	1499.9	36.093
U:book1	14029	4.98	1499.9	47.247
U:book2	19714	4.988	1499.9	38.875
U:geo	137056	4.983	1499.9	83.655
U:news	31048	4.988	1499.9	44.002
U:obj1	925574	4.988	1499.9	57.445
U:obj2	52729	4.992	1499.9	39.334
U:paper1	254314	4.986	1499.9	43.538
U:paper2	151339	4.987	1499.9	43.846
U:paper3	260414	4.989	1499.9	49.222
U:paper4	981226	4.989	1499.9	56.255
U:paper5	1098827	4.989	1499.9	56.266
U:paper6	362366	4.986	1499.9	44.821
U:pic	47399	4.987	1499.9	13.094
U:progc	358661	4.988	1499.9	43.549
U:progl	248155	4.984	1499.9	28.953
U:progp	397631	4.988	1499.9	29.101
U:trans	213094	4.985	1499.9	24.753

Driver: LZ4 HC (Java+Unsafe)/block

LZ4 HC (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	48604	4.984	1034.835	36.093
U:book1	5668	4.983	833.936	47.247
U:book2	7753	4.983	906.328	38.875
U:geo	65491	4.987	1282.511	83.655
U:news	12588	4.99	907.297	44.002
U:obj1	457784	4.984	1499.9	57.445
U:obj2	23238	4.988	1096.525	39.334
U:paper1	97288	4.987	988.971	43.538
U:paper2	58392	4.981	918.916	43.846
U:paper3	103748	4.989	922.779	49.222
U:paper4	617461	4.986	1499.9	56.255
U:paper5	697241	4.987	1499.9	56.266
U:paper6	149512	4.988	1089.285	44.821
U:pic	21337	4.981	1499.9	13.094
U:progc	148370	4.984	1124.598	43.549
U:progl	95523	4.987	1308.856	28.953
U:progp	159801	4.988	1499.9	29.101
U:trans	87649	4.98	1499.9	24.753

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	11941	4.986	254.091	39.534
U:book1	1435	4.98	211.267	53.581
U:book2	1960	4.987	228.977	42.955
U:geo	8604	4.983	168.628	79.199
U:news	3046	4.99	219.545	45.733
U:obj1	52222	4.985	214.819	54.157
U:obj2	5030	4.986	237.437	39.541
U:paper1	22594	4.988	229.646	44.164
U:paper2	13971	4.987	219.612	47.04
U:paper3	24146	4.985	214.9	50.217
U:paper4	88822	4.983	225.841	52.928
U:paper5	100318	4.983	229.501	52.434
U:paper6	31767	4.99	231.358	43.923
U:pic	5206	4.989	510.74	14.781
U:progc	31178	4.988	236.118	42.041
U:progl	22342	4.989	306.012	28.846
U:progp	33661	4.99	317.688	28.237
U:trans	19872	4.988	355.954	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	11903	4.986	253.322	31.657
U:book1	1385	4.99	203.503	40.789
U:book2	2009	4.986	234.719	33.831
U:geo	7533	4.985	147.576	66.823
U:news	2951	4.988	212.776	38.396
U:obj1	49951	4.986	205.438	47.949
U:obj2	5163	4.991	243.491	33.02
U:paper1	22908	4.986	232.931	34.898
U:paper2	14383	4.991	225.896	36.198
U:paper3	24080	4.988	214.216	38.843
U:paper4	82692	4.986	210.143	41.48
U:paper5	92763	4.987	212.073	41.576
U:paper6	32008	4.981	233.5	34.893
U:pic	5347	4.989	524.597	11.001
U:progc	31208	4.983	236.606	33.67
U:progl	23527	4.986	322.403	22.68
U:progp	34466	4.987	325.454	22.726
U:trans	20457	4.987	366.528	20.32

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	1447	4.983	30.815	24.615
U:book1	173	4.995	25.393	33.322
U:book2	241	4.997	28.098	28.307
U:geo	1140	4.988	22.321	55.537
U:news	357	4.985	25.757	33.564
U:obj1	5221	4.989	21.463	50.219
U:obj2	606	4.992	28.575	31.825
U:paper1	2668	4.988	27.116	31.156
U:paper2	1742	4.985	27.393	30.506
U:paper3	2907	4.989	25.855	34.086
U:paper4	9353	4.989	23.755	39.049
U:paper5	10166	4.986	23.243	40.43
U:paper6	3670	4.987	26.743	32.295
U:pic	668	4.988	65.54	9.696
U:progc	3542	4.986	26.834	31.648
U:progl	2459	4.989	33.676	21.743
U:progp	3605	4.985	34.054	21.748
U:trans	2034	4.988	36.438	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	1766	4.99	37.548	27.453
U:book1	235	4.995	34.494	33.96
U:book2	346	4.996	40.342	27.794
U:geo	952	4.988	18.638	51.952
U:news	473	4.993	34.073	31.514
U:obj1	5871	4.99	24.128	43.694
U:obj2	798	4.985	37.68	24.871
U:paper1	3184	4.986	32.378	32.43
U:paper2	2093	4.987	32.903	33.086
U:paper3	3293	4.986	29.303	36.61
U:paper4	10177	4.986	25.86	40.351
U:paper5	11278	4.983	25.8	40.572
U:paper6	4327	4.986	31.536	32.712
U:pic	990	4.986	97.184	7.96
U:progc	4274	4.985	32.388	31.597
U:progl	3421	4.985	46.886	20.829
U:progp	4949	4.991	46.696	20.881
U:trans	2996	4.992	53.622	17.76

Results Per Test

Generated using Japex version 1.2.2