Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

configFile: tests-calgary-uncompress.xml
chartType: barchart
dateTime: 01 Aug 2017/19:16:27 CDT
hostName: arlab182
inputDir: testdata/calgary
numberOfCpus: 72
numberOfThreads: 1
osArchitecture: amd64
osName: Linux
plotDrivers: false
plotGroupSize: 6
reportsDirectory: reports/calgary-uncompress
resultAxis: normal
resultAxisX: normal
resultUnit: TPS
resultUnitX: Size%
runTime: 30
runsPerDriver: 1
singleClassLoader: false
version: 1.2.2
vmInfo: Oracle Corporation 25.131-b11
warmupTime: 7
warmupsPerDriver: 0

Result Summary (TPS)

driver	resultAritMean	resultAritMeanX	resultGeomMean	resultGeomMeanX	resultHarmMean	resultHarmMeanX	singleClassLoader
LZ4 (JNI)/block	1386.117	53.909	1381.261	51.128	1376.197	47.408	n/a
LZ4 (Java+Unsafe)/block	799.717	53.909	756.272	51.128	721.287	47.408	n/a
Snappy(JNI)/block	812.887	53.415	777.741	50.708	749.852	47.351	true
Snappy(iq80)/block	645.937	54.646	612.386	52.052	587.984	48.678	n/a
LZF/block	589.845	52.406	580.899	49.898	571.703	46.429	n/a
LZF/stream	516.425	52.406	508.885	49.898	501.149	46.429	n/a
LZO-java/block	230.555	52.669	216.279	49.904	205.952	46.405	n/a
LZ4 HC (JNI)/block	1488.731	43.336	1488.319	40.538	1487.885	37.137	n/a
QuickLZ/L3/block	205.278	43.566	200.548	41.12	196.84	38.154	n/a
Gzip/JDK/stream	159.587	35.042	153.748	32.894	149	30.274	n/a
BZip2/stream	17.495	31.604	16.825	29.668	16.368	27.289	n/a
LZMA-orig/block	24.53	30.89	22.594	28.822	21.227	25.945	n/a

Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	404855	29.972	1433.26	52.188
U:book1	46522	29.969	1138.089	66.935
U:book2	63730	29.961	1239.16	55.369
U:geo	946143	29.963	1499.9	94.88
U:news	110731	29.976	1328.524	57.691
U:obj1	3342682	29.973	1499.9	60.124
U:obj2	176923	29.956	1390.198	48.723
U:paper1	777989	29.968	1316.143	54.433
U:paper2	470894	29.974	1231.518	59.109
U:paper3	818587	29.969	1211.969	60.822
U:paper4	3305466	29.974	1397.273	63.789
U:paper5	3832409	29.951	1458.716	62.406
U:paper6	1145586	29.974	1388.89	54.095
U:pic	122513	29.975	1499.9	16.821
U:progc	1124577	29.981	1416.971	52.781
U:progl	686076	29.966	1499.9	39.459
U:progp	1089680	29.933	1499.9	37.913
U:trans	614358	29.954	1499.9	32.833

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4JavaUnsafeDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	145220	29.944	514.582	52.188
U:book1	21484	29.933	526.212	66.935
U:book2	29810	29.961	579.613	55.369
U:geo	868873	29.978	1499.9	94.88
U:news	49339	29.981	591.856	57.691
U:obj1	2070739	29.984	1416.304	60.124
U:obj2	83054	29.966	652.374	48.723
U:paper1	364268	29.977	616.054	54.433
U:paper2	208272	29.961	544.927	59.109
U:paper3	392546	29.984	580.891	60.822
U:paper4	2226691	29.986	940.888	63.789
U:paper5	2639861	29.926	1005.649	62.406
U:paper6	558394	29.972	677.038	54.095
U:pic	70275	29.969	1147.711	16.821
U:progc	540728	29.977	681.399	52.781
U:progl	319675	29.972	728.771	39.459
U:progp	532282	29.943	837.127	37.913
U:trans	286453	29.985	853.609	32.833

Driver: Snappy(JNI)/block

Snappy-JNI, block mode

classPath: build/classes lib/snappy/*.jar
driverClass: com.ning.jcbm.snappy.SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	191369	29.964	677.664	52.256
U:book1	21611	29.966	528.742	66.224
U:book2	32698	29.981	635.359	54.734
U:geo	2044276	29.977	1499.9	97.698
U:news	53719	29.964	644.758	57.983
U:obj1	1772901	29.95	1213.954	61.658
U:obj2	96102	29.972	754.718	49.091
U:paper1	394249	29.956	667.231	52.935
U:paper2	237486	29.974	621.089	57.305
U:paper3	409149	29.978	605.585	59.932
U:paper4	1542998	29.984	652.031	61.561
U:paper5	1784252	29.984	678.397	61.151
U:paper6	570142	29.983	691.01	52.851
U:pic	81224	29.938	1327.873	18.115
U:progc	555156	29.983	699.438	51.006
U:progl	373377	29.981	850.938	36.993
U:progp	589895	29.976	926.699	35.523
U:trans	320925	29.978	956.573	34.449

Driver: Snappy(iq80)/block

Snappy-Java, block mode

classPath: build/classes lib/iq80-snappy/*.jar
driverClass: com.ning.jcbm.iq80snappy.Iq80SnappyDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	145625	29.965	515.656	55.445
U:book1	16138	29.957	394.961	68.25
U:book2	24291	29.985	471.935	56.758
U:geo	531531	29.982	1499.9	95.636
U:news	40128	29.963	481.646	59.775
U:obj1	1154139	29.925	790.944	61.221
U:obj2	71088	29.97	558.308	49.794
U:paper1	314551	29.984	531.852	55.332
U:paper2	181007	29.978	473.323	59.339
U:paper3	327328	29.977	484.5	62.006
U:paper4	1360262	29.972	575.039	61.749
U:paper5	1532480	29.98	582.734	60.842
U:paper6	468678	29.972	568.245	53.906
U:pic	58902	29.982	961.53	18.21
U:progc	456285	29.959	575.344	52.258
U:progl	306912	29.976	699.574	37.93
U:progp	490550	29.981	770.518	37.121
U:trans	231807	29.981	690.865	38.058

Driver: LZF/block

LZF, block mode

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	145865	29.955	516.691	53.879
U:book1	20428	29.971	499.715	62.646
U:book2	26675	29.981	518.32	54.603
U:geo	117106	29.983	381.417	90.913
U:news	39564	29.969	474.788	56.899
U:obj1	966494	29.975	661.232	61.142
U:obj2	63349	29.981	497.357	49.693
U:paper1	340506	29.98	575.818	52.725
U:paper2	203342	29.984	531.616	56.491
U:paper3	365039	29.984	540.195	57.918
U:paper4	1681777	29.958	711.293	58.513
U:paper5	1943196	29.932	740.11	58.357
U:paper6	510266	29.962	618.89	51.815
U:pic	37428	29.977	611.102	16.283
U:progc	479104	29.975	603.783	50.307
U:progl	307391	29.974	700.705	37.134
U:progp	492565	29.978	773.767	35.77
U:trans	221539	29.975	660.405	38.221

Driver: LZF/stream

LZF, streaming

classPath: build/classes lib/lzf/*.jar
driverClass: com.ning.jcbm.lzf.LzfDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	140729	29.98	498.072	53.879
U:book1	15827	29.973	387.133	62.646
U:book2	23147	29.954	450.169	54.603
U:geo	107576	29.967	350.564	90.913
U:news	35356	29.974	424.219	56.899
U:obj1	843771	29.955	577.66	61.142
U:obj2	57400	29.979	450.682	49.693
U:paper1	294126	29.965	497.631	52.725
U:paper2	175667	29.974	459.418	56.491
U:paper3	311673	29.949	461.757	57.918
U:paper4	1453967	29.974	614.626	58.513
U:paper5	1676150	29.978	637.426	58.357
U:paper6	434684	29.963	527.187	51.815
U:pic	35403	29.964	578.277	16.283
U:progc	417446	29.961	526.325	50.307
U:progl	265711	29.975	605.683	37.134
U:progp	426856	29.973	670.638	35.77
U:trans	193970	29.977	578.184	38.221

Driver: LZO-java/block

LZO-java, block mode

classPath: build/classes lib/lzo-java/*.jar
driverClass: com.ning.jcbm.lzo.LzoJavaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	49213	29.957	174.312	52.3
U:book1	6081	29.968	148.768	64.587
U:book2	8322	29.967	161.778	54.299
U:geo	154291	29.978	502.618	98.392
U:news	14738	29.974	176.834	57.396
U:obj1	509456	29.974	348.568	60.114
U:obj2	26329	29.973	206.762	47.691
U:paper1	101086	29.976	170.964	53.024
U:paper2	60982	29.969	159.513	56.682
U:paper3	108168	29.972	160.13	58.363
U:paper4	524825	29.97	221.882	60.477
U:paper5	615662	29.968	234.202	59.637
U:paper6	148749	29.955	180.455	51.382
U:pic	25669	29.973	419.16	16.991
U:progc	145559	29.959	183.537	49.966
U:progl	94979	29.98	216.463	37.346
U:progp	148677	29.96	233.695	34.899
U:trans	83970	29.971	250.345	34.505

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

classPath: build/classes lib/lz4/*.jar
driverClass: com.ning.jcbm.lz4.Lz4HcJNIDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	468326	29.979	1499.9	36.093
U:book1	55483	29.971	1357.247	47.247
U:book2	77012	29.973	1496.83	38.875
U:geo	459642	29.962	1498.104	83.655
U:news	120555	29.976	1446.383	44.002
U:obj1	3536501	29.94	1499.9	57.445
U:obj2	198450	29.984	1499.9	39.334
U:paper1	991705	29.977	1499.9	43.538
U:paper2	594055	29.979	1499.9	43.846
U:paper3	1023826	29.984	1499.9	49.222
U:paper4	3836818	29.982	1499.9	56.255
U:paper5	4323727	29.982	1499.9	56.266
U:paper6	1412119	29.983	1499.9	44.821
U:pic	174024	29.938	1499.9	13.094
U:progc	1396486	29.971	1499.9	43.549
U:progl	840566	29.972	1499.9	28.953
U:progp	1504959	29.978	1499.9	29.101
U:trans	700566	29.975	1499.9	24.753

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

classPath: build/classes
driverClass: com.ning.jcbm.quicklz.QuickLZDriver3
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	56434	29.977	199.757	39.534
U:book1	7049	29.981	172.378	53.581
U:book2	9619	29.984	186.885	42.955
U:geo	48987	29.975	159.595	79.199
U:news	14798	29.978	177.529	45.733
U:obj1	302767	29.982	207.097	54.157
U:obj2	24421	29.952	191.914	39.541
U:paper1	103514	29.974	175.086	44.164
U:paper2	65021	29.976	170.041	47.04
U:paper3	110449	29.973	163.505	50.217
U:paper4	475552	29.968	201.062	52.928
U:paper5	564678	29.972	214.784	52.434
U:paper6	146972	29.979	178.158	43.923
U:pic	23155	29.977	378.058	14.781
U:progc	144063	29.962	181.631	42.041
U:progl	101628	29.97	231.698	28.846
U:progp	152285	29.969	239.288	28.237
U:trans	89382	29.965	266.529	24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

classPath: build/classes
driverClass: com.ning.jcbm.gzip.JDKGzipDriver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	44529	29.965	157.677	31.657
U:book1	5515	29.973	134.899	40.789
U:book2	7813	29.968	151.882	33.831
U:geo	28398	29.97	92.534	66.823
U:news	11180	29.973	134.148	38.396
U:obj1	178495	29.976	122.118	47.949
U:obj2	19048	29.965	149.624	33.02
U:paper1	86464	29.963	146.299	34.898
U:paper2	55603	29.971	145.434	36.198
U:paper3	92177	29.971	136.464	38.843
U:paper4	314488	29.974	132.939	41.48
U:paper5	355339	29.976	135.14	41.576
U:paper6	119132	29.971	144.447	34.893
U:pic	19482	29.973	318.134	11.001
U:progc	115644	29.973	145.748	33.67
U:progl	88022	29.969	200.684	22.68
U:progp	126727	29.973	199.106	22.726
U:trans	75554	29.966	225.292	20.32

Driver: BZip2/stream

Commons-compress BZip2 implementation

classPath: build/classes lib/jakarta/*.jar
driverClass: com.ning.jcbm.bzip2.BZip2Driver
streaming: true

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	4697	29.977	16.626	24.615
U:book1	580	29.984	14.182	33.322
U:book2	808	29.979	15.701	28.307
U:geo	3889	29.978	12.669	55.537
U:news	1187	29.974	14.242	33.564
U:obj1	19305	29.977	13.207	50.219
U:obj2	2123	29.979	16.669	31.825
U:paper1	9994	29.969	16.907	31.156
U:paper2	6011	29.969	15.723	30.506
U:paper3	10817	29.967	16.016	34.086
U:paper4	32963	29.969	13.936	39.049
U:paper5	35829	29.984	13.623	40.43
U:paper6	13730	29.972	16.647	32.295
U:pic	2457	29.963	40.135	9.696
U:progc	13290	29.971	16.751	31.648
U:progl	8922	29.975	20.337	21.743
U:progp	13227	29.964	20.788	21.748
U:trans	6963	29.974	20.757	19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

classPath: build/classes lib/lzma/*.jar
driverClass: com.ning.jcbm.lzma.LzmaDriver
streaming: n/a

testCase	resultIterations	resultTime	resultValue	resultValueX
U:bib	6755	29.979	23.909	27.453
U:book1	935	29.99	22.857	33.96
U:book2	1336	29.98	25.961	27.794
U:geo	3615	29.97	11.779	51.952
U:news	1810	29.974	21.717	31.514
U:obj1	21874	29.973	14.966	43.694
U:obj2	3088	29.979	24.246	24.871
U:paper1	12159	29.964	20.573	32.43
U:paper2	8011	29.975	20.951	33.086
U:paper3	12482	29.957	18.488	36.61
U:paper4	37792	29.971	15.977	40.351
U:paper5	41634	29.966	15.839	40.572
U:paper6	16437	29.966	19.933	32.712
U:pic	4213	29.971	68.801	7.96
U:progc	16148	29.972	20.353	31.597
U:progl	13361	29.975	30.456	20.829
U:progp	19240	29.967	30.235	20.881
U:trans	11572	29.971	34.5	17.76

Results Per Test

Generated using Japex version 1.2.2