Japex Report: Test suite for JVM compressors

Description

Micro-benchmark for testing performance of compressors on JVM platform

Global Parameters

Result Summary (TPS)

driver resultAritMean resultAritMeanX resultGeomMean resultGeomMeanX resultHarmMean resultHarmMeanX singleClassLoader
LZ4 (JNI)/block 1493.166 53.919 1488.871 51.136 1484.487 47.415 n/a
LZ4 HC (JNI)/block 1496.991 43.336 1490.656 40.538 1483.951 37.137 n/a
LZ4 (Java+Unsafe)/block 995.354 53.919 950.67 51.136 908.318 47.415 n/a
LZ4 HC (Java+Unsafe)/block 1022.433 43.336 987.535 40.538 954.659 37.137 n/a
LZ4 (Java)/block 613.974 53.919 582.618 51.136 559.472 47.415 n/a
LZ4 HC (Java)/block 647.483 43.336 633.454 40.538 619.944 37.137 n/a
Snappy(JNI)/block 945.618 54.646 911.108 52.052 881.16 48.678 true
Snappy(iq80)/block 811.961 54.646 777.416 52.052 748.943 48.678 n/a
LZF/block 581.234 52.407 572.38 49.899 563.201 46.429 n/a
LZF/stream 548.238 52.407 542.559 49.899 536.719 46.429 n/a
LZO-java/block 293.903 52.669 269.519 49.904 253.51 46.405 n/a
LZO-java/stream 298.671 52.669 272.159 49.904 255.24 46.405 n/a
QuickLZ/L1/block 148.472 50.391 143.798 47.878 140.214 44.619 n/a
QuickLZ/L3/block 187.595 43.566 181.872 41.12 177.462 38.154 n/a
Gzip/JDK/stream 210.109 35.042 202.26 32.894 195.913 30.274 n/a
Gzip/jzlib/stream 95.82 35.346 90.658 33.221 86.604 30.622 n/a
BZip2/stream 21.595 31.604 20.892 29.668 20.396 27.289 n/a
LZMA-orig/block 26.804 30.89 24.885 28.822 23.471 25.945 n/a
LZMA-java/stream 7.747 31.87 7.239 29.829 6.768 26.938 n/a




Driver: LZ4 (JNI)/block

LZ4 (JNI), block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 196321 14.982 1390.399 52.188
U:book1 26872 14.985 1314.765 66.935
U:book2 33290 14.985 1294.224 55.37
U:geo 708240 14.981 1599.9 94.989
U:news 57986 14.982 1391.949 57.688
U:obj1 2097158 14.971 1599.9 60.152
U:obj2 90962 14.979 1429.405 48.723
U:paper1 428280 14.987 1448.831 54.433
U:paper2 260180 14.982 1361.385 59.097
U:paper3 462144 14.979 1368.976 60.822
U:paper4 1973566 14.978 1599.9 63.812
U:paper5 2295081 14.974 1599.9 62.406
U:paper6 640283 14.982 1553.095 54.095
U:pic 66334 14.98 1599.9 16.822
U:progc 630697 14.985 1589.89 52.781
U:progl 336575 14.984 1534.771 39.459
U:progp 557400 14.986 1599.9 37.913
U:trans 288340 14.987 1599.9 32.864

Driver: LZ4 HC (JNI)/block

LZ4 HC (JNI), block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 188993 14.976 1339.078 36.093
U:book1 25656 14.98 1255.659 47.247
U:book2 31047 14.978 1207.541 38.875
U:geo 316706 14.982 1599.9 83.655
U:news 56458 14.98 1355.401 44.002
U:obj1 2191945 14.977 1599.9 57.445
U:obj2 93974 14.98 1476.573 39.334
U:paper1 443614 14.987 1500.653 43.538
U:paper2 254126 14.978 1330.042 43.846
U:paper3 500207 14.977 1481.888 49.222
U:paper4 2263868 14.985 1599.9 56.255
U:paper5 2604727 14.982 1599.9 56.266
U:paper6 694961 14.98 1599.9 44.821
U:pic 92666 14.983 1599.9 13.094
U:progc 669497 14.979 1599.9 43.549
U:progl 354884 14.984 1599.9 28.953
U:progp 602588 14.969 1599.9 29.101
U:trans 308021 14.978 1599.9 24.753

Driver: LZ4 (Java+Unsafe)/block

LZ4 (Java+Unsafe), block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 100367 14.986 710.66 52.188
U:book1 11510 14.986 563.114 66.935
U:book2 15868 14.983 616.959 55.37
U:geo 393592 14.986 1599.9 94.989
U:news 28378 14.982 681.225 57.688
U:obj1 1196311 14.983 1599.9 60.152
U:obj2 48848 14.98 767.532 48.723
U:paper1 250488 14.987 847.376 54.433
U:paper2 134705 14.981 704.855 59.097
U:paper3 267740 14.984 792.833 60.822
U:paper4 1286200 14.982 1087.771 63.812
U:paper5 1490684 14.978 1134.607 62.406
U:paper6 435072 14.986 1055.004 54.095
U:pic 38695 14.977 1264.525 16.822
U:progc 430494 14.983 1085.372 52.781
U:progl 222135 14.981 1013.118 39.459
U:progp 412080 14.978 1295.58 37.913
U:trans 183814 14.985 1096.045 32.864

Driver: LZ4 HC (Java+Unsafe)/block

LZ4 HC (Java+Unsafe), block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 114224 14.986 808.73 36.093
U:book1 13239 14.977 648.062 47.247
U:book2 18108 14.981 704.159 38.875
U:geo 156595 14.982 1020.724 83.655
U:news 29464 14.98 707.381 44.002
U:obj1 1111965 14.983 1521.971 57.445
U:obj2 55274 14.978 868.656 39.334
U:paper1 252060 14.984 852.854 43.538
U:paper2 140334 14.983 734.231 43.846
U:paper3 278577 14.984 824.898 49.222
U:paper4 1394438 14.983 1179.223 56.255
U:paper5 1567902 14.979 1193.301 56.266
U:paper6 433776 14.976 1052.568 44.821
U:pic 54988 14.981 1599.9 13.094
U:progc 415081 14.978 1046.904 43.549
U:progl 235875 14.98 1075.894 28.953
U:progp 418946 14.977 1317.235 29.101
U:trans 209001 14.975 1247.098 24.753

Driver: LZ4 (Java)/block

LZ4 (Java), block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 65968 14.974 467.452 52.188
U:book1 7774 14.979 380.491 66.935
U:book2 10955 14.984 425.922 55.37
U:geo 216932 14.982 1413.984 94.989
U:news 19283 14.974 463.141 57.688
U:obj1 588943 14.974 806.589 60.152
U:obj2 32226 14.984 506.219 48.723
U:paper1 147966 14.985 500.603 54.433
U:paper2 85113 14.973 445.606 59.097
U:paper3 161187 14.98 477.434 60.822
U:paper4 733053 14.981 620.003 63.812
U:paper5 840426 14.986 639.317 62.406
U:paper6 226942 14.976 550.686 54.095
U:pic 27023 14.974 883.253 16.822
U:progc 220661 14.982 556.392 52.781
U:progl 128478 14.98 586.013 39.459
U:progp 212391 14.986 667.409 37.913
U:trans 110785 14.975 661.024 32.864

Driver: LZ4 HC (Java)/block

LZ4 HC (Java), block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 77673 14.984 550.041 36.093
U:book1 9037 14.972 442.521 47.247
U:book2 12567 14.983 488.62 38.875
U:geo 100171 14.976 653.197 83.655
U:news 20082 14.979 482.171 44.002
U:obj1 582657 14.978 797.797 57.445
U:obj2 36065 14.972 566.988 39.334
U:paper1 170311 14.983 576.273 43.538
U:paper2 95779 14.987 500.996 43.846
U:paper3 186343 14.984 551.799 49.222
U:paper4 807619 14.982 682.996 56.255
U:paper5 902327 14.978 686.794 56.266
U:paper6 276262 14.978 670.249 44.821
U:pic 29460 14.976 962.782 13.094
U:progc 270725 14.976 682.897 43.549
U:progl 158372 14.977 722.52 28.953
U:progp 264867 14.983 832.483 29.101
U:trans 134744 14.983 803.576 24.753

Driver: Snappy(JNI)/block

Snappy-java, block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 109922 14.974 778.927 55.445
U:book1 12055 14.983 589.897 68.25
U:book2 17973 14.986 698.677 56.758
U:geo 483337 14.985 1599.9 95.636
U:news 31585 14.977 758.468 59.775
U:obj1 988185 14.972 1353.566 61.221
U:obj2 55644 14.971 874.886 49.794
U:paper1 229346 14.978 776.312 55.332
U:paper2 133174 14.977 697.037 59.339
U:paper3 237718 14.983 703.955 62.006
U:paper4 1055254 14.982 892.427 61.749
U:paper5 1225069 14.98 932.311 60.842
U:paper6 342740 14.986 831.14 53.906
U:pic 44498 14.981 1453.748 18.21
U:progc 341513 14.983 861.021 52.258
U:progl 220239 14.981 1004.47 37.93
U:progp 361299 14.985 1135.437 37.121
U:trans 180841 14.977 1078.948 38.058

Driver: Snappy(iq80)/block

Snappy-iq80, block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 93986 14.966 666.35 55.445
U:book1 10152 14.985 496.699 68.25
U:book2 15011 14.98 583.764 56.758
U:geo 369387 14.979 1599.9 95.636
U:news 25226 14.979 605.674 59.775
U:obj1 772002 14.985 1056.525 61.221
U:obj2 45014 14.985 707.087 49.794
U:paper1 196978 14.982 666.549 55.332
U:paper2 113667 14.978 594.905 59.339
U:paper3 203801 14.978 603.726 62.006
U:paper4 926755 14.984 783.649 61.749
U:paper5 1047821 14.982 797.326 60.842
U:paper6 299569 14.987 726.39 53.906
U:pic 37057 14.983 1210.537 18.21
U:progc 292458 14.985 737.276 52.258
U:progl 194367 14.981 886.495 37.93
U:progp 308547 14.979 970.017 37.121
U:trans 154707 14.986 922.424 38.058

Driver: LZF/block

LZF, block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 72334 14.975 512.522 53.88
U:book1 8800 14.985 430.549 62.647
U:book2 12673 14.98 492.842 54.604
U:geo 61569 14.985 401.253 90.913
U:news 18557 14.972 445.742 56.901
U:obj1 477509 14.985 653.499 61.142
U:obj2 32011 14.979 503.037 49.695
U:paper1 169991 14.982 575.25 52.725
U:paper2 104828 14.981 548.552 56.491
U:paper3 183627 14.982 543.825 57.918
U:paper4 785725 14.978 664.679 58.513
U:paper5 917006 14.987 697.556 58.357
U:paper6 248858 14.982 603.602 51.815
U:pic 21539 14.982 703.646 16.283
U:progc 236317 14.98 595.919 50.307
U:progl 151633 14.986 691.333 37.135
U:progp 228888 14.975 719.784 35.77
U:trans 113788 14.983 678.613 38.226

Driver: LZF/stream

LZF, streaming

testCase resultIterations resultTime resultValue resultValueX
U:bib 70218 14.978 497.427 53.88
U:book1 9737 14.969 476.894 62.647
U:book2 12824 14.977 498.819 54.604
U:geo 58575 14.985 381.728 90.913
U:news 18997 14.976 456.214 56.901
U:obj1 448596 14.975 614.337 61.142
U:obj2 30826 14.982 484.303 49.695
U:paper1 157998 14.98 534.73 52.725
U:paper2 98339 14.978 514.695 56.491
U:paper3 171046 14.977 506.743 57.918
U:paper4 676648 14.975 572.528 58.513
U:paper5 791665 14.979 602.528 58.357
U:paper6 228289 14.982 553.716 51.815
U:pic 20605 14.982 673.119 16.283
U:progc 217179 14.986 547.451 50.307
U:progl 142094 14.967 648.69 37.135
U:progp 212474 14.985 667.714 35.77
U:trans 106713 14.977 636.653 38.226

Driver: LZO-java/block

LZO-java, block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 29871 14.98 211.579 52.3
U:book1 3622 14.986 177.202 64.587
U:book2 4977 14.973 193.636 54.299
U:geo 123157 14.981 802.843 98.392
U:news 8803 14.984 211.286 57.396
U:obj1 337043 14.985 461.269 60.114
U:obj2 15733 14.983 247.167 47.691
U:paper1 61615 14.981 208.515 53.024
U:paper2 36427 14.98 190.628 56.682
U:paper3 66309 14.986 196.328 58.363
U:paper4 348653 14.984 294.822 60.477
U:paper5 424027 14.982 322.662 59.637
U:paper6 90321 14.977 219.158 51.382
U:pic 14375 14.98 469.659 16.991
U:progc 89721 14.979 226.271 49.966
U:progl 57707 14.978 263.248 37.346
U:progp 91651 14.985 288.028 34.899
U:trans 51310 14.985 305.957 34.505

Driver: LZO-java/stream

LZO-java, streaming

testCase resultIterations resultTime resultValue resultValueX
U:bib 30246 14.982 214.21 52.3
U:book1 3719 14.975 182.074 64.587
U:book2 5033 14.979 195.744 54.299
U:geo 128997 14.985 840.662 98.392
U:news 8983 14.969 215.823 57.396
U:obj1 349516 14.985 478.338 60.114
U:obj2 15923 14.986 250.102 47.691
U:paper1 61303 14.984 207.412 53.024
U:paper2 36870 14.982 192.912 56.682
U:paper3 65432 14.981 193.795 58.363
U:paper4 350633 14.986 296.452 60.477
U:paper5 436563 14.985 332.121 59.637
U:paper6 88971 14.976 215.893 51.382
U:pic 15022 14.986 490.625 16.991
U:progc 89915 14.976 226.811 49.966
U:progl 57181 14.982 260.779 37.346
U:progp 89378 14.981 280.957 34.899
U:trans 50494 14.971 301.366 34.505

Driver: QuickLZ/L1/block

QuickLZ (level 1), block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 19593 14.984 138.749 48.719
U:book1 2524 14.982 123.517 60.88
U:book2 3477 14.983 135.193 51.648
U:geo 15000 14.981 97.783 85.732
U:news 5301 14.987 127.207 53.256
U:obj1 90498 14.985 123.853 59.561
U:obj2 9157 14.978 143.906 45.079
U:paper1 39504 14.985 133.656 52.253
U:paper2 24598 14.984 128.692 55.485
U:paper3 42391 14.973 125.624 58.277
U:paper4 149286 14.98 126.272 59.612
U:paper5 173240 14.986 131.79 59.219
U:paper6 57130 14.976 138.631 51.455
U:pic 9059 14.977 296.037 16.852
U:progc 54739 14.984 138.003 49.13
U:progl 39501 14.983 180.139 35.818
U:progp 58113 14.981 182.67 33.925
U:trans 33673 14.986 200.771 30.138

Driver: QuickLZ/L3/block

QuickLZ (level 3), block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 26697 14.983 189.069 39.534
U:book1 3242 14.982 158.651 53.581
U:book2 4558 14.984 177.208 42.955
U:geo 19248 14.978 125.494 79.199
U:news 7062 14.981 169.529 45.733
U:obj1 109382 14.983 149.715 54.157
U:obj2 11363 14.979 178.564 39.541
U:paper1 49332 14.985 166.9 44.164
U:paper2 31355 14.98 164.077 47.04
U:paper3 53132 14.981 157.371 50.217
U:paper4 187124 14.979 158.287 52.928
U:paper5 214621 14.986 163.27 52.434
U:paper6 71780 14.977 174.17 43.923
U:pic 11351 14.975 370.982 14.781
U:progc 67188 14.981 169.423 42.041
U:progl 48947 14.986 223.169 28.846
U:progp 72263 14.982 227.138 28.237
U:trans 42540 14.984 253.688 24.868

Driver: Gzip/JDK/stream

JDK Gzip/Deflate, streaming

testCase resultIterations resultTime resultValue resultValueX
U:bib 29243 14.984 207.08 31.657
U:book1 3439 14.987 168.233 40.789
U:book2 4999 14.987 194.319 33.831
U:geo 18745 14.987 122.145 66.823
U:news 7231 14.984 173.555 38.396
U:obj1 124403 14.982 170.289 47.949
U:obj2 12620 14.981 198.282 33.02
U:paper1 56687 14.98 191.857 34.898
U:paper2 35727 14.986 186.885 36.198
U:paper3 60207 14.981 178.321 38.843
U:paper4 205983 14.979 174.237 41.48
U:paper5 231885 14.985 176.409 41.576
U:paper6 79490 14.984 192.777 34.893
U:pic 12828 14.975 419.257 11.001
U:progc 77815 14.981 196.215 33.67
U:progl 58441 14.982 266.53 22.68
U:progp 85064 14.986 267.303 22.726
U:trans 50003 14.98 298.262 20.32

Driver: Gzip/jzlib/stream

JCraft's jzlib (gzip), streaming

testCase resultIterations resultTime resultValue resultValueX
U:bib 13543 14.984 95.902 32.309
U:book1 1578 14.975 77.257 41.427
U:book2 2381 14.989 92.541 34.274
U:geo 7636 14.987 49.758 67.149
U:news 3410 14.982 81.856 38.605
U:obj1 50044 14.978 68.519 47.949
U:obj2 5959 14.984 93.607 33.519
U:paper1 25824 14.985 87.368 35.131
U:paper2 15975 14.986 83.566 36.685
U:paper3 26562 14.978 78.687 39.036
U:paper4 81807 14.985 69.174 41.653
U:paper5 91489 14.981 69.621 41.651
U:paper6 35356 14.981 85.763 35.079
U:pic 6650 14.979 217.287 11.178
U:progc 34268 14.982 86.402 33.849
U:progl 27334 14.985 124.633 23.038
U:progp 39282 14.98 123.487 22.99
U:trans 23361 14.981 139.339 20.712

Driver: BZip2/stream

Commons-compress BZip2 implementation

testCase resultIterations resultTime resultValue resultValueX
U:bib 3139 14.989 22.22 24.615
U:book1 385 15.007 18.809 33.322
U:book2 538 14.993 20.904 28.307
U:geo 2531 14.987 16.493 55.537
U:news 785 14.991 18.833 33.564
U:obj1 11739 14.981 16.07 50.219
U:obj2 1343 14.98 21.103 31.825
U:paper1 5810 14.985 19.657 31.156
U:paper2 3778 14.98 19.771 30.506
U:paper3 6298 14.983 18.651 34.086
U:paper4 20446 14.984 17.29 39.049
U:paper5 22290 14.984 16.959 40.43
U:paper6 8238 14.979 19.986 32.295
U:pic 1426 14.978 46.599 9.696
U:progc 7845 14.979 19.784 31.648
U:progl 5366 14.978 24.478 21.743
U:progp 7798 14.985 24.507 21.748
U:trans 4460 14.981 26.602 19.13

Driver: LZMA-orig/block

7Zip's LZMA, block mode

testCase resultIterations resultTime resultValue resultValueX
U:bib 3785 14.979 26.812 27.453
U:book1 496 14.99 24.26 33.96
U:book2 722 14.99 28.06 27.794
U:geo 1966 14.982 12.815 51.952
U:news 997 14.978 23.939 31.514
U:obj1 12470 14.981 17.07 43.694
U:obj2 1724 14.988 27.075 24.871
U:paper1 6748 14.985 22.83 32.43
U:paper2 4385 14.985 22.939 33.086
U:paper3 6959 14.981 20.611 36.61
U:paper4 21246 14.984 17.966 40.351
U:paper5 23461 14.976 17.859 40.572
U:paper6 9166 14.986 22.226 32.712
U:pic 2176 14.992 71.04 7.96
U:progc 9020 14.977 22.75 31.597
U:progl 7187 14.982 32.776 20.829
U:progp 10515 14.984 33.046 20.881
U:trans 6440 14.986 38.399 17.76

Driver: LZMA-java/stream

LZMA-java, streaming

testCase resultIterations resultTime resultValue resultValueX
U:bib 1107 14.993 7.834 29.049
U:book1 257 15.009 12.554 38.342
U:book2 322 14.985 12.518 31.421
U:geo 986 15.005 6.417 51.931
U:news 459 15.019 10.991 35.817
U:obj1 3199 14.977 4.38 43.61
U:obj2 681 14.993 10.691 25.933
U:paper1 1882 14.975 6.371 32.725
U:paper2 1329 14.995 6.948 33.857
U:paper3 1976 14.981 5.852 36.689
U:paper4 4667 14.982 3.947 40.313
U:paper5 5065 14.977 3.855 40.514
U:paper6 2416 14.979 5.861 32.71
U:pic 399 15.003 13.017 8.368
U:progc 2419 14.984 6.099 31.602
U:progl 1590 14.986 7.249 21.065
U:progp 2253 14.972 7.086 21.199
U:trans 1303 14.982 7.771 18.516

Results Per Test










Generated using Japex version 1.2.2