Stop running benchmarks.jl on Travis CI

[tkf]

No description provided.

[github-actions]

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 18 Jan 2020 - 05:38
  • Baseline: 18 Jan 2020 - 05:42
• Package commits:
  • Target: 8bde04
  • Baseline: f355ea
• Julia commits:
  • Target: 2d5741
  • Baseline: 2d5741
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["collect", "identity-union"]	1.05 (5%) ❌	1.00 (1%)
["gemm", "fusedmul", "xf", "8"]	1.06 (5%) ❌	1.00 (1%)
["gemm", "mul", "linalg", "256"]	1.05 (5%) ❌	1.00 (1%)
["gemm", "mul", "man", "ivdep", "8"]	1.28 (5%) ❌	1.00 (1%)
["gemm", "mul", "man", "true", "8"]	0.87 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "false", "256"]	0.93 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "false", "8"]	1.05 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "ivdep", "8"]	1.25 (5%) ❌	1.00 (1%)
["missing_dot", "equiv"]	0.90 (5%) ✅	1.00 (1%)
["missing_dot", "rf_nota"]	0.87 (5%) ✅	1.00 (1%)
["partition_by", "xf"]	0.92 (5%) ✅	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Target

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      24708 s          0 s       1585 s      41622 s          0 s
       #2  2294 MHz      30675 s          0 s       1504 s      35656 s          0 s
       
  Memory: 6.782737731933594 GB (3547.14453125 MB free)
  Uptime: 693.0 sec
  Load Avg:  1.154296875  1.0615234375  0.623046875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

Baseline

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      31304 s          0 s       2067 s      56567 s          0 s
       #2  2294 MHz      48388 s          0 s       1717 s      39777 s          0 s
       
  Memory: 6.782737731933594 GB (3529.67578125 MB free)
  Uptime: 913.0 sec
  Load Avg:  1.1943359375  1.1220703125  0.748046875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 18 Jan 2020 - 5:38
• Package commit: 8bde04
• Julia commit: 2d5741
• Julia command flags: None
• Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	205.701 μs (5%)
["cat", "xf"]	1.460 μs (5%)
["collect", "filter-missing"]	77.600 μs (5%)		33.00 KiB (1%)	17
["collect", "identity-float"]	62.600 μs (5%)		256.86 KiB (1%)	17
["collect", "identity-union"]	313.502 μs (5%)		285.56 KiB (1%)	6659
["dot", "blas"]	2.278 μs (5%)
["dot", "man"]	2.256 μs (5%)
["dot", "rf"]	2.667 μs (5%)
["dot", "xf"]	2.667 μs (5%)
["filter_map_map!", "man"]	67.500 μs (5%)
["filter_map_map!", "xf"]	69.601 μs (5%)		144 bytes (1%)	8
["filter_map_reduce", "man"]	194.901 μs (5%)
["filter_map_reduce", "xf"]	194.901 μs (5%)
["gemm", "fusedmul", "blas", "16"]	3.586 ms (5%)
["gemm", "fusedmul", "blas", "2"]	2.637 ms (5%)
["gemm", "fusedmul", "blas", "32"]	5.210 ms (5%)
["gemm", "fusedmul", "blas", "8"]	2.984 ms (5%)
["gemm", "fusedmul", "xf", "16"]	5.426 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	623.402 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	10.995 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.807 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	693.704 μs (5%)
["gemm", "mul", "linalg", "32"]	3.712 μs (5%)
["gemm", "mul", "linalg", "8"]	291.176 ns (5%)
["gemm", "mul", "man", "false", "256"]	4.618 ms (5%)
["gemm", "mul", "man", "false", "32"]	7.020 μs (5%)
["gemm", "mul", "man", "false", "8"]	409.500 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	4.673 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	6.220 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	382.759 ns (5%)
["gemm", "mul", "man", "true", "256"]	4.778 ms (5%)
["gemm", "mul", "man", "true", "32"]	7.300 μs (5%)
["gemm", "mul", "man", "true", "8"]	348.837 ns (5%)
["gemm", "mul", "xf", "false", "256"]	4.441 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	6.925 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	421.111 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	4.664 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	5.683 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	376.102 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	4.730 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	6.900 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	399.500 ns (5%)		48 bytes (1%)	2
["missing_argmax", "man"]	905.882 ns (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	2.189 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	2.233 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.230 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.060 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	4.043 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	852.174 ns (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.250 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	191.201 μs (5%)		73.92 KiB (1%)	3863
["missing_dot", "xf_nota"]	186.601 μs (5%)		74.14 KiB (1%)	3866
["partition_by", "man"]	1.835 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	1.641 ms (5%)		576 bytes (1%)	7

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      24708 s          0 s       1585 s      41622 s          0 s
       #2  2294 MHz      30675 s          0 s       1504 s      35656 s          0 s
       
  Memory: 6.782737731933594 GB (3547.14453125 MB free)
  Uptime: 693.0 sec
  Load Avg:  1.154296875  1.0615234375  0.623046875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 18 Jan 2020 - 5:42
• Package commit: f355ea
• Julia commit: 2d5741
• Julia command flags: None
• Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	206.900 μs (5%)
["cat", "xf"]	1.460 μs (5%)
["collect", "filter-missing"]	78.100 μs (5%)		33.00 KiB (1%)	17
["collect", "identity-float"]	61.800 μs (5%)		256.86 KiB (1%)	17
["collect", "identity-union"]	298.401 μs (5%)		285.44 KiB (1%)	6675
["dot", "blas"]	2.267 μs (5%)
["dot", "man"]	2.278 μs (5%)
["dot", "rf"]	2.656 μs (5%)
["dot", "xf"]	2.667 μs (5%)
["filter_map_map!", "man"]	67.700 μs (5%)
["filter_map_map!", "xf"]	69.800 μs (5%)		144 bytes (1%)	8
["filter_map_reduce", "man"]	194.900 μs (5%)
["filter_map_reduce", "xf"]	194.900 μs (5%)
["gemm", "fusedmul", "blas", "16"]	3.583 ms (5%)
["gemm", "fusedmul", "blas", "2"]	2.641 ms (5%)
["gemm", "fusedmul", "blas", "32"]	5.164 ms (5%)
["gemm", "fusedmul", "blas", "8"]	3.130 ms (5%)
["gemm", "fusedmul", "xf", "16"]	5.412 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	608.201 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	11.006 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.656 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	660.503 μs (5%)
["gemm", "mul", "linalg", "32"]	3.800 μs (5%)
["gemm", "mul", "linalg", "8"]	300.000 ns (5%)
["gemm", "mul", "man", "false", "256"]	4.570 ms (5%)
["gemm", "mul", "man", "false", "32"]	7.100 μs (5%)
["gemm", "mul", "man", "false", "8"]	400.000 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	4.723 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	6.300 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	300.000 ns (5%)
["gemm", "mul", "man", "true", "256"]	4.811 ms (5%)
["gemm", "mul", "man", "true", "32"]	7.400 μs (5%)
["gemm", "mul", "man", "true", "8"]	400.000 ns (5%)
["gemm", "mul", "xf", "false", "256"]	4.789 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	7.000 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	400.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	4.702 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	5.900 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	300.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	4.747 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	7.000 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	400.000 ns (5%)		48 bytes (1%)	2
["missing_argmax", "man"]	941.206 ns (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	2.133 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	2.167 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.360 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.090 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	4.057 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	888.420 ns (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.430 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	186.600 μs (5%)		74.09 KiB (1%)	3866
["missing_dot", "xf_nota"]	189.500 μs (5%)		74.14 KiB (1%)	3866
["partition_by", "man"]	1.828 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	1.790 ms (5%)		576 bytes (1%)	7

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      31304 s          0 s       2067 s      56567 s          0 s
       #2  2294 MHz      48388 s          0 s       1717 s      39777 s          0 s
       
  Memory: 6.782737731933594 GB (3529.67578125 MB free)
  Uptime: 913.0 sec
  Load Avg:  1.1943359375  1.1220703125  0.748046875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

[codecov-io]

Codecov Report

Merging #168 into master will increase coverage by 0.01%.
The diff coverage is 94.11%.

@@            Coverage Diff             @@
##           master     #168      +/-   ##
==========================================
+ Coverage   93.67%   93.68%   +0.01%     
==========================================
  Files          19       19              
  Lines        1264     1267       +3     
==========================================
+ Hits         1184     1187       +3     
  Misses         80       80

Impacted Files	Coverage Δ
src/processes.jl	90.74% <100%> (+0.05%)	⬆️
src/reduce.jl	93.58% <100%> (+1.69%)	⬆️
src/dreduce.jl	100% <100%> (ø)	⬆️
src/core.jl	91.46% <75%> (-0.52%)	⬇️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 367a055...7691d49. Read the comment docs.

[github-actions]

Multi-thread benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 19 Jan 2020 - 15:54
  • Baseline: 19 Jan 2020 - 15:56
• Package commits:
  • Target: b4bc5c
  • Baseline: 30cdf2
• Julia commits:
  • Target: 2d5741
  • Baseline: 2d5741
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: JULIA_NUM_THREADS => 2
  • Baseline: JULIA_NUM_THREADS => 2

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["parallel_histogram", "comm", "basesize=4096"]	1.07 (5%) ❌	0.96 (1%) ✅
["parallel_histogram", "comm", "basesize=8192"]	1.18 (5%) ❌	1.01 (1%)
["unordered", "unordered", "basesize=1024"]	1.14 (5%) ❌	1.12 (1%) ❌
["words", "nthreads=2"]	0.89 (5%) ✅	1.00 (1%)
["words", "nthreads=4"]	0.93 (5%) ✅	1.01 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["unordered"]
• ["unordered", "unordered"]
• ["words"]

Julia versioninfo

Target

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2397 MHz      17081 s          0 s       1410 s      12722 s          0 s
       #2  2397 MHz      19509 s          0 s       1671 s       9999 s          0 s
       
  Memory: 6.782737731933594 GB (3682.53125 MB free)
  Uptime: 327.0 sec
  Load Avg:  1.59814453125  1.05224609375  0.48193359375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, haswell)

Baseline

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2397 MHz      24706 s          0 s       1720 s      16373 s          0 s
       #2  2397 MHz      27859 s          0 s       1967 s      12972 s          0 s
       
  Memory: 6.782737731933594 GB (3708.6328125 MB free)
  Uptime: 444.0 sec
  Load Avg:  1.58349609375  1.173828125  0.5947265625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, haswell)

---

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 19 Jan 2020 - 15:54
• Package commit: b4bc5c
• Julia commit: 2d5741
• Julia command flags: None
• Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["parallel_histogram", "assoc", "basesize=16384"]	5.519 ms (5%)		732.25 KiB (1%)	110
["parallel_histogram", "assoc", "basesize=4096"]	6.268 ms (5%)		1.80 MiB (1%)	540
["parallel_histogram", "assoc", "basesize=8192"]	5.868 ms (5%)		1.43 MiB (1%)	262
["parallel_histogram", "comm", "basesize=16384"]	13.097 ms (5%)		1.22 MiB (1%)	261
["parallel_histogram", "comm", "basesize=4096"]	19.379 ms (5%)		1023.88 KiB (1%)	1906
["parallel_histogram", "comm", "basesize=8192"]	17.435 ms (5%)		1.24 MiB (1%)	1477
["parallel_histogram", "seq"]	10.113 ms (5%)		364.63 KiB (1%)	25
["unordered", "collect"]	549.727 ms (5%)		513.00 KiB (1%)	23
["unordered", "unordered", "basesize=1"]	595.806 ms (5%)		30.26 MiB (1%)	475232
["unordered", "unordered", "basesize=1024"]	401.264 ms (5%)		995.13 KiB (1%)	16803
["unordered", "unordered", "basesize=32"]	306.930 ms (5%)		1.57 MiB (1%)	23222
["words", "nthreads=1"]	44.052 ms (5%)	7.656 ms	65.13 MiB (1%)	2107636
["words", "nthreads=2"]	23.555 ms (5%)		65.85 MiB (1%)	2107797
["words", "nthreads=4"]	25.204 ms (5%)		66.48 MiB (1%)	2108105

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["unordered"]
• ["unordered", "unordered"]
• ["words"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2397 MHz      17081 s          0 s       1410 s      12722 s          0 s
       #2  2397 MHz      19509 s          0 s       1671 s       9999 s          0 s
       
  Memory: 6.782737731933594 GB (3682.53125 MB free)
  Uptime: 327.0 sec
  Load Avg:  1.59814453125  1.05224609375  0.48193359375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, haswell)

---

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 19 Jan 2020 - 15:56
• Package commit: 30cdf2
• Julia commit: 2d5741
• Julia command flags: None
• Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["parallel_histogram", "assoc", "basesize=16384"]	5.519 ms (5%)		732.25 KiB (1%)	110
["parallel_histogram", "assoc", "basesize=4096"]	6.280 ms (5%)		1.80 MiB (1%)	540
["parallel_histogram", "assoc", "basesize=8192"]	5.896 ms (5%)		1.43 MiB (1%)	261
["parallel_histogram", "comm", "basesize=16384"]	13.028 ms (5%)		1.22 MiB (1%)	246
["parallel_histogram", "comm", "basesize=4096"]	18.111 ms (5%)		1.04 MiB (1%)	3122
["parallel_histogram", "comm", "basesize=8192"]	14.769 ms (5%)		1.23 MiB (1%)	798
["parallel_histogram", "seq"]	10.177 ms (5%)		364.63 KiB (1%)	25
["unordered", "collect"]	554.223 ms (5%)		513.00 KiB (1%)	23
["unordered", "unordered", "basesize=1"]	622.067 ms (5%)		30.25 MiB (1%)	474488
["unordered", "unordered", "basesize=1024"]	351.511 ms (5%)		888.69 KiB (1%)	9946
["unordered", "unordered", "basesize=32"]	311.770 ms (5%)		1.58 MiB (1%)	23677
["words", "nthreads=1"]	43.992 ms (5%)	7.697 ms	64.87 MiB (1%)	2098668
["words", "nthreads=2"]	26.613 ms (5%)		65.59 MiB (1%)	2098829
["words", "nthreads=4"]	27.130 ms (5%)		66.04 MiB (1%)	2098986

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["unordered"]
• ["unordered", "unordered"]
• ["words"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: 
              speed         user         nice          sys         idle          irq
       #1  2397 MHz      24706 s          0 s       1720 s      16373 s          0 s
       #2  2397 MHz      27859 s          0 s       1967 s      12972 s          0 s
       
  Memory: 6.782737731933594 GB (3708.6328125 MB free)
  Uptime: 444.0 sec
  Load Avg:  1.58349609375  1.173828125  0.5947265625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, haswell)

---

Runtime information

Runtime Info
BLAS #threads	2
BLAS.vendor()	openblas64
Sys.CPU_THREADS	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               63
Model name:          Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Stepping:            2
CPU MHz:             2397.224
BogoMIPS:            4794.44
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            256K
L3 cache:            30720K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm invpcid_single pti fsgsbase bmi1 avx2 smep bmi2 erms invpcid xsaveopt md_clear

Cpu Property	Value
Brand	Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Vendor	:Intel
Architecture	:Haswell
Model	Family: 0x06, Model: 0x3f, Stepping: 0x02, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 256, 30720) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	256 bit = 32 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via rdtsc
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

[github-actions]

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 19 Jan 2020 - 15:58
  • Baseline: 19 Jan 2020 - 16:02
• Package commits:
  • Target: b4bc5c
  • Baseline: 30cdf2
• Julia commits:
  • Target: 2d5741
  • Baseline: 2d5741
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["collect", "identity-float"]	0.95 (5%) ✅	1.00 (1%)
["collect", "identity-union"]	1.06 (5%) ❌	1.00 (1%)
["gemm", "mul", "linalg", "8"]	1.09 (5%) ❌	1.00 (1%)
["gemm", "mul", "man", "false", "8"]	0.89 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "ivdep", "8"]	0.89 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "true", "8"]	1.23 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "false", "8"]	1.07 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "ivdep", "8"]	0.90 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "true", "8"]	1.08 (5%) ❌	1.00 (1%)
["missing_argmax", "man"]	1.07 (5%) ❌	1.00 (1%)
["missing_argmax", "xf"]	1.05 (5%) ❌	1.00 (1%)
["missing_dot", "equiv"]	1.16 (5%) ❌	1.00 (1%)
["missing_dot", "rf"]	1.07 (5%) ❌	1.00 (1%)
["missing_dot", "rf_nota"]	1.07 (5%) ❌	1.00 (1%)
["missing_dot", "xf"]	1.07 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Target

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      21099 s          0 s       1696 s      31228 s          0 s
       #2  2294 MHz      35969 s          0 s       1454 s      17818 s          0 s
       
  Memory: 6.782737731933594 GB (3524.13671875 MB free)
  Uptime: 560.0 sec
  Load Avg:  1.169921875  1.02490234375  0.572265625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

Baseline

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      25686 s          0 s       1946 s      49058 s          0 s
       #2  2294 MHz      56394 s          0 s       1799 s      19776 s          0 s
       
  Memory: 6.782737731933594 GB (3530.87890625 MB free)
  Uptime: 788.0 sec
  Load Avg:  1.1630859375  1.08642578125  0.70654296875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

---

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 19 Jan 2020 - 15:58
• Package commit: b4bc5c
• Julia commit: 2d5741
• Julia command flags: None
• Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	261.400 μs (5%)
["cat", "xf"]	1.820 μs (5%)
["collect", "filter-missing"]	99.900 μs (5%)		33.05 KiB (1%)	20
["collect", "identity-float"]	77.000 μs (5%)		256.91 KiB (1%)	20
["collect", "identity-union"]	390.901 μs (5%)		285.48 KiB (1%)	6653
["dot", "blas"]	2.622 μs (5%)
["dot", "man"]	2.611 μs (5%)
["dot", "rf"]	3.100 μs (5%)
["dot", "xf"]	3.025 μs (5%)
["filter_map_map!", "man"]	73.700 μs (5%)
["filter_map_map!", "xf"]	77.000 μs (5%)		144 bytes (1%)	8
["filter_map_reduce", "man"]	242.000 μs (5%)
["filter_map_reduce", "xf"]	242.000 μs (5%)
["gemm", "fusedmul", "blas", "16"]	3.602 ms (5%)
["gemm", "fusedmul", "blas", "2"]	2.627 ms (5%)
["gemm", "fusedmul", "blas", "32"]	5.248 ms (5%)
["gemm", "fusedmul", "blas", "8"]	3.267 ms (5%)
["gemm", "fusedmul", "xf", "16"]	5.476 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	670.803 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	10.967 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.714 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	761.901 μs (5%)
["gemm", "mul", "linalg", "32"]	4.329 μs (5%)
["gemm", "mul", "linalg", "8"]	327.149 ns (5%)
["gemm", "mul", "man", "false", "256"]	4.779 ms (5%)
["gemm", "mul", "man", "false", "32"]	8.133 μs (5%)
["gemm", "mul", "man", "false", "8"]	445.413 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	4.752 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	7.300 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	442.857 ns (5%)
["gemm", "mul", "man", "true", "256"]	4.795 ms (5%)
["gemm", "mul", "man", "true", "32"]	8.367 μs (5%)
["gemm", "mul", "man", "true", "8"]	490.576 ns (5%)
["gemm", "mul", "xf", "false", "256"]	4.741 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	8.000 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	534.211 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	4.724 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	6.580 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	452.284 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	4.792 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	7.650 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	433.503 ns (5%)		48 bytes (1%)	2
["missing_argmax", "man"]	1.230 μs (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	2.756 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	2.822 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.760 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.400 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	4.917 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	1.370 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.730 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	239.800 μs (5%)		74.05 KiB (1%)	3863
["missing_dot", "xf_nota"]	230.000 μs (5%)		74.13 KiB (1%)	3867
["partition_by", "man"]	2.335 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	2.268 ms (5%)		576 bytes (1%)	7

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      21099 s          0 s       1696 s      31228 s          0 s
       #2  2294 MHz      35969 s          0 s       1454 s      17818 s          0 s
       
  Memory: 6.782737731933594 GB (3524.13671875 MB free)
  Uptime: 560.0 sec
  Load Avg:  1.169921875  1.02490234375  0.572265625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

---

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 19 Jan 2020 - 16:2
• Package commit: 30cdf2
• Julia commit: 2d5741
• Julia command flags: None
• Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	261.100 μs (5%)
["cat", "xf"]	1.770 μs (5%)
["collect", "filter-missing"]	103.000 μs (5%)		33.05 KiB (1%)	20
["collect", "identity-float"]	81.200 μs (5%)		256.91 KiB (1%)	20
["collect", "identity-union"]	368.700 μs (5%)		285.89 KiB (1%)	6669
["dot", "blas"]	2.578 μs (5%)
["dot", "man"]	2.578 μs (5%)
["dot", "rf"]	3.100 μs (5%)
["dot", "xf"]	3.112 μs (5%)
["filter_map_map!", "man"]	73.900 μs (5%)
["filter_map_map!", "xf"]	76.700 μs (5%)		144 bytes (1%)	8
["filter_map_reduce", "man"]	242.100 μs (5%)
["filter_map_reduce", "xf"]	242.000 μs (5%)
["gemm", "fusedmul", "blas", "16"]	3.581 ms (5%)
["gemm", "fusedmul", "blas", "2"]	2.634 ms (5%)
["gemm", "fusedmul", "blas", "32"]	5.245 ms (5%)
["gemm", "fusedmul", "blas", "8"]	3.257 ms (5%)
["gemm", "fusedmul", "xf", "16"]	5.457 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	670.801 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	11.540 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.707 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	760.901 μs (5%)
["gemm", "mul", "linalg", "32"]	4.400 μs (5%)
["gemm", "mul", "linalg", "8"]	300.000 ns (5%)
["gemm", "mul", "man", "false", "256"]	4.898 ms (5%)
["gemm", "mul", "man", "false", "32"]	8.200 μs (5%)
["gemm", "mul", "man", "false", "8"]	500.000 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	4.889 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	7.400 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	500.000 ns (5%)
["gemm", "mul", "man", "true", "256"]	4.913 ms (5%)
["gemm", "mul", "man", "true", "32"]	8.400 μs (5%)
["gemm", "mul", "man", "true", "8"]	400.000 ns (5%)
["gemm", "mul", "xf", "false", "256"]	4.913 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	8.100 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	500.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	4.881 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	6.700 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	500.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	4.885 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	7.800 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	400.000 ns (5%)		48 bytes (1%)	2
["missing_argmax", "man"]	1.150 μs (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	2.844 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	2.678 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.520 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.400 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	4.883 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	1.280 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.620 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	224.601 μs (5%)		74.05 KiB (1%)	3866
["missing_dot", "xf_nota"]	240.100 μs (5%)		73.89 KiB (1%)	3856
["partition_by", "man"]	2.288 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	2.221 ms (5%)		576 bytes (1%)	7

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1027-azure #29~18.04.1-Ubuntu SMP Mon Nov 25 21:18:57 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      25686 s          0 s       1946 s      49058 s          0 s
       #2  2294 MHz      56394 s          0 s       1799 s      19776 s          0 s
       
  Memory: 6.782737731933594 GB (3530.87890625 MB free)
  Uptime: 788.0 sec
  Load Avg:  1.1630859375  1.08642578125  0.70654296875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, broadwell)

---

Runtime information

Runtime Info
BLAS #threads	2
BLAS.vendor()	openblas64
Sys.CPU_THREADS	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               79
Model name:          Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Stepping:            1
CPU MHz:             2294.685
BogoMIPS:            4589.37
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            256K
L3 cache:            51200K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear

Cpu Property	Value
Brand	Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Vendor	:Intel
Architecture	:Broadwell
Model	Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 256, 51200) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	256 bit = 32 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via rdtsc
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

[github-actions]

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 27 Jan 2020 - 20:21
  • Baseline: 27 Jan 2020 - 20:25
• Package commits:
  • Target: 9f66ec
  • Baseline: be2cdd
• Julia commits:
  • Target: 2d5741
  • Baseline: 2d5741
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1
  • Baseline: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["gemm", "fusedmul", "xf", "2"]	1.07 (5%) ❌	1.00 (1%)
["gemm", "fusedmul", "xf", "32"]	1.08 (5%) ❌	1.00 (1%)
["gemm", "fusedmul", "xf", "8"]	1.07 (5%) ❌	1.00 (1%)
["gemm", "mul", "man", "false", "8"]	1.09 (5%) ❌	1.00 (1%)
["gemm", "mul", "man", "ivdep", "8"]	0.79 (5%) ✅	1.00 (1%)
["gemm", "mul", "man", "true", "8"]	1.10 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "false", "8"]	1.10 (5%) ❌	1.00 (1%)
["gemm", "mul", "xf", "ivdep", "32"]	0.94 (5%) ✅	1.00 (1%)
["gemm", "mul", "xf", "ivdep", "8"]	1.14 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Target

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1028-azure #30~18.04.1-Ubuntu SMP Fri Dec 6 11:47:59 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      47960 s          0 s       1174 s      14437 s          0 s
       #2  2095 MHz       5026 s          0 s       1170 s      57119 s          0 s
       
  Memory: 6.782741546630859 GB (3570.1015625 MB free)
  Uptime: 650.0 sec
  Load Avg:  1.0322265625  0.9736328125  0.56787109375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1028-azure #30~18.04.1-Ubuntu SMP Fri Dec 6 11:47:59 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      51811 s          0 s       1290 s      33531 s          0 s
       #2  2095 MHz      24408 s          0 s       1242 s      60757 s          0 s
       
  Memory: 6.782741546630859 GB (3600.13671875 MB free)
  Uptime: 882.0 sec
  Load Avg:  1.0478515625  1.03076171875  0.6962890625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

---

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 27 Jan 2020 - 20:21
• Package commit: 9f66ec
• Julia commit: 2d5741
• Julia command flags: None
• Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	290.808 μs (5%)
["cat", "xf"]	2.133 μs (5%)
["collect", "filter-missing"]	115.403 μs (5%)		33.05 KiB (1%)	20
["collect", "identity-float"]	83.102 μs (5%)		256.91 KiB (1%)	20
["collect", "identity-union"]	413.011 μs (5%)		285.39 KiB (1%)	6651
["dot", "blas"]	1.490 μs (5%)
["dot", "man"]	1.430 μs (5%)
["dot", "rf"]	2.667 μs (5%)
["dot", "xf"]	2.678 μs (5%)
["filter_map_map!", "man"]	60.301 μs (5%)
["filter_map_map!", "xf"]	62.901 μs (5%)		144 bytes (1%)	8
["filter_map_reduce", "man"]	287.609 μs (5%)
["filter_map_reduce", "xf"]	287.809 μs (5%)
["findall", "base"]	1.007 ms (5%)		2.00 MiB (1%)	21
["findall", "xf-array"]	762.207 μs (5%)		3.05 MiB (1%)	100015
["findall", "xf-iter"]	967.312 μs (5%)		2.00 MiB (1%)	29
["gemm", "fusedmul", "blas", "16"]	5.112 ms (5%)
["gemm", "fusedmul", "blas", "2"]	3.799 ms (5%)
["gemm", "fusedmul", "blas", "32"]	7.264 ms (5%)
["gemm", "fusedmul", "blas", "8"]	4.035 ms (5%)
["gemm", "fusedmul", "xf", "16"]	5.181 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	649.812 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	11.461 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.670 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	1.111 ms (5%)
["gemm", "mul", "linalg", "32"]	3.737 μs (5%)
["gemm", "mul", "linalg", "8"]	304.789 ns (5%)
["gemm", "mul", "man", "false", "256"]	2.079 ms (5%)
["gemm", "mul", "man", "false", "32"]	5.800 μs (5%)
["gemm", "mul", "man", "false", "8"]	545.755 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	2.088 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	4.814 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	476.421 ns (5%)
["gemm", "mul", "man", "true", "256"]	2.087 ms (5%)
["gemm", "mul", "man", "true", "32"]	6.380 μs (5%)
["gemm", "mul", "man", "true", "8"]	550.813 ns (5%)
["gemm", "mul", "xf", "false", "256"]	2.080 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	5.467 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	552.417 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	2.078 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	4.614 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	455.848 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	2.083 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	5.817 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	479.497 ns (5%)		48 bytes (1%)	2
["missing_argmax", "man"]	3.350 μs (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	3.188 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	3.200 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.820 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.680 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	5.900 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	1.690 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.830 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	274.809 μs (5%)		74.14 KiB (1%)	3867
["missing_dot", "xf_nota"]	267.509 μs (5%)		74.09 KiB (1%)	3864
["partition_by", "man"]	2.495 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	2.331 ms (5%)		576 bytes (1%)	7

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1028-azure #30~18.04.1-Ubuntu SMP Fri Dec 6 11:47:59 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      47960 s          0 s       1174 s      14437 s          0 s
       #2  2095 MHz       5026 s          0 s       1170 s      57119 s          0 s
       
  Memory: 6.782741546630859 GB (3570.1015625 MB free)
  Uptime: 650.0 sec
  Load Avg:  1.0322265625  0.9736328125  0.56787109375
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

---

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 27 Jan 2020 - 20:25
• Package commit: be2cdd
• Julia commit: 2d5741
• Julia command flags: None
• Environment variables: OMP_NUM_THREADS => 1 JULIA_NUM_THREADS => 1

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["cat", "base"]	292.404 μs (5%)
["cat", "xf"]	2.122 μs (5%)
["collect", "filter-missing"]	117.802 μs (5%)		33.05 KiB (1%)	20
["collect", "identity-float"]	81.302 μs (5%)		256.91 KiB (1%)	20
["collect", "identity-union"]	403.906 μs (5%)		285.50 KiB (1%)	6693
["dot", "blas"]	1.510 μs (5%)
["dot", "man"]	1.410 μs (5%)
["dot", "rf"]	2.678 μs (5%)
["dot", "xf"]	2.678 μs (5%)
["filter_map_map!", "man"]	58.701 μs (5%)
["filter_map_map!", "xf"]	63.101 μs (5%)		144 bytes (1%)	8
["filter_map_reduce", "man"]	287.604 μs (5%)
["filter_map_reduce", "xf"]	287.904 μs (5%)
["findall", "base"]	1.012 ms (5%)		2.00 MiB (1%)	21
["findall", "xf-array"]	743.812 μs (5%)		3.05 MiB (1%)	100015
["findall", "xf-iter"]	945.915 μs (5%)		2.00 MiB (1%)	29
["gemm", "fusedmul", "blas", "16"]	5.104 ms (5%)
["gemm", "fusedmul", "blas", "2"]	3.799 ms (5%)
["gemm", "fusedmul", "blas", "32"]	7.246 ms (5%)
["gemm", "fusedmul", "blas", "8"]	4.005 ms (5%)
["gemm", "fusedmul", "xf", "16"]	5.106 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "2"]	604.608 μs (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "32"]	10.642 ms (5%)		160 bytes (1%)	6
["gemm", "fusedmul", "xf", "8"]	2.497 ms (5%)		160 bytes (1%)	6
["gemm", "mul", "linalg", "256"]	1.111 ms (5%)
["gemm", "mul", "linalg", "32"]	3.800 μs (5%)
["gemm", "mul", "linalg", "8"]	300.000 ns (5%)
["gemm", "mul", "man", "false", "256"]	2.147 ms (5%)
["gemm", "mul", "man", "false", "32"]	5.900 μs (5%)
["gemm", "mul", "man", "false", "8"]	500.000 ns (5%)
["gemm", "mul", "man", "ivdep", "256"]	2.116 ms (5%)
["gemm", "mul", "man", "ivdep", "32"]	4.800 μs (5%)
["gemm", "mul", "man", "ivdep", "8"]	600.000 ns (5%)
["gemm", "mul", "man", "true", "256"]	2.152 ms (5%)
["gemm", "mul", "man", "true", "32"]	6.400 μs (5%)
["gemm", "mul", "man", "true", "8"]	500.000 ns (5%)
["gemm", "mul", "xf", "false", "256"]	2.140 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "32"]	5.600 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "false", "8"]	500.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "256"]	2.106 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "32"]	4.900 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "ivdep", "8"]	400.000 ns (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "256"]	2.138 ms (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "32"]	5.900 μs (5%)		48 bytes (1%)	2
["gemm", "mul", "xf", "true", "8"]	500.000 ns (5%)		48 bytes (1%)	2
["missing_argmax", "man"]	3.350 μs (5%)		32 bytes (1%)	1
["missing_argmax", "rf"]	3.188 μs (5%)		32 bytes (1%)	1
["missing_argmax", "xf"]	3.175 μs (5%)		32 bytes (1%)	1
["missing_dot", "equiv"]	1.830 μs (5%)		16 bytes (1%)	1
["missing_dot", "man"]	1.680 μs (5%)		16 bytes (1%)	1
["missing_dot", "naive"]	5.900 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf"]	1.690 μs (5%)		16 bytes (1%)	1
["missing_dot", "rf_nota"]	1.850 μs (5%)		16 bytes (1%)	1
["missing_dot", "xf"]	269.404 μs (5%)		74.11 KiB (1%)	3865
["missing_dot", "xf_nota"]	267.203 μs (5%)		74.20 KiB (1%)	3868
["partition_by", "man"]	2.470 ms (5%)		352 bytes (1%)	4
["partition_by", "xf"]	2.324 ms (5%)		576 bytes (1%)	7

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["cat"]
• ["collect"]
• ["dot"]
• ["filter_map_map!"]
• ["filter_map_reduce"]
• ["findall"]
• ["gemm", "fusedmul", "blas"]
• ["gemm", "fusedmul", "xf"]
• ["gemm", "mul", "linalg"]
• ["gemm", "mul", "man", "false"]
• ["gemm", "mul", "man", "ivdep"]
• ["gemm", "mul", "man", "true"]
• ["gemm", "mul", "xf", "false"]
• ["gemm", "mul", "xf", "ivdep"]
• ["gemm", "mul", "xf", "true"]
• ["missing_argmax"]
• ["missing_dot"]
• ["partition_by"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1028-azure #30~18.04.1-Ubuntu SMP Fri Dec 6 11:47:59 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      51811 s          0 s       1290 s      33531 s          0 s
       #2  2095 MHz      24408 s          0 s       1242 s      60757 s          0 s
       
  Memory: 6.782741546630859 GB (3600.13671875 MB free)
  Uptime: 882.0 sec
  Load Avg:  1.0478515625  1.03076171875  0.6962890625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

---

Runtime information

Runtime Info
BLAS #threads	2
BLAS.vendor()	openblas64
Sys.CPU_THREADS	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.078
BogoMIPS:            4190.15
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via rdtsc
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

[github-actions]

Multi-thread benchmark result

Judge result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmarks:
  • Target: 27 Jan 2020 - 20:22
  • Baseline: 27 Jan 2020 - 20:27
• Package commits:
  • Target: 9f66ec
  • Baseline: be2cdd
• Julia commits:
  • Target: 2d5741
  • Baseline: 2d5741
• Julia command flags:
  • Target: None
  • Baseline: None
• Environment variables:
  • Target: JULIA_NUM_THREADS => 2
  • Baseline: JULIA_NUM_THREADS => 2

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
["collect", "assoc", "basesize=1"]	1.07 (5%) ❌	1.00 (1%)
["collect", "assoc", "basesize=1024"]	0.93 (5%) ✅	1.00 (1%)
["collect", "unordered", "basesize=1"]	1.06 (5%) ❌	1.00 (1%)
["collect", "unordered", "basesize=1024"]	0.69 (5%) ✅	0.80 (1%) ✅
["collect", "unordered", "basesize=32"]	0.94 (5%) ✅	1.00 (1%)
["findfirst", "n=1000", "foldl"]	1.13 (5%) ❌	1.00 (1%)
["findfirst", "n=1000", "reduce", "basesize=128"]	0.61 (5%) ✅	0.66 (1%) ✅
["findfirst", "n=1000", "reduce", "basesize=256"]	1.10 (5%) ❌	1.07 (1%) ❌
["findfirst", "n=1000", "reduce", "basesize=512"]	1.09 (5%) ❌	0.99 (1%)
["findfirst", "n=400", "foldl"]	1.09 (5%) ❌	1.00 (1%)
["findfirst", "n=400", "reduce", "basesize=128"]	0.95 (5%) ✅	0.91 (1%) ✅
["findfirst", "n=400", "reduce", "basesize=256"]	1.02 (5%)	1.01 (1%) ❌
["findfirst", "n=400", "reduce", "basesize=512"]	1.06 (5%) ❌	0.99 (1%) ✅
["findfirst", "n=500", "foldl"]	1.10 (5%) ❌	1.00 (1%)
["findfirst", "n=500", "reduce", "basesize=128"]	2.44 (5%) ❌	1.96 (1%) ❌
["findfirst", "n=500", "reduce", "basesize=512"]	0.91 (5%) ✅	0.88 (1%) ✅
["parallel_histogram", "assoc", "basesize=16384"]	0.87 (5%) ✅	1.00 (1%)
["parallel_histogram", "comm", "basesize=8192"]	0.85 (5%) ✅	0.97 (1%) ✅
["parallel_histogram", "seq"]	0.88 (5%) ✅	1.00 (1%)
["sum", "random", "foldl"]	1.06 (5%) ❌	1.00 (1%)
["sum", "random", "reduce", "basesize=256"]	1.14 (5%) ❌	1.00 (1%)
["sum", "uniform", "foldl"]	1.08 (5%) ❌	1.00 (1%)
["sum", "uniform", "reduce", "basesize=512"]	1.11 (5%) ❌	1.00 (1%)
["sum", "valley", "foldl"]	1.05 (5%) ❌	1.00 (1%)
["sum", "valley", "reduce", "basesize=512"]	1.07 (5%) ❌	1.00 (1%)
["words", "nthreads=4"]	0.94 (5%) ✅	1.01 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Target

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1028-azure #30~18.04.1-Ubuntu SMP Fri Dec 6 11:47:59 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      39411 s          0 s       1668 s      27706 s          0 s
       #2  2095 MHz      52378 s          0 s       1965 s      14969 s          0 s
       
  Memory: 6.782741546630859 GB (3697.30078125 MB free)
  Uptime: 708.0 sec
  Load Avg:  1.77392578125  1.47314453125  0.8369140625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1028-azure #30~18.04.1-Ubuntu SMP Fri Dec 6 11:47:59 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      62807 s          0 s       2048 s      30326 s          0 s
       #2  2095 MHz      70851 s          0 s       2416 s      22389 s          0 s
       
  Memory: 6.782741546630859 GB (3724.078125 MB free)
  Uptime: 974.0 sec
  Load Avg:  1.7529296875  1.60888671875  1.056640625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

---

Target result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 27 Jan 2020 - 20:22
• Package commit: 9f66ec
• Julia commit: 2d5741
• Julia command flags: None
• Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["collect", "assoc", "basesize=1"]	374.669 ms (5%)	11.711 ms	91.55 MiB (1%)	1754659
["collect", "assoc", "basesize=1024"]	223.307 ms (5%)		1.84 MiB (1%)	1966
["collect", "assoc", "basesize=32"]	227.660 ms (5%)		5.77 MiB (1%)	59129
["collect", "seq"]	443.207 ms (5%)		513.00 KiB (1%)	23
["collect", "unordered", "basesize=1"]	490.522 ms (5%)		30.24 MiB (1%)	474196
["collect", "unordered", "basesize=1024"]	251.176 ms (5%)		760.92 KiB (1%)	1814
["collect", "unordered", "basesize=32"]	270.936 ms (5%)		1.52 MiB (1%)	19923
["findfirst", "n=1000", "foldl"]	707.410 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"]	435.884 ms (5%)		928.97 KiB (1%)	18111
["findfirst", "n=1000", "reduce", "basesize=256"]	510.545 ms (5%)		545.30 KiB (1%)	10636
["findfirst", "n=1000", "reduce", "basesize=512"]	656.931 ms (5%)		350.28 KiB (1%)	6837
["findfirst", "n=400", "foldl"]	495.536 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"]	301.269 ms (5%)		1.21 MiB (1%)	24434
["findfirst", "n=400", "reduce", "basesize=256"]	300.746 ms (5%)		658.06 KiB (1%)	12961
["findfirst", "n=400", "reduce", "basesize=512"]	329.654 ms (5%)		387.19 KiB (1%)	7611
["findfirst", "n=500", "foldl"]	81.962 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"]	182.492 ms (5%)		833.30 KiB (1%)	16111
["findfirst", "n=500", "reduce", "basesize=256"]	146.301 ms (5%)		385.48 KiB (1%)	7454
["findfirst", "n=500", "reduce", "basesize=512"]	119.888 ms (5%)		199.31 KiB (1%)	3848
["overhead", "n=64"]	165.101 μs (5%)		155.11 KiB (1%)	3007
["parallel_histogram", "assoc", "basesize=16384"]	3.953 ms (5%)		732.22 KiB (1%)	109
["parallel_histogram", "assoc", "basesize=4096"]	4.685 ms (5%)		1.80 MiB (1%)	539
["parallel_histogram", "assoc", "basesize=8192"]	4.524 ms (5%)		1.43 MiB (1%)	260
["parallel_histogram", "comm", "basesize=16384"]	15.136 ms (5%)		1.23 MiB (1%)	652
["parallel_histogram", "comm", "basesize=4096"]	21.333 ms (5%)		1.06 MiB (1%)	5757
["parallel_histogram", "comm", "basesize=8192"]	16.328 ms (5%)		1.23 MiB (1%)	797
["parallel_histogram", "seq"]	7.449 ms (5%)		364.63 KiB (1%)	25
["sum", "random", "foldl"]	15.138 ms (5%)
["sum", "random", "reduce", "basesize=128"]	7.809 ms (5%)		331.36 KiB (1%)	6833
["sum", "random", "reduce", "basesize=256"]	8.496 ms (5%)		164.09 KiB (1%)	3392
["sum", "random", "reduce", "basesize=512"]	7.236 ms (5%)		80.73 KiB (1%)	1673
["sum", "uniform", "foldl"]	15.104 ms (5%)
["sum", "uniform", "reduce", "basesize=128"]	7.405 ms (5%)		331.41 KiB (1%)	6836
["sum", "uniform", "reduce", "basesize=256"]	7.205 ms (5%)		164.11 KiB (1%)	3393
["sum", "uniform", "reduce", "basesize=512"]	7.815 ms (5%)		80.73 KiB (1%)	1673
["sum", "valley", "foldl"]	14.971 ms (5%)
["sum", "valley", "reduce", "basesize=128"]	7.574 ms (5%)		331.33 KiB (1%)	6831
["sum", "valley", "reduce", "basesize=256"]	7.636 ms (5%)		164.09 KiB (1%)	3392
["sum", "valley", "reduce", "basesize=512"]	7.889 ms (5%)		80.75 KiB (1%)	1674
["words", "nthreads=1"]	31.627 ms (5%)	5.802 ms	64.81 MiB (1%)	2097084
["words", "nthreads=2"]	18.776 ms (5%)		65.53 MiB (1%)	2097246
["words", "nthreads=4"]	18.762 ms (5%)		66.17 MiB (1%)	2097553

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1028-azure #30~18.04.1-Ubuntu SMP Fri Dec 6 11:47:59 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      39411 s          0 s       1668 s      27706 s          0 s
       #2  2095 MHz      52378 s          0 s       1965 s      14969 s          0 s
       
  Memory: 6.782741546630859 GB (3697.30078125 MB free)
  Uptime: 708.0 sec
  Load Avg:  1.77392578125  1.47314453125  0.8369140625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

---

Baseline result

Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl

Job Properties

• Time of benchmark: 27 Jan 2020 - 20:27
• Package commit: be2cdd
• Julia commit: 2d5741
• Julia command flags: None
• Environment variables: JULIA_NUM_THREADS => 2

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
["collect", "assoc", "basesize=1"]	348.789 ms (5%)	8.770 ms	91.55 MiB (1%)	1754665
["collect", "assoc", "basesize=1024"]	241.250 ms (5%)		1.84 MiB (1%)	1968
["collect", "assoc", "basesize=32"]	235.894 ms (5%)		5.77 MiB (1%)	59136
["collect", "seq"]	452.611 ms (5%)		513.00 KiB (1%)	23
["collect", "unordered", "basesize=1"]	464.307 ms (5%)	7.086 ms	30.24 MiB (1%)	473905
["collect", "unordered", "basesize=1024"]	365.443 ms (5%)		948.31 KiB (1%)	13762
["collect", "unordered", "basesize=32"]	288.000 ms (5%)		1.51 MiB (1%)	19487
["findfirst", "n=1000", "foldl"]	625.702 ms (5%)
["findfirst", "n=1000", "reduce", "basesize=128"]	717.471 ms (5%)		1.38 MiB (1%)	27681
["findfirst", "n=1000", "reduce", "basesize=256"]	463.321 ms (5%)		509.48 KiB (1%)	9937
["findfirst", "n=1000", "reduce", "basesize=512"]	602.223 ms (5%)		352.72 KiB (1%)	6879
["findfirst", "n=400", "foldl"]	454.432 ms (5%)
["findfirst", "n=400", "reduce", "basesize=128"]	318.735 ms (5%)		1.33 MiB (1%)	26797
["findfirst", "n=400", "reduce", "basesize=256"]	295.403 ms (5%)		650.25 KiB (1%)	12803
["findfirst", "n=400", "reduce", "basesize=512"]	311.251 ms (5%)		392.39 KiB (1%)	7716
["findfirst", "n=500", "foldl"]	74.701 ms (5%)
["findfirst", "n=500", "reduce", "basesize=128"]	74.810 ms (5%)		424.91 KiB (1%)	8220
["findfirst", "n=500", "reduce", "basesize=256"]	143.266 ms (5%)		383.08 KiB (1%)	7413
["findfirst", "n=500", "reduce", "basesize=512"]	131.633 ms (5%)		227.55 KiB (1%)	4411
["overhead", "n=64"]	167.100 μs (5%)		155.11 KiB (1%)	3007
["parallel_histogram", "assoc", "basesize=16384"]	4.557 ms (5%)		732.22 KiB (1%)	109
["parallel_histogram", "assoc", "basesize=4096"]	4.469 ms (5%)		1.80 MiB (1%)	539
["parallel_histogram", "assoc", "basesize=8192"]	4.481 ms (5%)		1.43 MiB (1%)	261
["parallel_histogram", "comm", "basesize=16384"]	15.189 ms (5%)		1.22 MiB (1%)	406
["parallel_histogram", "comm", "basesize=4096"]	21.902 ms (5%)		1.05 MiB (1%)	2589
["parallel_histogram", "comm", "basesize=8192"]	19.220 ms (5%)		1.27 MiB (1%)	3277
["parallel_histogram", "seq"]	8.424 ms (5%)		364.63 KiB (1%)	25
["sum", "random", "foldl"]	14.327 ms (5%)
["sum", "random", "reduce", "basesize=128"]	7.443 ms (5%)		331.34 KiB (1%)	6832
["sum", "random", "reduce", "basesize=256"]	7.474 ms (5%)		164.08 KiB (1%)	3391
["sum", "random", "reduce", "basesize=512"]	7.176 ms (5%)		80.75 KiB (1%)	1674
["sum", "uniform", "foldl"]	14.006 ms (5%)
["sum", "uniform", "reduce", "basesize=128"]	7.457 ms (5%)		331.38 KiB (1%)	6834
["sum", "uniform", "reduce", "basesize=256"]	7.275 ms (5%)		164.09 KiB (1%)	3392
["sum", "uniform", "reduce", "basesize=512"]	7.024 ms (5%)		80.72 KiB (1%)	1672
["sum", "valley", "foldl"]	14.227 ms (5%)
["sum", "valley", "reduce", "basesize=128"]	7.832 ms (5%)		331.25 KiB (1%)	6826
["sum", "valley", "reduce", "basesize=256"]	7.286 ms (5%)		164.09 KiB (1%)	3392
["sum", "valley", "reduce", "basesize=512"]	7.353 ms (5%)		80.75 KiB (1%)	1674
["words", "nthreads=1"]	31.805 ms (5%)	5.796 ms	64.40 MiB (1%)	2084058
["words", "nthreads=2"]	19.003 ms (5%)		65.12 MiB (1%)	2084220
["words", "nthreads=4"]	19.989 ms (5%)		65.76 MiB (1%)	2084531

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

• ["collect", "assoc"]
• ["collect"]
• ["collect", "unordered"]
• ["findfirst", "n=1000"]
• ["findfirst", "n=1000", "reduce"]
• ["findfirst", "n=400"]
• ["findfirst", "n=400", "reduce"]
• ["findfirst", "n=500"]
• ["findfirst", "n=500", "reduce"]
• ["overhead"]
• ["parallel_histogram", "assoc"]
• ["parallel_histogram", "comm"]
• ["parallel_histogram"]
• ["sum", "random"]
• ["sum", "random", "reduce"]
• ["sum", "uniform"]
• ["sum", "uniform", "reduce"]
• ["sum", "valley"]
• ["sum", "valley", "reduce"]
• ["words"]

Julia versioninfo

Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.3 LTS
  uname: Linux 5.0.0-1028-azure #30~18.04.1-Ubuntu SMP Fri Dec 6 11:47:59 UTC 2019 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      62807 s          0 s       2048 s      30326 s          0 s
       #2  2095 MHz      70851 s          0 s       2416 s      22389 s          0 s
       
  Memory: 6.782741546630859 GB (3724.078125 MB free)
  Uptime: 974.0 sec
  Load Avg:  1.7529296875  1.60888671875  1.056640625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-6.0.1 (ORCJIT, skylake)

---

Runtime information

Runtime Info
BLAS #threads	2
BLAS.vendor()	openblas64
Sys.CPU_THREADS	2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.074
BogoMIPS:            4190.14
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves

Cpu Property	Value
Brand	Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor	:Intel
Architecture	:Skylake
Model	Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores	2 physical cores, 2 logical cores (on executing CPU)
	No Hyperthreading detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 1024, 36608) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 44 bits physical
SIMD	512 bit = 64 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via rdtsc
	TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft