Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add collector and finish! #143

Merged
merged 5 commits into from
May 21, 2020
Merged

Add collector and finish! #143

merged 5 commits into from
May 21, 2020

Conversation

tkf
Copy link
Member

@tkf tkf commented May 21, 2020

No description provided.

@github-actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmarks:
    • Target: 21 May 2020 - 05:19
    • Baseline: 21 May 2020 - 05:20
  • Package commits:
    • Target: a253fd
    • Baseline: 01bb10
  • Julia commits:
    • Target: 381693
    • Baseline: 381693
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["append", "append!!(::Vector, ::SingletonVector)"] 0.86 (5%) ✅ 1.00 (1%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 0.78 (5%) ✅ 1.00 (1%)
["dataframes", "Categorical"] 0.87 (5%) ✅ 1.00 (1%)
["dataframes", "Missing-Int"] 0.86 (5%) ✅ 1.00 (1%)
["dataframes", "Missing-String"] 1.09 (5%) ❌ 1.00 (1%)
["dataframes", "String-String"] 0.95 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["dataframes"]

Julia versioninfo

Target

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz       8611 s          0 s       1291 s      27768 s          0 s
       #2  2095 MHz      17156 s          0 s       1768 s      18736 s          0 s
       
  Memory: 6.764888763427734 GB (3587.015625 MB free)
  Uptime: 390.0 sec
  Load Avg:  1.0  0.7255859375  0.3447265625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      12288 s          0 s       1360 s      31646 s          0 s
       #2  2095 MHz      21093 s          0 s       1844 s      22357 s          0 s
       
  Memory: 6.764888763427734 GB (3600.37890625 MB free)
  Uptime: 467.0 sec
  Load Avg:  1.0  0.79345703125  0.40185546875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Target result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmark: 21 May 2020 - 5:19
  • Package commit: a253fd
  • Julia commit: 381693
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["append", "append!!(::SVector, ::SingletonVector)"] 13.901 ms (5%) 16.78 MiB (1%) 600000
["append", "append!!(::Vector, ::SingletonVector)"] 400.501 μs (5%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 2.900 ns (5%)
["collectors", ":comp => \"filter\"", ":impl => \"base\""] 35.900 μs (5%) 128.66 KiB (1%) 14
["collectors", ":comp => \"filter\"", ":impl => \"coll\""] 41.501 μs (5%) 284.84 KiB (1%) 5013
["collectors", ":comp => \"filter\"", ":impl => \"nonexpanding\""] 40.000 μs (5%) 312.75 KiB (1%) 5005
["collectors", ":comp => \"filter\"", ":impl => \"vec\""] 39.200 μs (5%) 128.72 KiB (1%) 15
["collectors", ":comp => \"map\"", ":impl => \"coll\""] 5.500 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"man\""] 5.767 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"safe_coll\""] 10.400 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"vec\""] 65.900 μs (5%) 256.64 KiB (1%) 14
["dataframes", "Categorical"] 709.685 ms (5%) 83.388 ms 992.89 MiB (1%) 6318092
["dataframes", "Int-Int"] 1.052 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-Int"] 1.253 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-String"] 1.518 ms (5%) 160.27 KiB (1%) 10252
["dataframes", "String-String"] 1.372 ms (5%) 160.27 KiB (1%) 10252

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["collectors", ":comp => \"filter\""]
  • ["collectors", ":comp => \"map\""]
  • ["dataframes"]

Julia versioninfo

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz       8611 s          0 s       1291 s      27768 s          0 s
       #2  2095 MHz      17156 s          0 s       1768 s      18736 s          0 s
       
  Memory: 6.764888763427734 GB (3587.015625 MB free)
  Uptime: 390.0 sec
  Load Avg:  1.0  0.7255859375  0.3447265625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmark: 21 May 2020 - 5:20
  • Package commit: 01bb10
  • Julia commit: 381693
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["append", "append!!(::SVector, ::SingletonVector)"] 13.587 ms (5%) 16.78 MiB (1%) 600000
["append", "append!!(::Vector, ::SingletonVector)"] 465.109 μs (5%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 3.700 ns (5%)
["dataframes", "Categorical"] 818.328 ms (5%) 92.438 ms 992.89 MiB (1%) 6318092
["dataframes", "Int-Int"] 1.047 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-Int"] 1.450 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-String"] 1.399 ms (5%) 160.27 KiB (1%) 10252
["dataframes", "String-String"] 1.448 ms (5%) 160.27 KiB (1%) 10252

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["dataframes"]

Julia versioninfo

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      12288 s          0 s       1360 s      31646 s          0 s
       #2  2095 MHz      21093 s          0 s       1844 s      22357 s          0 s
       
  Memory: 6.764888763427734 GB (3600.37890625 MB free)
  Uptime: 467.0 sec
  Load Avg:  1.0  0.79345703125  0.40185546875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() openblas64
Sys.CPU_THREADS 2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.079
BogoMIPS:            4190.15
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves
Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 44 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@tkf
Copy link
Member Author

tkf commented May 21, 2020

It looks like the speed up with "filter" case requires Julia 1.6 (1.5?):

In 1.4.1:

2-element BenchmarkTools.BenchmarkGroup:
  tags: []
  :comp => "map" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "safe_coll" => Trial(8.378 μs)
          :impl => "vec" => Trial(50.589 μs)
          :impl => "coll" => Trial(3.267 μs)
          :impl => "man" => Trial(3.335 μs)
  :comp => "filter" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "base" => Trial(28.013 μs)
          :impl => "vec" => Trial(29.273 μs)
          :impl => "coll" => Trial(43.366 μs)
          :impl => "nonexpanding" => Trial(39.645 μs)

In 1.6.0-DEV.62:

2-element BenchmarkTools.BenchmarkGroup:
  tags: []
  :comp => "map" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "safe_coll" => Trial(8.244 μs)
          :impl => "vec" => Trial(50.121 μs)
          :impl => "coll" => Trial(4.174 μs)
          :impl => "man" => Trial(3.924 μs)
  :comp => "filter" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "base" => Trial(30.483 μs)
          :impl => "vec" => Trial(30.203 μs)
          :impl => "coll" => Trial(14.574 μs)
          :impl => "nonexpanding" => Trial(10.516 μs)

@codecov-commenter
Copy link

codecov-commenter commented May 21, 2020

Codecov Report

Merging #143 into master will increase coverage by 0.21%.
The diff coverage is 93.44%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #143      +/-   ##
==========================================
+ Coverage   91.88%   92.09%   +0.21%     
==========================================
  Files          20       21       +1     
  Lines         382      443      +61     
==========================================
+ Hits          351      408      +57     
- Misses         31       35       +4     
Impacted Files Coverage Δ
src/BangBang.jl 100.00% <ø> (ø)
src/NoBang/base.jl 94.80% <0.00%> (-1.25%) ⬇️
src/base.jl 82.97% <33.33%> (-1.64%) ⬇️
src/core.jl 82.35% <50.00%> (-4.32%) ⬇️
src/NoBang/emptycontainers.jl 96.15% <100.00%> (+2.82%) ⬆️
src/NoBang/singletoncontainers.jl 100.00% <100.00%> (ø)
src/collectors.jl 100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 01bb108...92e0d90. Read the comment docs.

@github-actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmarks:
    • Target: 21 May 2020 - 05:33
    • Baseline: 21 May 2020 - 05:34
  • Package commits:
    • Target: 9ba90b
    • Baseline: 01bb10
  • Julia commits:
    • Target: 381693
    • Baseline: 381693
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["dataframes", "Categorical"] 0.83 (5%) ✅ 1.00 (1%)
["dataframes", "Missing-String"] 1.05 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["dataframes"]

Julia versioninfo

Target

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      20849 s          0 s       1442 s       7848 s          0 s
       #2  2294 MHz       5124 s          0 s       1326 s      23834 s          0 s
       
  Memory: 6.764888763427734 GB (3532.9453125 MB free)
  Uptime: 318.0 sec
  Load Avg:  1.162109375  0.8173828125  0.37353515625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)

Baseline

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      22638 s          0 s       1501 s      13651 s          0 s
       #2  2294 MHz      10955 s          0 s       1417 s      25560 s          0 s
       
  Memory: 6.764888763427734 GB (3541.859375 MB free)
  Uptime: 394.0 sec
  Load Avg:  1.04443359375  0.86083984375  0.4248046875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)

Target result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmark: 21 May 2020 - 5:33
  • Package commit: 9ba90b
  • Julia commit: 381693
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["append", "append!!(::SVector, ::SingletonVector)"] 10.565 ms (5%) 16.78 MiB (1%) 600000
["append", "append!!(::Vector, ::SingletonVector)"] 407.701 μs (5%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 2.800 ns (5%)
["collectors", ":comp => \"filter\"", ":impl => \"base\""] 32.200 μs (5%) 128.66 KiB (1%) 14
["collectors", ":comp => \"filter\"", ":impl => \"coll\""] 41.300 μs (5%) 284.84 KiB (1%) 5013
["collectors", ":comp => \"filter\"", ":impl => \"nonexpanding\""] 32.400 μs (5%) 312.75 KiB (1%) 5005
["collectors", ":comp => \"filter\"", ":impl => \"vec\""] 34.400 μs (5%) 128.72 KiB (1%) 15
["collectors", ":comp => \"map\"", ":impl => \"coll\""] 5.157 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"man\""] 4.272 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"safe_coll\""] 8.800 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"vec\""] 59.301 μs (5%) 256.64 KiB (1%) 14
["dataframes", "Categorical"] 730.624 ms (5%) 93.220 ms 992.89 MiB (1%) 6318092
["dataframes", "Int-Int"] 962.603 μs (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-Int"] 1.326 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-String"] 1.370 ms (5%) 160.27 KiB (1%) 10252
["dataframes", "String-String"] 1.273 ms (5%) 160.27 KiB (1%) 10252

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["collectors", ":comp => \"filter\""]
  • ["collectors", ":comp => \"map\""]
  • ["dataframes"]

Julia versioninfo

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      20849 s          0 s       1442 s       7848 s          0 s
       #2  2294 MHz       5124 s          0 s       1326 s      23834 s          0 s
       
  Memory: 6.764888763427734 GB (3532.9453125 MB free)
  Uptime: 318.0 sec
  Load Avg:  1.162109375  0.8173828125  0.37353515625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)

Baseline result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmark: 21 May 2020 - 5:34
  • Package commit: 01bb10
  • Julia commit: 381693
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["append", "append!!(::SVector, ::SingletonVector)"] 10.597 ms (5%) 16.78 MiB (1%) 600000
["append", "append!!(::Vector, ::SingletonVector)"] 411.401 μs (5%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 2.800 ns (5%)
["dataframes", "Categorical"] 876.221 ms (5%) 98.669 ms 992.89 MiB (1%) 6318092
["dataframes", "Int-Int"] 936.102 μs (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-Int"] 1.348 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-String"] 1.303 ms (5%) 160.27 KiB (1%) 10252
["dataframes", "String-String"] 1.267 ms (5%) 160.27 KiB (1%) 10252

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["dataframes"]

Julia versioninfo

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      22638 s          0 s       1501 s      13651 s          0 s
       #2  2294 MHz      10955 s          0 s       1417 s      25560 s          0 s
       
  Memory: 6.764888763427734 GB (3541.859375 MB free)
  Uptime: 394.0 sec
  Load Avg:  1.04443359375  0.86083984375  0.4248046875
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() openblas64
Sys.CPU_THREADS 2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               79
Model name:          Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Stepping:            1
CPU MHz:             2294.684
BogoMIPS:            4589.36
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            256K
L3 cache:            51200K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear
Cpu Property Value
Brand Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Vendor :Intel
Architecture :Broadwell
Model Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 256, 51200) kbytes
64 byte cache line size
Address Size 48 bits virtual, 44 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmarks:
    • Target: 21 May 2020 - 06:06
    • Baseline: 21 May 2020 - 06:07
  • Package commits:
    • Target: ed5e23
    • Baseline: 01bb10
  • Julia commits:
    • Target: 381693
    • Baseline: 381693
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["append", "append!!(::SVector, ::SingletonVector)"] 1.05 (5%) ❌ 1.00 (1%)
["append", "append!!(::Vector, ::SingletonVector)"] 0.87 (5%) ✅ 1.00 (1%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 0.78 (5%) ✅ 1.00 (1%)
["dataframes", "Categorical"] 0.87 (5%) ✅ 1.00 (1%)
["dataframes", "Missing-Int"] 0.86 (5%) ✅ 1.00 (1%)
["dataframes", "Missing-String"] 0.75 (5%) ✅ 1.00 (1%)
["dataframes", "String-String"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["dataframes"]

Julia versioninfo

Target

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      19999 s          0 s       1730 s      33487 s          0 s
       #2  2095 MHz       6009 s          0 s       1422 s      45860 s          0 s
       
  Memory: 6.764888763427734 GB (3616.9765625 MB free)
  Uptime: 604.0 sec
  Load Avg:  1.103515625  0.92529296875  0.54150390625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      26476 s          0 s       1818 s      34654 s          0 s
       #2  2095 MHz       7248 s          0 s       1479 s      52296 s          0 s
       
  Memory: 6.764888763427734 GB (3604.359375 MB free)
  Uptime: 682.0 sec
  Load Avg:  1.09033203125  0.97314453125  0.59228515625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Target result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmark: 21 May 2020 - 6:6
  • Package commit: ed5e23
  • Julia commit: 381693
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["append", "append!!(::SVector, ::SingletonVector)"] 13.998 ms (5%) 16.78 MiB (1%) 600000
["append", "append!!(::Vector, ::SingletonVector)"] 465.334 μs (5%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 2.900 ns (5%)
["collectors", ":comp => \"filter\"", ":impl => \"base\""] 43.603 μs (5%) 128.66 KiB (1%) 14
["collectors", ":comp => \"filter\"", ":impl => \"coll\""] 44.903 μs (5%) 284.84 KiB (1%) 5013
["collectors", ":comp => \"filter\"", ":impl => \"nonexpanding\""] 42.603 μs (5%) 312.75 KiB (1%) 5005
["collectors", ":comp => \"filter\"", ":impl => \"vec\""] 39.503 μs (5%) 128.72 KiB (1%) 15
["collectors", ":comp => \"map\"", ":impl => \"coll\""] 7.400 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"man\""] 8.641 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"safe_coll\""] 11.501 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"vec\""] 73.005 μs (5%) 256.64 KiB (1%) 14
["dataframes", "Categorical"] 698.032 ms (5%) 73.712 ms 992.89 MiB (1%) 6318092
["dataframes", "Int-Int"] 1.038 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-Int"] 1.319 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-String"] 1.162 ms (5%) 160.27 KiB (1%) 10252
["dataframes", "String-String"] 1.473 ms (5%) 160.27 KiB (1%) 10252

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["collectors", ":comp => \"filter\""]
  • ["collectors", ":comp => \"map\""]
  • ["dataframes"]

Julia versioninfo

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      19999 s          0 s       1730 s      33487 s          0 s
       #2  2095 MHz       6009 s          0 s       1422 s      45860 s          0 s
       
  Memory: 6.764888763427734 GB (3616.9765625 MB free)
  Uptime: 604.0 sec
  Load Avg:  1.103515625  0.92529296875  0.54150390625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Baseline result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmark: 21 May 2020 - 6:7
  • Package commit: 01bb10
  • Julia commit: 381693
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["append", "append!!(::SVector, ::SingletonVector)"] 13.307 ms (5%) 16.78 MiB (1%) 600000
["append", "append!!(::Vector, ::SingletonVector)"] 534.030 μs (5%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 3.700 ns (5%)
["dataframes", "Categorical"] 804.391 ms (5%) 88.795 ms 992.89 MiB (1%) 6318092
["dataframes", "Int-Int"] 1.063 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-Int"] 1.530 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-String"] 1.542 ms (5%) 160.27 KiB (1%) 10252
["dataframes", "String-String"] 1.387 ms (5%) 160.27 KiB (1%) 10252

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["dataframes"]

Julia versioninfo

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: 
              speed         user         nice          sys         idle          irq
       #1  2095 MHz      26476 s          0 s       1818 s      34654 s          0 s
       #2  2095 MHz       7248 s          0 s       1479 s      52296 s          0 s
       
  Memory: 6.764888763427734 GB (3604.359375 MB free)
  Uptime: 682.0 sec
  Load Avg:  1.09033203125  0.97314453125  0.59228515625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, skylake)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() openblas64
Sys.CPU_THREADS 2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping:            4
CPU MHz:             2095.192
BogoMIPS:            4190.38
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            36608K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves
Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Vendor :Intel
Architecture :Skylake
Model Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 1024, 36608) kbytes
64 byte cache line size
Address Size 48 bits virtual, 44 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@github-actions
Copy link
Contributor

Benchmark result

Judge result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmarks:
    • Target: 21 May 2020 - 06:58
    • Baseline: 21 May 2020 - 07:00
  • Package commits:
    • Target: 981c84
    • Baseline: 01bb10
  • Julia commits:
    • Target: 381693
    • Baseline: 381693
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["append", "append!!(::SVector, ::SingletonVector)"] 1.18 (5%) ❌ 1.00 (1%)
["append", "append!!(::Vector, ::SingletonVector)"] 1.07 (5%) ❌ 1.00 (1%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 1.07 (5%) ❌ 1.00 (1%)
["dataframes", "Categorical"] 0.90 (5%) ✅ 1.00 (1%)
["dataframes", "Missing-String"] 1.19 (5%) ❌ 1.00 (1%)
["dataframes", "String-String"] 1.15 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["dataframes"]

Julia versioninfo

Target

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      21151 s          0 s       1480 s      10981 s          0 s
       #2  2294 MHz       6691 s          0 s       1440 s      25799 s          0 s
       
  Memory: 6.764888763427734 GB (3584.71484375 MB free)
  Uptime: 352.0 sec
  Load Avg:  1.04296875  0.81494140625  0.3916015625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)

Baseline

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      28797 s          0 s       1571 s      11204 s          0 s
       #2  2294 MHz       7002 s          0 s       1481 s      33420 s          0 s
       
  Memory: 6.764888763427734 GB (3615.7578125 MB free)
  Uptime: 432.0 sec
  Load Avg:  1.0087890625  0.86181640625  0.4462890625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)

Target result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmark: 21 May 2020 - 6:58
  • Package commit: 981c84
  • Julia commit: 381693
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["append", "append!!(::SVector, ::SingletonVector)"] 12.700 ms (5%) 16.78 MiB (1%) 600000
["append", "append!!(::Vector, ::SingletonVector)"] 444.901 μs (5%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 3.000 ns (5%)
["collectors", ":comp => \"filter\"", ":impl => \"base\""] 42.400 μs (5%) 128.66 KiB (1%) 14
["collectors", ":comp => \"filter\"", ":impl => \"coll\""] 44.501 μs (5%) 284.81 KiB (1%) 5012
["collectors", ":comp => \"filter\"", ":impl => \"nonexpanding\""] 38.200 μs (5%) 312.75 KiB (1%) 5005
["collectors", ":comp => \"filter\"", ":impl => \"vec\""] 45.800 μs (5%) 128.59 KiB (1%) 13
["collectors", ":comp => \"map\"", ":impl => \"coll\""] 5.120 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"man\""] 4.300 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"safe_coll\""] 10.200 μs (5%) 78.20 KiB (1%) 2
["collectors", ":comp => \"map\"", ":impl => \"vec\""] 74.601 μs (5%) 256.64 KiB (1%) 14
["dataframes", "Categorical"] 843.697 ms (5%) 105.924 ms 992.89 MiB (1%) 6318092
["dataframes", "Int-Int"] 971.404 μs (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-Int"] 1.390 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-String"] 1.583 ms (5%) 160.27 KiB (1%) 10252
["dataframes", "String-String"] 1.467 ms (5%) 160.27 KiB (1%) 10252

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["collectors", ":comp => \"filter\""]
  • ["collectors", ":comp => \"map\""]
  • ["dataframes"]

Julia versioninfo

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      21151 s          0 s       1480 s      10981 s          0 s
       #2  2294 MHz       6691 s          0 s       1440 s      25799 s          0 s
       
  Memory: 6.764888763427734 GB (3584.71484375 MB free)
  Uptime: 352.0 sec
  Load Avg:  1.04296875  0.81494140625  0.3916015625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)

Baseline result

Benchmark Report for /home/runner/work/BangBang.jl/BangBang.jl

Job Properties

  • Time of benchmark: 21 May 2020 - 7:0
  • Package commit: 01bb10
  • Julia commit: 381693
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["append", "append!!(::SVector, ::SingletonVector)"] 10.804 ms (5%) 16.78 MiB (1%) 600000
["append", "append!!(::Vector, ::SingletonVector)"] 415.908 μs (5%)
["append", "append!!(Empty(SVector), ::SingletonVector)"] 2.800 ns (5%)
["dataframes", "Categorical"] 940.496 ms (5%) 111.179 ms 992.89 MiB (1%) 6318092
["dataframes", "Int-Int"] 954.903 μs (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-Int"] 1.351 ms (5%) 160.23 KiB (1%) 10251
["dataframes", "Missing-String"] 1.335 ms (5%) 160.27 KiB (1%) 10252
["dataframes", "String-String"] 1.271 ms (5%) 160.27 KiB (1%) 10252

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["append"]
  • ["dataframes"]

Julia versioninfo

Julia Version 1.4.1
Commit 381693d3df* (2020-04-14 17:20 UTC)
Platform Info:
  OS: Linux (x86_64-pc-linux-gnu)
      Ubuntu 18.04.4 LTS
  uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64
  CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: 
              speed         user         nice          sys         idle          irq
       #1  2294 MHz      28797 s          0 s       1571 s      11204 s          0 s
       #2  2294 MHz       7002 s          0 s       1481 s      33420 s          0 s
       
  Memory: 6.764888763427734 GB (3615.7578125 MB free)
  Uptime: 432.0 sec
  Load Avg:  1.0087890625  0.86181640625  0.4462890625
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-8.0.1 (ORCJIT, broadwell)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() openblas64
Sys.CPU_THREADS 2

lscpu output:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              2
On-line CPU(s) list: 0,1
Thread(s) per core:  1
Core(s) per socket:  2
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               79
Model name:          Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Stepping:            1
CPU MHz:             2294.687
BogoMIPS:            4589.37
Hypervisor vendor:   Microsoft
Virtualization type: full
L1d cache:           32K
L1i cache:           32K
L2 cache:            256K
L3 cache:            51200K
NUMA node0 CPU(s):   0,1
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear
Cpu Property Value
Brand Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Vendor :Intel
Architecture :Broadwell
Model Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 256, 51200) kbytes
64 byte cache line size
Address Size 48 bits virtual, 44 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@tkf
Copy link
Member Author

tkf commented May 21, 2020

92e0d90 with 1.6.0-DEV.62

2-element BenchmarkTools.BenchmarkGroup:
  tags: []
  :comp => "map" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "safe_coll" => Trial(10.816 μs)
          :impl => "vec" => Trial(49.284 μs)
          :impl => "coll" => Trial(3.553 μs)
          :impl => "man" => Trial(3.649 μs)
  :comp => "filter" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "base" => Trial(26.234 μs)
          :impl => "vec" => Trial(29.128 μs)
          :impl => "coll" => Trial(13.049 μs)
          :impl => "nonexpanding" => Trial(9.986 μs)

I see some fluctuations in [:comp => "filter"][:impl => "nonexpanding"]. Identical run:

2-element BenchmarkTools.BenchmarkGroup:
  tags: []
  :comp => "map" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "safe_coll" => Trial(11.101 μs)
          :impl => "vec" => Trial(49.540 μs)
          :impl => "coll" => Trial(3.826 μs)
          :impl => "man" => Trial(3.008 μs)
  :comp => "filter" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "base" => Trial(27.685 μs)
          :impl => "vec" => Trial(29.429 μs)
          :impl => "coll" => Trial(14.379 μs)
          :impl => "nonexpanding" => Trial(12.951 μs)

92e0d90 with 1.4.1

2-element BenchmarkTools.BenchmarkGroup:
  tags: []
  :comp => "map" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "safe_coll" => Trial(8.196 μs)
          :impl => "vec" => Trial(50.837 μs)
          :impl => "coll" => Trial(3.704 μs)
          :impl => "man" => Trial(3.345 μs)
  :comp => "filter" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "base" => Trial(28.793 μs)
          :impl => "vec" => Trial(27.695 μs)
          :impl => "coll" => Trial(37.804 μs)
          :impl => "nonexpanding" => Trial(34.764 μs)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants