Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

JETAnalyzer: enable concrete eval for safe methods #529

Merged
merged 2 commits into from
May 31, 2023
Merged

JETAnalyzer: enable concrete eval for safe methods #529

merged 2 commits into from
May 31, 2023

Conversation

aviatesk
Copy link
Owner

No description provided.

@github-actions
Copy link

github-actions bot commented May 31, 2023 •
edited
Loading

JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 31 May 2023 - 09:23
  • Baseline: 31 May 2023 - 09:36
  • Package commits:
  • Target: cdd809
  • Baseline: f2705c
  • Julia commits:
  • Target: 318f0e
  • Baseline: 318f0e
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["First-Time-To-JET", "rand(Bool)"] 1.14 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass}", "identity(nothing)"] 0.93 (5%) ✅ 1.00 (1%)
["JETAnalyzer{SoundPass}", "identity(nothing)"] 1.07 (5%) ❌ 1.00 (1%)
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 1.09 (5%) ❌ 1.00 (1%)
["OptAnalyzer", "identity(nothing)"] 1.08 (5%) ❌ 1.00 (1%)
["show(::IO, ::JETCallResult)", "report_opt"] 1.10 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1402
Commit 318f0ead957 (2023-05-30 19:29 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 7528 s 0 s 298 s 2886 s 0 s
 #2 2793 MHz 2603 s 0 s 216 s 7877 s 0 s
 Memory: 6.781208038330078 GB (4471.62109375 MB free)
 Uptime: 1077.25 sec
 Load Avg: 1.01 1.02 0.77
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1402
Commit 318f0ead957 (2023-05-30 19:29 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 13348 s 0 s 438 s 4895 s 0 s
 #2 2793 MHz 4900 s 0 s 315 s 13440 s 0 s
 Memory: 6.781208038330078 GB (4489.98046875 MB free)
 Uptime: 1875.0 sec
 Load Avg: 1.0 1.01 0.94
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 31 May 2023 - 9:23
  • Package commit: cdd809
  • Julia commit: 318f0e
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 218.336 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 612.625 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 221.023 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 50.586 ms (5%) 2.17 MiB (1%) 38064
["JETAnalyzer{BasicPass} top-level", "self analysis"] 13.256 s (5%) 1.218 s 1.26 GiB (1%) 23134592
["JETAnalyzer{BasicPass} top-level", "simple"] 9.429 ms (5%) 2.08 MiB (1%) 35948
["JETAnalyzer{BasicPass}", "identity(nothing)"] 86.500 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 146.211 ms (5%) 37.63 MiB (1%) 703622
["JETAnalyzer{BasicPass}", "rand(Bool)"] 51.085 ms (5%) 14.64 MiB (1%) 266629
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 135.800 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.207 ms (5%) 1.93 MiB (1%) 33675
["JETAnalyzer{SoundPass}", "identity(nothing)"] 93.900 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 212.515 ms (5%) 36.061 ms 54.03 MiB (1%) 784345
["JETAnalyzer{SoundPass}", "rand(Bool)"] 52.608 ms (5%) 16.99 MiB (1%) 284504
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 153.099 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.017 ms (5%) 1.99 MiB (1%) 34844
["OptAnalyzer", "identity(nothing)"] 133.100 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 533.066 ms (5%) 64.711 ms 199.91 MiB (1%) 2953926
["OptAnalyzer", "rand(Bool)"] 28.852 ms (5%) 13.72 MiB (1%) 203671
["OptAnalyzer", "sum(\"julia\") (cached)"] 253.999 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 13.939 ms (5%) 5.84 MiB (1%) 87265
["show(::IO, ::JETCallResult)", "report_call"] 4.948 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 23.900 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1402
Commit 318f0ead957 (2023-05-30 19:29 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 7528 s 0 s 298 s 2886 s 0 s
 #2 2793 MHz 2603 s 0 s 216 s 7877 s 0 s
 Memory: 6.781208038330078 GB (4471.62109375 MB free)
 Uptime: 1077.25 sec
 Load Avg: 1.01 1.02 0.77
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 31 May 2023 - 9:36
  • Package commit: f2705c
  • Julia commit: 318f0e
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 215.545 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 539.138 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 218.512 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 50.726 ms (5%) 2.17 MiB (1%) 38064
["JETAnalyzer{BasicPass} top-level", "self analysis"] 13.522 s (5%) 1.270 s 1.25 GiB (1%) 23119489
["JETAnalyzer{BasicPass} top-level", "simple"] 9.441 ms (5%) 2.08 MiB (1%) 35948
["JETAnalyzer{BasicPass}", "identity(nothing)"] 92.700 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 150.278 ms (5%) 37.63 MiB (1%) 703623
["JETAnalyzer{BasicPass}", "rand(Bool)"] 51.074 ms (5%) 14.57 MiB (1%) 266628
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 130.399 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 7.080 ms (5%) 1.93 MiB (1%) 33675
["JETAnalyzer{SoundPass}", "identity(nothing)"] 87.700 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 214.541 ms (5%) 37.226 ms 54.02 MiB (1%) 784343
["JETAnalyzer{SoundPass}", "rand(Bool)"] 52.779 ms (5%) 16.92 MiB (1%) 284503
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 140.800 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.011 ms (5%) 1.99 MiB (1%) 34844
["OptAnalyzer", "identity(nothing)"] 123.600 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 536.205 ms (5%) 65.202 ms 199.91 MiB (1%) 2953927
["OptAnalyzer", "rand(Bool)"] 28.457 ms (5%) 13.72 MiB (1%) 203672
["OptAnalyzer", "sum(\"julia\") (cached)"] 259.600 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 13.556 ms (5%) 5.84 MiB (1%) 87265
["show(::IO, ::JETCallResult)", "report_call"] 4.931 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 21.700 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1402
Commit 318f0ead957 (2023-05-30 19:29 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 13348 s 0 s 438 s 4895 s 0 s
 #2 2793 MHz 4900 s 0 s 315 s 13440 s 0 s
 Memory: 6.781208038330078 GB (4489.98046875 MB free)
 Uptime: 1875.0 sec
 Load Avg: 1.0 1.01 0.94
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family: 6
Model: 106
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 6
BogoMIPS: 5586.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 96 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2.5 MiB (2 instances)
L3 cache: 48 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor :Intel
Architecture :UnknownIntel
Model Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (48, 1280, 49152) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
JET Benchmark Result

Judge result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmarks:
  • Target: 31 May 2023 - 09:53
  • Baseline: 31 May 2023 - 10:07
  • Package commits:
  • Target: 5b658b
  • Baseline: f2705c
  • Julia commits:
  • Target: 318f0e
  • Baseline: 318f0e
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["JETAnalyzer{BasicPass} top-level", "demo"] 1.10 (5%) ❌ 1.00 (1%)
["JETAnalyzer{BasicPass} top-level", "simple"] 0.94 (5%) ✅ 0.89 (1%) ✅
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 0.85 (5%) ✅ 0.89 (1%) ✅
["JETAnalyzer{BasicPass}", "rand(Bool)"] 0.83 (5%) ✅ 0.82 (1%) ✅
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 1.03 (5%) 0.88 (1%) ✅
["JETAnalyzer{SoundPass}", "identity(nothing)"] 1.05 (5%) ❌ 1.00 (1%)
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 0.86 (5%) ✅ 0.85 (1%) ✅
["JETAnalyzer{SoundPass}", "rand(Bool)"] 0.82 (5%) ✅ 0.80 (1%) ✅
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 1.07 (5%) ❌ 1.00 (1%)
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 0.91 (5%) ✅ 0.88 (1%) ✅
["show(::IO, ::JETCallResult)", "report_opt"] 1.15 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Target

Julia Version 1.10.0-DEV.1402
Commit 318f0ead957 (2023-05-30 19:29 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 2856 s 0 s 240 s 8459 s 0 s
 #2 2793 MHz 7308 s 0 s 280 s 3960 s 0 s
 Memory: 6.781208038330078 GB (4509.9921875 MB free)
 Uptime: 1163.8 sec
 Load Avg: 1.0 1.01 0.77
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline

Julia Version 1.10.0-DEV.1402
Commit 318f0ead957 (2023-05-30 19:29 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 5028 s 0 s 393 s 14106 s 0 s
 #2 2793 MHz 13269 s 0 s 368 s 5895 s 0 s
 Memory: 6.781208038330078 GB (4470.1953125 MB free)
 Uptime: 1962.73 sec
 Load Avg: 1.01 1.02 0.94
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Target result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 31 May 2023 - 9:53
  • Package commit: 5b658b
  • Julia commit: 318f0e
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 221.079 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 534.206 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 221.758 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 55.542 ms (5%) 2.17 MiB (1%) 38144
["JETAnalyzer{BasicPass} top-level", "self analysis"] 13.659 s (5%) 1.308 s 1.26 GiB (1%) 23687538
["JETAnalyzer{BasicPass} top-level", "simple"] 8.587 ms (5%) 1.84 MiB (1%) 32438
["JETAnalyzer{BasicPass}", "identity(nothing)"] 87.400 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 126.492 ms (5%) 33.33 MiB (1%) 626149
["JETAnalyzer{BasicPass}", "rand(Bool)"] 43.020 ms (5%) 12.01 MiB (1%) 221037
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 135.300 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 6.621 ms (5%) 1.69 MiB (1%) 30165
["JETAnalyzer{SoundPass}", "identity(nothing)"] 91.600 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 185.613 ms (5%) 35.352 ms 46.46 MiB (1%) 696374
["JETAnalyzer{SoundPass}", "rand(Bool)"] 43.766 ms (5%) 13.63 MiB (1%) 235409
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 146.100 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 6.412 ms (5%) 1.75 MiB (1%) 31279
["OptAnalyzer", "identity(nothing)"] 131.399 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 529.895 ms (5%) 64.051 ms 199.91 MiB (1%) 2953927
["OptAnalyzer", "rand(Bool)"] 28.730 ms (5%) 13.72 MiB (1%) 203672
["OptAnalyzer", "sum(\"julia\") (cached)"] 263.000 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 13.750 ms (5%) 5.83 MiB (1%) 87264
["show(::IO, ::JETCallResult)", "report_call"] 4.896 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 24.100 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1402
Commit 318f0ead957 (2023-05-30 19:29 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 2856 s 0 s 240 s 8459 s 0 s
 #2 2793 MHz 7308 s 0 s 280 s 3960 s 0 s
 Memory: 6.781208038330078 GB (4509.9921875 MB free)
 Uptime: 1163.8 sec
 Load Avg: 1.0 1.01 0.77
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Baseline result

Benchmark Report for /home/runner/work/JET.jl/JET.jl

Job Properties

  • Time of benchmark: 31 May 2023 - 10:7
  • Package commit: f2705c
  • Julia commit: 318f0e
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["First-Time-To-JET", "package loading"] 222.995 ms (5%) 64.73 KiB (1%) 19
["First-Time-To-JET", "rand(Bool)"] 525.373 ms (5%) 65.14 KiB (1%) 19
["First-Time-To-JET", "sum(\"julia\")"] 219.704 ms (5%) 65.14 KiB (1%) 19
["JETAnalyzer{BasicPass} top-level", "demo"] 50.526 ms (5%) 2.17 MiB (1%) 38064
["JETAnalyzer{BasicPass} top-level", "self analysis"] 13.603 s (5%) 1.286 s 1.25 GiB (1%) 23119471
["JETAnalyzer{BasicPass} top-level", "simple"] 9.097 ms (5%) 2.08 MiB (1%) 35948
["JETAnalyzer{BasicPass}", "identity(nothing)"] 85.400 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{BasicPass}", "println(QuoteNode(nothing))"] 148.970 ms (5%) 37.63 MiB (1%) 703622
["JETAnalyzer{BasicPass}", "rand(Bool)"] 51.833 ms (5%) 14.64 MiB (1%) 266629
["JETAnalyzer{BasicPass}", "sum(\"julia\") (cached)"] 131.600 μs (5%) 14.91 KiB (1%) 204
["JETAnalyzer{BasicPass}", "sum(\"julia\")"] 6.444 ms (5%) 1.93 MiB (1%) 33675
["JETAnalyzer{SoundPass}", "identity(nothing)"] 87.101 μs (5%) 7.41 KiB (1%) 107
["JETAnalyzer{SoundPass}", "println(QuoteNode(nothing))"] 214.617 ms (5%) 36.977 ms 54.39 MiB (1%) 784384
["JETAnalyzer{SoundPass}", "rand(Bool)"] 53.321 ms (5%) 16.99 MiB (1%) 284504
["JETAnalyzer{SoundPass}", "sum(\"julia\") (cached)"] 136.800 μs (5%) 18.81 KiB (1%) 241
["JETAnalyzer{SoundPass}", "sum(\"julia\")"] 7.065 ms (5%) 1.99 MiB (1%) 34844
["OptAnalyzer", "identity(nothing)"] 133.599 μs (5%) 25.62 KiB (1%) 370
["OptAnalyzer", "println(QuoteNode(nothing))"] 525.314 ms (5%) 62.669 ms 199.91 MiB (1%) 2953902
["OptAnalyzer", "rand(Bool)"] 28.400 ms (5%) 13.72 MiB (1%) 203671
["OptAnalyzer", "sum(\"julia\") (cached)"] 252.000 μs (5%) 58.16 KiB (1%) 801
["OptAnalyzer", "sum(\"julia\")"] 13.849 ms (5%) 5.84 MiB (1%) 87265
["show(::IO, ::JETCallResult)", "report_call"] 4.922 ms (5%) 724.26 KiB (1%) 6779
["show(::IO, ::JETCallResult)", "report_opt"] 21.000 μs (5%) 632 bytes (1%) 14

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["First-Time-To-JET"]
  • ["JETAnalyzer{BasicPass} top-level"]
  • ["JETAnalyzer{BasicPass}"]
  • ["JETAnalyzer{SoundPass}"]
  • ["OptAnalyzer"]
  • ["show(::IO, ::JETCallResult)"]

Julia versioninfo

Julia Version 1.10.0-DEV.1402
Commit 318f0ead957 (2023-05-30 19:29 UTC)
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.2 LTS
 uname: Linux 5.15.0-1037-azure #44-Ubuntu SMP Thu Apr 20 13:19:31 UTC 2023 x86_64 x86_64
 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: 
 speed user nice sys idle irq
 #1 2793 MHz 5028 s 0 s 393 s 14106 s 0 s
 #2 2793 MHz 13269 s 0 s 368 s 5895 s 0 s
 Memory: 6.781208038330078 GB (4470.1953125 MB free)
 Uptime: 1962.73 sec
 Load Avg: 1.01 1.02 0.94
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, icelake-server)
 Threads: 1 on 2 virtual cores

Runtime information

Runtime Info
BLAS #threads 1
BLAS.vendor() lbt
Sys.CPU_THREADS 2

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
CPU family: 6
Model: 106
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
Stepping: 6
BogoMIPS: 5586.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 96 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 2.5 MiB (2 instances)
L3 cache: 48 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0,1
Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported
Vulnerability L1tf: Mitigation; PTE Inversion
Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown
Vulnerability Meltdown: Mitigation; PTI
Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Retbleed: Not affected
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown

Cpu Property Value
Brand Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Vendor :Intel
Architecture :UnknownIntel
Model Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00
Cores 2 physical cores, 2 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (48, 1280, 49152) kbytes
64 byte cache line size
Address Size 48 bits virtual, 46 bits physical
SIMD 512 bit = 64 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC increased at every clock cycle (non-invariant TSC)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@codecov-commenter
Copy link

codecov-commenter commented May 31, 2023 •
edited
Loading

Codecov Report

Patch coverage: 88.23% and project coverage change: -0.05 ⚠️

Comparison is base (f2705cf) 89.36% compared to head (28437e4) 89.32%.

❗ Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.

Additional details and impacted files 
@@            Coverage Diff             @@
##           master     #529      +/-   ##
==========================================
- Coverage   89.36%   89.32%   -0.05%     
==========================================
  Files          10       10              
  Lines        3019     3016       -3     
==========================================
- Hits         2698     2694       -4     
- Misses        321      322       +1
Impacted Files Coverage Δ
src/analyzers/jetanalyzer.jl 86.50% <88.23%> (-0.20%) ⬇️

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@aviatesk aviatesk changed the title JETAnalyzer: enable concrete eval for Base._tuple_unique_fieldtypes JETAnalyzer: enable concrete eval for safe methods May 31, 2023
@aviatesk aviatesk merged commit 5ea6503 into master May 31, 2023
@aviatesk aviatesk deleted the avi/jetanalyzer-accuracy branch May 31, 2023 11:10
@aviatesk aviatesk mentioned this pull request Jun 1, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@aviatesk @codecov-commenter