-
Notifications
You must be signed in to change notification settings - Fork 5
/
1.5.0-DEV-7206b56e94.log
519 lines (466 loc) · 20.5 KB
/
1.5.0-DEV-7206b56e94.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
Julia Version 1.5.0-DEV.485
Commit 7206b56e94 (2020-03-18 17:25 UTC)
Platform Info:
OS: Linux (x86_64-linux-gnu)
CPU: Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-9.0.1 (ORCJIT, skylake)
Environment:
JULIA_DEPOT_PATH = ::/usr/local/share/julia
JULIA_NUM_THREADS = 2
Resolving package versions...
Installed SortingAlgorithms ──────────── v0.3.1
Installed Arpack_jll ─────────────────── v3.5.0+2
Installed PDMats ─────────────────────── v0.9.12
Installed Rmath_jll ──────────────────── v0.2.2+0
Installed Roots ──────────────────────── v0.8.4
Installed Parameters ─────────────────── v0.12.0
Installed CalibrationTests ───────────── v0.3.0
Installed Distributions ──────────────── v0.22.6
Installed QuadGK ─────────────────────── v2.3.1
Installed StatsBase ──────────────────── v0.32.2
Installed ZygoteRules ────────────────── v0.2.0
Installed OpenBLAS_jll ───────────────── v0.3.7+7
Installed Combinatorics ──────────────── v1.0.0
Installed CompilerSupportLibraries_jll ─ v0.3.0+0
Installed Reexport ───────────────────── v0.2.0
Installed Distances ──────────────────── v0.8.2
Installed StatsFuns ──────────────────── v0.9.4
Installed DataStructures ─────────────── v0.17.10
Installed OpenSpecFun_jll ────────────── v0.5.3+3
Installed Missings ───────────────────── v0.4.3
Installed DataAPI ────────────────────── v1.1.0
Installed Rmath ──────────────────────── v0.6.1
Installed RecipesBase ────────────────── v0.8.0
Installed SpecialFunctions ───────────── v0.10.0
Installed Polynomials ────────────────── v0.6.1
Installed HypothesisTests ────────────── v0.9.1
Installed Requires ───────────────────── v1.0.1
Installed Compat ─────────────────────── v3.8.0
Installed OrderedCollections ─────────── v1.1.0
Installed Arpack ─────────────────────── v0.4.0
Installed FillArrays ─────────────────── v0.8.5
Installed MacroTools ─────────────────── v0.5.4
Installed CalibrationErrors ──────────── v0.4.0
Installed KernelFunctions ────────────── v0.3.1
#=#=# ######################################################################## 100.0%
#=#=# ##O#- # ##O=# # ######################################################################## 100.0%
#=#=# 0.4%## 3.3%##### 7.6%######## 12.5%############# 19.4%#################### 27.9%########################### 37.9%###################################### 53.8%##################################################### 74.2%####################################################################### 98.6%######################################################################## 100.0%
#=#=# ## 3.0%###### 8.6%########### 16.2%################## 26.3%############################ 39.9%######################################### 57.0%###################################################### 76.3%######################################################################## 100.0%
#=#=# ######################################################################## 100.0%
Updating `~/.julia/environments/v1.5/Project.toml`
2818745e + CalibrationTests v0.3.0
Updating `~/.julia/environments/v1.5/Manifest.toml`
7d9fca2a + Arpack v0.4.0
68821587 + Arpack_jll v3.5.0+2
33913031 + CalibrationErrors v0.4.0
2818745e + CalibrationTests v0.3.0
861a8166 + Combinatorics v1.0.0
34da2185 + Compat v3.8.0
e66e0078 + CompilerSupportLibraries_jll v0.3.0+0
9a962f9c + DataAPI v1.1.0
864edb3b + DataStructures v0.17.10
b4f34e82 + Distances v0.8.2
31c24e10 + Distributions v0.22.6
1a297f60 + FillArrays v0.8.5
09f84164 + HypothesisTests v0.9.1
ec8451be + KernelFunctions v0.3.1
1914dd2f + MacroTools v0.5.4
e1d29d7a + Missings v0.4.3
4536629a + OpenBLAS_jll v0.3.7+7
efe28fd5 + OpenSpecFun_jll v0.5.3+3
bac558e1 + OrderedCollections v1.1.0
90014a1f + PDMats v0.9.12
d96e819e + Parameters v0.12.0
f27b6e38 + Polynomials v0.6.1
1fd47b50 + QuadGK v2.3.1
3cdcf5f2 + RecipesBase v0.8.0
189a3867 + Reexport v0.2.0
ae029012 + Requires v1.0.1
79098fc4 + Rmath v0.6.1
f50d1b31 + Rmath_jll v0.2.2+0
f2b01f46 + Roots v0.8.4
a2af1166 + SortingAlgorithms v0.3.1
276daf66 + SpecialFunctions v0.10.0
2913bbd2 + StatsBase v0.32.2
4c63d2b9 + StatsFuns v0.9.4
700de1a5 + ZygoteRules v0.2.0
2a0f44e3 + Base64
ade2ca70 + Dates
8bb1440f + DelimitedFiles
8ba89e20 + Distributed
b77e0a4c + InteractiveUtils
76f85450 + LibGit2
8f399da3 + Libdl
37e2e46d + LinearAlgebra
56ddb016 + Logging
d6f4376e + Markdown
a63ad114 + Mmap
44cfe95a + Pkg
de0858da + Printf
3fa0cd96 + REPL
9a3f8284 + Random
ea8e919c + SHA
9e88b42a + Serialization
1a1011a3 + SharedArrays
6462fe0b + Sockets
2f01184e + SparseArrays
10745b16 + Statistics
4607b0f0 + SuiteSparse
8dfed614 + Test
cf7118a7 + UUIDs
4ec0a83e + Unicode
Testing CalibrationTests
Status `/tmp/jl_usDmt5/Project.toml`
33913031 CalibrationErrors v0.4.0
2818745e CalibrationTests v0.3.0
31c24e10 Distributions v0.22.6
09f84164 HypothesisTests v0.9.1
d96e819e Parameters v0.12.0
1bc83da4 SafeTestsets v0.0.1
2913bbd2 StatsBase v0.32.2
4c63d2b9 StatsFuns v0.9.4
37e2e46d LinearAlgebra
9a3f8284 Random
10745b16 Statistics
8dfed614 Test
Status `/tmp/jl_usDmt5/Manifest.toml`
7d9fca2a Arpack v0.4.0
68821587 Arpack_jll v3.5.0+2
33913031 CalibrationErrors v0.4.0
2818745e CalibrationTests v0.3.0
861a8166 Combinatorics v1.0.0
34da2185 Compat v3.8.0
e66e0078 CompilerSupportLibraries_jll v0.3.0+0
9a962f9c DataAPI v1.1.0
864edb3b DataStructures v0.17.10
b4f34e82 Distances v0.8.2
31c24e10 Distributions v0.22.6
1a297f60 FillArrays v0.8.5
09f84164 HypothesisTests v0.9.1
ec8451be KernelFunctions v0.3.1
1914dd2f MacroTools v0.5.4
e1d29d7a Missings v0.4.3
4536629a OpenBLAS_jll v0.3.7+7
efe28fd5 OpenSpecFun_jll v0.5.3+3
bac558e1 OrderedCollections v1.1.0
90014a1f PDMats v0.9.12
d96e819e Parameters v0.12.0
f27b6e38 Polynomials v0.6.1
1fd47b50 QuadGK v2.3.1
3cdcf5f2 RecipesBase v0.8.0
189a3867 Reexport v0.2.0
ae029012 Requires v1.0.1
79098fc4 Rmath v0.6.1
f50d1b31 Rmath_jll v0.2.2+0
f2b01f46 Roots v0.8.4
1bc83da4 SafeTestsets v0.0.1
a2af1166 SortingAlgorithms v0.3.1
276daf66 SpecialFunctions v0.10.0
2913bbd2 StatsBase v0.32.2
4c63d2b9 StatsFuns v0.9.4
700de1a5 ZygoteRules v0.2.0
2a0f44e3 Base64
ade2ca70 Dates
8bb1440f DelimitedFiles
8ba89e20 Distributed
b77e0a4c InteractiveUtils
76f85450 LibGit2
8f399da3 Libdl
37e2e46d LinearAlgebra
56ddb016 Logging
d6f4376e Markdown
a63ad114 Mmap
44cfe95a Pkg
de0858da Printf
3fa0cd96 REPL
9a3f8284 Random
ea8e919c SHA
9e88b42a Serialization
1a1011a3 SharedArrays
6462fe0b Sockets
2f01184e SparseArrays
10745b16 Statistics
4607b0f0 SuiteSparse
8dfed614 Test
cf7118a7 UUIDs
4ec0a83e Unicode
Calibration test based on consistency resampling
------------------------------------------------
Population details:
parameter of interest: ECE
value under h_0: 0.0
point estimate: 0.03128778929612831
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 0.9000
Details:
Calibration test based on consistency resampling
------------------------------------------------
Population details:
parameter of interest: ECE
value under h_0: 0.0
point estimate: 0.48709480215974366
Test summary:
outcome with 95% confidence: reject h_0
one-sided p-value: <1e-99
Details:
Calibration test based on consistency resampling
------------------------------------------------
Population details:
parameter of interest: BiasedSKCE
value under h_0: 0.0
point estimate: 0.00026149645946610926
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 0.8660
Details:
Calibration test based on consistency resampling
------------------------------------------------
Population details:
parameter of interest: BiasedSKCE
value under h_0: 0.0
point estimate: 0.2076489334984309
Test summary:
outcome with 95% confidence: reject h_0
one-sided p-value: <1e-99
Details:
Calibration test based on consistency resampling
------------------------------------------------
Population details:
parameter of interest: LinearUnbiasedSKCE
value under h_0: 0.0
point estimate: -0.006350670869858721
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 0.7350
Details:
Calibration test based on consistency resampling
------------------------------------------------
Population details:
parameter of interest: LinearUnbiasedSKCE
value under h_0: 0.0
point estimate: 0.1833006000565324
Test summary:
outcome with 95% confidence: reject h_0
one-sided p-value: <1e-99
Details:
Calibration test based on consistency resampling
------------------------------------------------
Population details:
parameter of interest: QuadraticUnbiasedSKCE
value under h_0: 0.0
point estimate: -0.00036838382507119053
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 0.8190
Details:
Calibration test based on consistency resampling
------------------------------------------------
Population details:
parameter of interest: QuadraticUnbiasedSKCE
value under h_0: 0.0
point estimate: 0.20678205345072792
Test summary:
outcome with 95% confidence: reject h_0
one-sided p-value: <1e-99
Details:
Distribution-free calibration test
----------------------------------
Population details:
parameter of interest: BiasedSKCE
value under h_0: 0.0
point estimate: 0.00026149645946610926
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 1.0000
Details:
number of observations: 500
uniform bound of the terms of the estimator: 2
Distribution-free calibration test
----------------------------------
Population details:
parameter of interest: BiasedSKCE
value under h_0: 0.0
point estimate: 0.2076489334984309
Test summary:
outcome with 95% confidence: reject h_0
one-sided p-value: <1e-8
Details:
number of observations: 500
uniform bound of the terms of the estimator: 2
Distribution-free calibration test
----------------------------------
Population details:
parameter of interest: LinearUnbiasedSKCE
value under h_0: 0.0
point estimate: -0.006350670869858721
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 0.9987
Details:
number of observations: 500
uniform bound of the terms of the estimator: 2
Distribution-free calibration test
----------------------------------
Population details:
parameter of interest: LinearUnbiasedSKCE
value under h_0: 0.0
point estimate: 0.1833006000565324
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 0.3499
Details:
number of observations: 500
uniform bound of the terms of the estimator: 2
Distribution-free calibration test
----------------------------------
Population details:
parameter of interest: QuadraticUnbiasedSKCE
value under h_0: 0.0
point estimate: -0.00036838382507119053
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 1.0000
Details:
number of observations: 500
uniform bound of the terms of the estimator: 2
Distribution-free calibration test
----------------------------------
Population details:
parameter of interest: QuadraticUnbiasedSKCE
value under h_0: 0.0
point estimate: 0.20678205345072792
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 0.2628
Details:
number of observations: 500
uniform bound of the terms of the estimator: 2
Asymptotic calibration test based on the linear unbiased SKCE estimator
-----------------------------------------------------------------------
Population details:
parameter of interest: SKCE
value under h_0: 0.0
point estimate: -0.006350670869858721
95% confidence interval: (-0.0225, Inf)
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 0.7414
Details:
number of pairs of observations: 250
z-statistic: -0.6477854621449546
standard error of evaluations of pairs of observations: 0.009803663776013601
Asymptotic calibration test based on the linear unbiased SKCE estimator
-----------------------------------------------------------------------
Population details:
parameter of interest: SKCE
value under h_0: 0.0
point estimate: 0.1833006000565324
95% confidence interval: (0.1568, Inf)
Test summary:
outcome with 95% confidence: reject h_0
one-sided p-value: <1e-29
Details:
number of pairs of observations: 250
z-statistic: 11.361279411387867
standard error of evaluations of pairs of observations: 0.016133799145262005
Asymptotic calibration test based on the quadratic unbiased SKCE estimator
--------------------------------------------------------------------------
Population details:
parameter of interest: SKCE
value under h_0: 0.0
point estimate: -0.00036838382507119096
Test summary:
outcome with 95% confidence: fail to reject h_0
one-sided p-value: 0.8200
Details:
test statistic: -0.0006306185286757184
Asymptotic calibration test based on the quadratic unbiased SKCE estimator
--------------------------------------------------------------------------
Population details:
parameter of interest: SKCE
value under h_0: 0.0
point estimate: 0.20678205345072792
Test summary:
outcome with 95% confidence: reject h_0
one-sided p-value: <1e-99
Details:
test statistic: -0.0004524871550187071
Test Summary: | Pass Total
Binary trend tests | 18 18
Consistency test with ECE (2 classes)
Consistency test with ECE (5 classes)
Consistency test with ECE (10 classes)
Consistency test with the linear SKCE estimator (2 classes)
Consistency test with the linear SKCE estimator (5 classes)
Consistency test with the linear SKCE estimator (10 classes)
Test Summary: | Pass Total
Consistency test | 36 36
bounds: Error During Test at /home/pkgeval/.julia/packages/CalibrationTests/Ct9Zh/test/skce/distribution_free.jl:12
Got exception outside of a @test
type ScaledKernel has no field σ
Stacktrace:
[1] getproperty(::KernelFunctions.ScaledKernel{KernelFunctions.ExponentialKernel,Int64}, ::Symbol) at ./Base.jl:33
[2] uniformbound(::KernelFunctions.ScaledKernel{KernelFunctions.ExponentialKernel,Int64}) at /home/pkgeval/.julia/packages/CalibrationTests/Ct9Zh/src/skce/distribution_free.jl:66
[3] top-level scope at /home/pkgeval/.julia/packages/CalibrationTests/Ct9Zh/test/skce/distribution_free.jl:24
[4] top-level scope at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Test/src/Test.jl:1114
[5] top-level scope at /home/pkgeval/.julia/packages/CalibrationTests/Ct9Zh/test/skce/distribution_free.jl:14
[6] include(::Function, ::Module, ::String) at ./Base.jl:380
[7] include at ./Base.jl:368 [inlined]
[8] include(::String) at /home/pkgeval/.julia/packages/SafeTestsets/A83XK/src/SafeTestsets.jl:23
[9] top-level scope at /home/pkgeval/.julia/packages/CalibrationTests/Ct9Zh/test/runtests.jl:5
[10] top-level scope at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Test/src/Test.jl:1114
[11] top-level scope at /home/pkgeval/.julia/packages/CalibrationTests/Ct9Zh/test/runtests.jl:5
[12] eval(::Module, ::Any) at ./boot.jl:331
[13] top-level scope at /home/pkgeval/.julia/packages/SafeTestsets/A83XK/src/SafeTestsets.jl:23
[14] include(::String) at ./client.jl:441
[15] top-level scope at none:6
[16] eval(::Module, ::Any) at ./boot.jl:331
[17] exec_options(::Base.JLOptions) at ./client.jl:264
[18] _start() at ./client.jl:490
Test Summary: | Pass Error Total
Distribution-free tests | 222 1 223
bounds | 1 1
estimator and estimates | 216 216
consistency | 6 6
ERROR: LoadError: Some tests did not pass: 222 passed, 0 failed, 1 errored, 0 broken.
in expression starting at /home/pkgeval/.julia/packages/CalibrationTests/Ct9Zh/test/runtests.jl:5
ERROR: Package CalibrationTests errored during testing
Stacktrace:
[1] pkgerror(::String, ::Vararg{String,N} where N) at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Pkg/src/Types.jl:53
[2] test(::Pkg.Types.Context, ::Array{Pkg.Types.PackageSpec,1}; coverage::Bool, julia_args::Cmd, test_args::Cmd, test_fn::Nothing) at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Pkg/src/Operations.jl:1523
[3] test(::Pkg.Types.Context, ::Array{Pkg.Types.PackageSpec,1}; coverage::Bool, test_fn::Nothing, julia_args::Cmd, test_args::Cmd, kwargs::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}) at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:316
[4] test(::Pkg.Types.Context, ::Array{Pkg.Types.PackageSpec,1}) at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:303
[5] #test#68 at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:297 [inlined]
[6] test at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:297 [inlined]
[7] #test#67 at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:296 [inlined]
[8] test at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:296 [inlined]
[9] test(::String; kwargs::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}) at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:295
[10] test(::String) at /workspace/srcdir/usr/share/julia/stdlib/v1.5/Pkg/src/API.jl:295
[11] top-level scope at none:13