Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallel tests exit with wrong status #20027

Closed
tkelman opened this issue Jan 14, 2017 · 4 comments
Closed

Parallel tests exit with wrong status #20027

tkelman opened this issue Jan 14, 2017 · 4 comments
Labels
bug Indicates an unexpected problem or unintended behavior priority This should be addressed urgently testsystem The unit testing framework and Test stdlib
Milestone
0.6.0

Comments

@tkelman
Copy link
Contributor

tkelman commented Jan 14, 2017

Over at least the last few weeks, when tests get run in parallel (as on CI) and there's a failure, the overall execution isn't exiting with a nonzero status like it should be. This has been hiding several issues. For example,

~/Julia/julia-0.6$ git checkout -q e9380c00d1d
~/Julia/julia-0.6$ make && for cores in 2 1; do JULIA_CPU_CORES=$cores usr/bin/julia test/runtests.jl abstractarray int; done
Test (Worker)     | Time (s) | GC (s) | GC % | Alloc (MB) | RSS (MB)
int (3)           |    4.92  |  0.33  |  6.8 | 56.74      | 213.37
Worker 1 failed running test abstractarray:
UndefVarError: TestMain_abstractarray not defined
 in deserialize(::Base.ClusterSerializer{TCPSocket}, ::Type{Module}) at ./serialize.jl:604
 in handle_deserialize(::Base.ClusterSerializer{TCPSocket}, ::Int32) at ./serialize.jl:583
 in deserialize(::Base.ClusterSerializer{TCPSocket}) at ./serialize.jl:543
 in deserialize_datatype(::Base.ClusterSerializer{TCPSocket}) at ./serialize.jl:837
 in handle_deserialize(::Base.ClusterSerializer{TCPSocket}, ::Int32) at ./serialize.jl:573
 in deserialize(::Base.ClusterSerializer{TCPSocket}, ::DataType) at ./serialize.jl:903
 in deserialize_datatype(::Base.ClusterSerializer{TCPSocket}) at ./serialize.jl:850
 in handle_deserialize(::Base.ClusterSerializer{TCPSocket}, ::Int32) at ./serialize.jl:573
 in deserialize(::Base.ClusterSerializer{TCPSocket}, ::DataType) at ./serialize.jl:903
 in deserialize_datatype(::Base.ClusterSerializer{TCPSocket}) at ./serialize.jl:850
 in handle_deserialize(::Base.ClusterSerializer{TCPSocket}, ::Int32) at ./serialize.jl:573
 in deserialize_array(::Base.ClusterSerializer{TCPSocket}) at ./serialize.jl:720
 in handle_deserialize(::Base.ClusterSerializer{TCPSocket}, ::Int32) at ./serialize.jl:571
 in deserialize(::Base.ClusterSerializer{TCPSocket}, ::DataType) at ./serialize.jl:903
 in deserialize_datatype(::Base.ClusterSerializer{TCPSocket}) at ./serialize.jl:850
 in handle_deserialize(::Base.ClusterSerializer{TCPSocket}, ::Int32) at ./serialize.jl:573
 in deserialize(::Base.ClusterSerializer{TCPSocket}, ::DataType) at ./serialize.jl:903
 in deserialize_datatype(::Base.ClusterSerializer{TCPSocket}) at ./serialize.jl:850
 in handle_deserialize(::Base.ClusterSerializer{TCPSocket}, ::Int32) at ./serialize.jl:573
 in deserialize(::Base.ClusterSerializer{TCPSocket}, ::DataType) at ./serialize.jl:903
 in deserialize_datatype(::Base.ClusterSerializer{TCPSocket}) at ./serialize.jl:850
 in handle_deserialize(::Base.ClusterSerializer{TCPSocket}, ::Int32) at ./serialize.jl:573
 in deserialize_msg(::Base.ClusterSerializer{TCPSocket}, ::Type{Base.ResultMsg}) at ./multi.jl:120
 in deserialize_msg(::Base.ClusterSerializer{TCPSocket}) at ./multi.jl:130
 in message_handler_loop(::TCPSocket, ::TCPSocket, ::Bool) at ./multi.jl:1371
 in process_tcp_streams(::TCPSocket, ::TCPSocket, ::Bool) at ./multi.jl:1328
 in (::Base.##500#501{TCPSocket,TCPSocket,Bool})() at ./event.jl:71
Test Summary: |  Pass  Total
  Overall     | 10017  10017
    SUCCESS
Test (Worker)     | Time (s) | GC (s) | GC % | Alloc (MB) | RSS (MB)
abstractarray: Error During Test
  Test threw an exception of type BoundsError
  Expression: $(Expr(:escape, :(B[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(A[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(find(mask))))
  BoundsError: attempt to access 2×12 TestMain_abstractarray.T24Linear{Int64,2,(2,12)} at index [Base.LogicalIndex(Bool[true,true,false,false,false,false,false,true,true,true,true,true,false,true,true,false,false,false,true,false,true,true,true,true])]
  Stacktrace:
   [1] throw_boundserror(::TestMain_abstractarray.T24Linear{Int64,2,(2,12)}, ::Tuple{Base.LogicalIndex{Int64,BitArray{1}}}) at ./abstractarray.jl:365
   [2] checkbounds at ./abstractarray.jl:322 [inlined]
   [3] macro expansion at ./multidimensional.jl:369 [inlined]
   [4] _getindex at ./multidimensional.jl:366 [inlined]
   [5] getindex(::TestMain_abstractarray.T24Linear{Int64,2,(2,12)}, ::BitArray{1}) at ./abstractarray.jl:793
   [6] test_vector_indexing(::Type{TestMain_abstractarray.T24Linear}, ::Tuple{Int64,Int64}, ::Type{TestMain_abstractarray.TestAbstractArray}) at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:378
   [7] macro expansion; at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:701 [inlined]
   [8] anonymous at ./<missing>:?
   [9] include_from_node1(::String) at ./loading.jl:532
   [10] include(::String) at ./sysimg.jl:14
   [11] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:13 [inlined]
   [12] macro expansion; at ./test.jl:842 [inlined]
   [13] macro expansion; at ./util.jl:288 [inlined]
   [14] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:0 [inlined]
   [15] anonymous at ./<missing>:?
abstractarray: Error During Test
  Test threw an exception of type BoundsError
  Expression: $(Expr(:escape, :(B[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(A[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(find(mask))))
  BoundsError: attempt to access 2×3×4 TestMain_abstractarray.T24Linear{Int64,3,(2,3,4)} at index [Base.LogicalIndex(Bool[false,false,false,false,false,true,true,false,true,true,false,true,false,false,true,true,false,false,false,false,true,true,false,false])]
  Stacktrace:
   [1] throw_boundserror(::TestMain_abstractarray.T24Linear{Int64,3,(2,3,4)}, ::Tuple{Base.LogicalIndex{Int64,BitArray{1}}}) at ./abstractarray.jl:365
   [2] checkbounds at ./abstractarray.jl:322 [inlined]
   [3] macro expansion at ./multidimensional.jl:369 [inlined]
   [4] _getindex at ./multidimensional.jl:366 [inlined]
   [5] getindex(::TestMain_abstractarray.T24Linear{Int64,3,(2,3,4)}, ::BitArray{1}) at ./abstractarray.jl:793
   [6] test_vector_indexing(::Type{TestMain_abstractarray.T24Linear}, ::Tuple{Int64,Int64,Int64}, ::Type{TestMain_abstractarray.TestAbstractArray}) at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:378
   [7] macro expansion; at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:701 [inlined]
   [8] anonymous at ./<missing>:?
   [9] include_from_node1(::String) at ./loading.jl:532
   [10] include(::String) at ./sysimg.jl:14
   [11] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:13 [inlined]
   [12] macro expansion; at ./test.jl:842 [inlined]
   [13] macro expansion; at ./util.jl:288 [inlined]
   [14] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:0 [inlined]
   [15] anonymous at ./<missing>:?
abstractarray: Error During Test
  Test threw an exception of type BoundsError
  Expression: $(Expr(:escape, :(B[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(A[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(find(mask))))
  BoundsError: attempt to access 1×2×3×4 TestMain_abstractarray.T24Linear{Int64,4,(1,2,3,4)} at index [Base.LogicalIndex(Bool[true,false,false,true,false,true,false,false,false,true,false,true,false,false,true,true,true,true,true,true,true,false,true,true])]
  Stacktrace:
   [1] throw_boundserror(::TestMain_abstractarray.T24Linear{Int64,4,(1,2,3,4)}, ::Tuple{Base.LogicalIndex{Int64,BitArray{1}}}) at ./abstractarray.jl:365
   [2] checkbounds at ./abstractarray.jl:322 [inlined]
   [3] macro expansion at ./multidimensional.jl:369 [inlined]
   [4] _getindex at ./multidimensional.jl:366 [inlined]
   [5] getindex(::TestMain_abstractarray.T24Linear{Int64,4,(1,2,3,4)}, ::BitArray{1}) at ./abstractarray.jl:793
   [6] test_vector_indexing(::Type{TestMain_abstractarray.T24Linear}, ::NTuple{4,Int64}, ::Type{TestMain_abstractarray.TestAbstractArray}) at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:378
   [7] macro expansion; at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:701 [inlined]
   [8] anonymous at ./<missing>:?
   [9] include_from_node1(::String) at ./loading.jl:532
   [10] include(::String) at ./sysimg.jl:14
   [11] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:13 [inlined]
   [12] macro expansion; at ./test.jl:842 [inlined]
   [13] macro expansion; at ./util.jl:288 [inlined]
   [14] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:0 [inlined]
   [15] anonymous at ./<missing>:?
abstractarray: Error During Test
  Test threw an exception of type BoundsError
  Expression: $(Expr(:escape, :(B[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(A[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(find(mask))))
  BoundsError: attempt to access 4×3×2×1 TestMain_abstractarray.T24Linear{Int64,4,(4,3,2,1)} at index [Base.LogicalIndex(Bool[true,false,false,false,true,true,false,false,true,true,false,false,false,true,true,false,false,false,true,true,true,true,true,false])]
  Stacktrace:
   [1] throw_boundserror(::TestMain_abstractarray.T24Linear{Int64,4,(4,3,2,1)}, ::Tuple{Base.LogicalIndex{Int64,BitArray{1}}}) at ./abstractarray.jl:365
   [2] checkbounds at ./abstractarray.jl:322 [inlined]
   [3] macro expansion at ./multidimensional.jl:369 [inlined]
   [4] _getindex at ./multidimensional.jl:366 [inlined]
   [5] getindex(::TestMain_abstractarray.T24Linear{Int64,4,(4,3,2,1)}, ::BitArray{1}) at ./abstractarray.jl:793
   [6] test_vector_indexing(::Type{TestMain_abstractarray.T24Linear}, ::NTuple{4,Int64}, ::Type{TestMain_abstractarray.TestAbstractArray}) at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:378
   [7] macro expansion; at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:701 [inlined]
   [8] anonymous at ./<missing>:?
   [9] include_from_node1(::String) at ./loading.jl:532
   [10] include(::String) at ./sysimg.jl:14
   [11] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:13 [inlined]
   [12] macro expansion; at ./test.jl:842 [inlined]
   [13] macro expansion; at ./util.jl:288 [inlined]
   [14] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:0 [inlined]
   [15] anonymous at ./<missing>:?
abstractarray: Error During Test
  Test threw an exception of type BoundsError
  Expression: $(Expr(:escape, :(B[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(A[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(find(mask))))
  BoundsError: attempt to access 2×12 TestMain_abstractarray.TSlow{Int64,2} at index [Base.LogicalIndex(Bool[true,true,false,false,false,false,false,true,false,true,false,false,true,true,false,false,true,false,true,false,true,false,true,false])]
  Stacktrace:
   [1] throw_boundserror(::TestMain_abstractarray.TSlow{Int64,2}, ::Tuple{Base.LogicalIndex{Int64,BitArray{1}}}) at ./abstractarray.jl:365
   [2] checkbounds at ./abstractarray.jl:322 [inlined]
   [3] macro expansion at ./multidimensional.jl:369 [inlined]
   [4] _getindex at ./multidimensional.jl:366 [inlined]
   [5] getindex(::TestMain_abstractarray.TSlow{Int64,2}, ::BitArray{1}) at ./abstractarray.jl:793
   [6] test_vector_indexing(::Type{TestMain_abstractarray.TSlow}, ::Tuple{Int64,Int64}, ::Type{TestMain_abstractarray.TestAbstractArray}) at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:378
   [7] macro expansion; at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:701 [inlined]
   [8] anonymous at ./<missing>:?
   [9] include_from_node1(::String) at ./loading.jl:532
   [10] include(::String) at ./sysimg.jl:14
   [11] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:13 [inlined]
   [12] macro expansion; at ./test.jl:842 [inlined]
   [13] macro expansion; at ./util.jl:288 [inlined]
   [14] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:0 [inlined]
   [15] anonymous at ./<missing>:?
abstractarray: Error During Test
  Test threw an exception of type BoundsError
  Expression: $(Expr(:escape, :(B[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(A[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(find(mask))))
  BoundsError: attempt to access 2×3×4 TestMain_abstractarray.TSlow{Int64,3} at index [Base.LogicalIndex(Bool[true,false,true,true,true,false,false,true,true,false,false,false,false,true,false,true,false,true,false,true,true,true,true,true])]
  Stacktrace:
   [1] throw_boundserror(::TestMain_abstractarray.TSlow{Int64,3}, ::Tuple{Base.LogicalIndex{Int64,BitArray{1}}}) at ./abstractarray.jl:365
   [2] checkbounds at ./abstractarray.jl:322 [inlined]
   [3] macro expansion at ./multidimensional.jl:369 [inlined]
   [4] _getindex at ./multidimensional.jl:366 [inlined]
   [5] getindex(::TestMain_abstractarray.TSlow{Int64,3}, ::BitArray{1}) at ./abstractarray.jl:793
   [6] test_vector_indexing(::Type{TestMain_abstractarray.TSlow}, ::Tuple{Int64,Int64,Int64}, ::Type{TestMain_abstractarray.TestAbstractArray}) at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:378
   [7] macro expansion; at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:701 [inlined]
   [8] anonymous at ./<missing>:?
   [9] include_from_node1(::String) at ./loading.jl:532
   [10] include(::String) at ./sysimg.jl:14
   [11] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:13 [inlined]
   [12] macro expansion; at ./test.jl:842 [inlined]
   [13] macro expansion; at ./util.jl:288 [inlined]
   [14] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:0 [inlined]
   [15] anonymous at ./<missing>:?
abstractarray: Error During Test
  Test threw an exception of type BoundsError
  Expression: $(Expr(:escape, :(B[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(A[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(find(mask))))
  BoundsError: attempt to access 1×2×3×4 TestMain_abstractarray.TSlow{Int64,4} at index [Base.LogicalIndex(Bool[false,true,false,true,true,true,true,true,true,false,false,true,true,true,false,false,false,true,false,false,true,true,true,true])]
  Stacktrace:
   [1] throw_boundserror(::TestMain_abstractarray.TSlow{Int64,4}, ::Tuple{Base.LogicalIndex{Int64,BitArray{1}}}) at ./abstractarray.jl:365
   [2] checkbounds at ./abstractarray.jl:322 [inlined]
   [3] macro expansion at ./multidimensional.jl:369 [inlined]
   [4] _getindex at ./multidimensional.jl:366 [inlined]
   [5] getindex(::TestMain_abstractarray.TSlow{Int64,4}, ::BitArray{1}) at ./abstractarray.jl:793
   [6] test_vector_indexing(::Type{TestMain_abstractarray.TSlow}, ::NTuple{4,Int64}, ::Type{TestMain_abstractarray.TestAbstractArray}) at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:378
   [7] macro expansion; at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:701 [inlined]
   [8] anonymous at ./<missing>:?
   [9] include_from_node1(::String) at ./loading.jl:532
   [10] include(::String) at ./sysimg.jl:14
   [11] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:13 [inlined]
   [12] macro expansion; at ./test.jl:842 [inlined]
   [13] macro expansion; at ./util.jl:288 [inlined]
   [14] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:0 [inlined]
   [15] anonymous at ./<missing>:?
abstractarray: Error During Test
  Test threw an exception of type BoundsError
  Expression: $(Expr(:escape, :(B[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(A[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(find(mask))))
  BoundsError: attempt to access 4×3×2×1 TestMain_abstractarray.TSlow{Int64,4} at index [Base.LogicalIndex(Bool[false,false,true,false,false,false,false,true,true,true,true,false,true,false,true,true,false,false,false,true,false,false,true,false])]
  Stacktrace:
   [1] throw_boundserror(::TestMain_abstractarray.TSlow{Int64,4}, ::Tuple{Base.LogicalIndex{Int64,BitArray{1}}}) at ./abstractarray.jl:365
   [2] checkbounds at ./abstractarray.jl:322 [inlined]
   [3] macro expansion at ./multidimensional.jl:369 [inlined]
   [4] _getindex at ./multidimensional.jl:366 [inlined]
   [5] getindex(::TestMain_abstractarray.TSlow{Int64,4}, ::BitArray{1}) at ./abstractarray.jl:793
   [6] test_vector_indexing(::Type{TestMain_abstractarray.TSlow}, ::NTuple{4,Int64}, ::Type{TestMain_abstractarray.TestAbstractArray}) at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:378
   [7] macro expansion; at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:701 [inlined]
   [8] anonymous at ./<missing>:?
   [9] include_from_node1(::String) at ./loading.jl:532
   [10] include(::String) at ./sysimg.jl:14
   [11] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:13 [inlined]
   [12] macro expansion; at ./test.jl:842 [inlined]
   [13] macro expansion; at ./util.jl:288 [inlined]
   [14] macro expansion; at /home/tkelman/Julia/julia-0.6/test/testdefs.jl:0 [inlined]
   [15] anonymous at ./<missing>:?
int (1)           |    2.51  |  0.02  |  0.7 | 50.27      | 321.00
Worker 1 failed running test abstractarray:
Some tests did not pass: 2776 passed, 0 failed, 8 errored, 0 broken.abstractarray: Error During Test
  Test threw an exception of type BoundsError
  Expression: $(Expr(:escape, :(B[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(A[vec(mask)]))) $(Expr(:escape, :(==))) $(Expr(:escape, :(find(mask))))
ERROR: LoadError: MethodError: no method matching size(::TestMain_abstractarray.T24Linear{Int64,2,(2,12)})
The applicable method may be too new: running in world age 20887, while current world is 20976.
Closest candidates are:
  size{T,N,dims}(::TestMain_abstractarray.T24Linear{T,N,dims}) at /home/tkelman/Julia/julia-0.6/test/abstractarray.jl:190 (method too new to be called from this world context.)
  size{T,N}(::AbstractArray{T,N}, !Matched::Any) at abstractarray.jl:22
  size{N}(::Any, !Matched::Integer, !Matched::Integer, !Matched::Integer...) at abstractarray.jl:23
  ...
Stacktrace:
 [1] summary(::TestMain_abstractarray.T24Linear{Int64,2,(2,12)}) at ./show.jl:1533
 [2] showerror(::IOContext{Base.AbstractIOBuffer{Array{UInt8,1}}}, ::BoundsError) at ./replutil.jl:163
 [3] (::Base.##755#756{BoundsError})(::IOContext{Base.AbstractIOBuffer{Array{UInt8,1}}}) at ./replutil.jl:198
 [4] #with_output_color#793(::Bool, ::Function, ::Function, ::Symbol, ::Base.AbstractIOBuffer{Array{UInt8,1}}) at ./util.jl:310
 [5] with_output_color(::Function, ::Symbol, ::Base.AbstractIOBuffer{Array{UInt8,1}}) at ./util.jl:307
 [6] #showerror#754(::Bool, ::Function, ::Base.AbstractIOBuffer{Array{UInt8,1}}, ::BoundsError, ::Array{Ptr{Void},1}) at ./replutil.jl:197
 [7] showerror(::Base.AbstractIOBuffer{Array{UInt8,1}}, ::BoundsError, ::Array{Ptr{Void},1}) at ./replutil.jl:196
 [8] #sprint#208(::Void, ::Function, ::Int64, ::Function, ::BoundsError, ::Vararg{Any,N}) at ./strings/io.jl:55
 [9] show(::Base.TTY, ::Base.Test.Error) at ./test.jl:138
 [10] print(::Base.TTY, ::Base.Test.Error) at ./strings/io.jl:18
 [11] record(::Base.Test.DefaultTestSet, ::Base.Test.Error) at ./test.jl:558
 [12] (::##33#41)() at /home/tkelman/Julia/julia-0.6/test/runtests.jl:170
 [13] cd(::##33#41, ::String) at ./file.jl:69
 [14] include_from_node1(::String) at ./loading.jl:532
 [15] include(::String) at ./sysimg.jl:14
 [16] process_options(::Base.JLOptions) at ./client.jl:308
 [17] _start() at ./client.jl:374
while loading /home/tkelman/Julia/julia-0.6/test/runtests.jl, in expression starting on line 38

The abstractarray failure here isn't the important part (it was fixed by #20018), this issue is about that fact that tests "passed" with the failure present.
@tkelman tkelman added bug Indicates an unexpected problem or unintended behavior testsystem The unit testing framework and Test stdlib labels Jan 14, 2017
@tkelman tkelman mentioned this issue Jan 14, 2017
Merged
3 tasks
@vchuravy vchuravy added this to the 0.6.0 milestone Jan 14, 2017
@Keno Keno mentioned this issue Jan 15, 2017
Merged
@JeffBezanson JeffBezanson added the priority This should be addressed urgently label Jan 20, 2017
@JeffBezanson JeffBezanson mentioned this issue Jan 20, 2017
Merged
@tkelman tkelman mentioned this issue Jan 20, 2017
Merged
@amitmurthy amitmurthy mentioned this issue Jan 24, 2017
Merged
@tkelman
Copy link
Contributor Author

tkelman commented Jan 24, 2017

Now that I know what to test for (see discussion in #20210, throwing a BoundsError that has a custom array type in one of its fields that isn't defined on node 1 is a good test case for this), it bisected to 8982605. I'm glad @kshyatt put in the work to make the version of that PR that we wound up merging bisect-clean.

@amitmurthy
Copy link
Contributor

@kshyatt prior to 8982605 were the error and stacktrace printed in the worker itself?

@amitmurthy
Copy link
Contributor

@tkelman care to open an issue for #20027 (comment) ? Else I'll do it later.

@tkelman
Copy link
Contributor Author

tkelman commented Jan 25, 2017

It sounds as though you may have more ideas on alternatives we could try than I do.

This was referenced Jan 25, 2017
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Indicates an unexpected problem or unintended behavior priority This should be addressed urgently testsystem The unit testing framework and Test stdlib
Projects
None yet
Milestone
0.6.0
Development

No branches or pull requests
4 participants
@amitmurthy @vchuravy @JeffBezanson @tkelman