Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

sql/tests: TestRandomSyntaxFunctions failed #66514

Closed
cockroach-teamcity opened this issue Jun 16, 2021 · 3 comments
Closed

sql/tests: TestRandomSyntaxFunctions failed #66514

cockroach-teamcity opened this issue Jun 16, 2021 · 3 comments
Labels
C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot.
Milestone
21.1

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Jun 16, 2021 •
edited by cockroach-jira-scripts
Loading

sql/tests.TestRandomSyntaxFunctions failed with artifacts on release-21.1 @ af2c90b391faa0e0256b96269a0e3c2e29a0ca7b:

        	/usr/local/go/src/crypto/tls/conn.go:801 +0xf3
        crypto/tls.(*Conn).readRecordOrCCS(0xc002728e00, 0x0, 0x0, 0x86b631)
        	/usr/local/go/src/crypto/tls/conn.go:608 +0x115
        crypto/tls.(*Conn).readRecord(...)
        	/usr/local/go/src/crypto/tls/conn.go:576
        crypto/tls.(*Conn).Read(0xc002728e00, 0xc009ab8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        	/usr/local/go/src/crypto/tls/conn.go:1252 +0x15f
        github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*readTimeoutConn).Read(0xc0377e7b60, 0xc009ab8000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
        	/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:1680 +0x129
        bufio.(*Reader).fill(0xc009073b48)
        	/usr/local/go/src/bufio/bufio.go:101 +0x105
        bufio.(*Reader).ReadByte(0xc009073b48, 0x2282cae2, 0xed85b8377, 0x0)
        	/usr/local/go/src/bufio/bufio.go:253 +0x39
        github.com/cockroachdb/cockroach/pkg/sql/pgwire/pgwirebase.(*ReadBuffer).ReadTypedMsg(0xc009074308, 0x5b57120, 0xc009073b48, 0x5b4cc20, 0x8041068, 0x0, 0x0)
        	/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/pgwirebase/encoding.go:203 +0x35
        github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).serveImpl.func4(0xc009073b00, 0xc0091b46e0, 0xc001720000, 0xc01d8057cd, 0x5b69760, 0xc015f77300, 0xc01d805830, 0xc01d8057cc, 0xc02fd1e100, 0x0, ...)
        	/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:329 +0x71
        github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).serveImpl(0xc009073b00, 0x5b9e120, 0xc0161b5110, 0xc0091b46d0, 0xc001720000, 0x5400, 0x15000, 0xc0246ff900, 0x0, 0x4, ...)
        	/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:460 +0x565
        github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*Server).serveConn(0xc001a02500, 0x5b9e120, 0xc0161b5110, 0x5c02be0, 0xc002728e00, 0xc009ab4044, 0x4, 0xc0161b50e0, 0x5b4a3e0, 0xc01df3ac30, ...)
        	/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/conn.go:153 +0x1b8
        github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*Server).ServeConn(0xc001a02500, 0x5b9e120, 0xc0161b5110, 0x5c06ae0, 0xc0216ba0e0, 0x5b9e101, 0x0, 0x0)
        	/go/src/github.com/cockroachdb/cockroach/pkg/sql/pgwire/server.go:674 +0xdd8
        github.com/cockroachdb/cockroach/pkg/server.(*SQLServer).startServeSQL.func1.1(0x5c06ae0, 0xc0216ba0e0)
        	/go/src/github.com/cockroachdb/cockroach/pkg/server/server.go:2096 +0xf7
        github.com/cockroachdb/cockroach/pkg/util/netutil.(*Server).ServeWith.func1(0xc006a08200, 0x5b9e120, 0xc00b9345d0, 0xc007d7ce48, 0x5c06ae0, 0xc0216ba0e0, 0xc008a52f30)
        	/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:156 +0xaf
        created by github.com/cockroachdb/cockroach/pkg/util/netutil.(*Server).ServeWith
        	/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:153 +0x24a
        
        goroutine 3086091 [select]:
        google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0181648c0, 0x1, 0x0, 0x0, 0x0, 0x0)
        	/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125
        google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0139bac00, 0x0, 0x0)
        	/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3
        google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc004c63180)
        	/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b
        created by google.golang.org/grpc/internal/transport.newHTTP2Client
        	/go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc
        
    rsg_test.go:191: SELECT 1 executed successfully: probably a slow statement
    rsg_test.go:760: Crash detected: 
        SELECT st_buffer('010500000008000000010200000002000000E0008D0506ADED41A07A766D887EB2413CE9A543AA2802C238069D73295BF041010200000002000000EC62245F5089F6418EE6E6AB347A0242F0C5931F3AC4EA41224BAA50E0E7F54101020000000200000040ABD4851D1D0242D4C266CB24F0F3C1F0024A97872DD8C178F4CD6755F7F541010200000002000000F4731B03503E0142DE7E74F6260F0142B422D2D90F8002C284E54C434311F341010200000006000000188E8998AA57E9413839557910BAD0C1C0F707A0D46BA241A0644AE7EC5ACD41B037DFBF7704CCC1F8A3F94B60F6D54120F5F677E9B3EB41F8C7D90076B5F74166F9ED3F9B50E3C182598DA38793F841E645DA9BA1C3FFC1B03ABDB7D0A2F94101020000000200000098F233D6A04DDAC16C5BC3973AA7F341A4537180A0FF01C218E692C97DB5FE41010200000002000000D40E8B36E810E441266651D729A0F7C19C828B1F8119EE412EF53E86243DF7C1010200000002000000686DCBAAAA4FE3419F326A862542FEC12089896EE713D54110DD622C0675F7C1':::GEOMETRY, 3.4028234663852886e+38:::FLOAT8, 32767:::INT8) 
        
        Stack trace:
        timeout: "SELECT st_buffer('010500000008000000010200000002000000E0008D0506ADED41A07A766D887EB2413CE9A543AA2802C238069D73295BF041010200000002000000EC62245F5089F6418EE6E6AB347A0242F0C5931F3AC4EA41224BAA50E0E7F54101020000000200000040ABD4851D1D0242D4C266CB24F0F3C1F0024A97872DD8C178F4CD6755F7F541010200000002000000F4731B03503E0142DE7E74F6260F0142B422D2D90F8002C284E54C434311F341010200000006000000188E8998AA57E9413839557910BAD0C1C0F707A0D46BA241A0644AE7EC5ACD41B037DFBF7704CCC1F8A3F94B60F6D54120F5F677E9B3EB41F8C7D90076B5F74166F9ED3F9B50E3C182598DA38793F841E645DA9BA1C3FFC1B03ABDB7D0A2F94101020000000200000098F233D6A04DDAC16C5BC3973AA7F341A4537180A0FF01C218E692C97DB5FE41010200000002000000D40E8B36E810E441266651D729A0F7C19C828B1F8119EE412EF53E86243DF7C1010200000002000000686DCBAAAA4FE3419F326A862542FEC12089896EE713D54110DD622C0675F7C1':::GEOMETRY, 3.4028234663852886e+38:::FLOAT8, 32767:::INT8) ". currently executing: map[SELECT st_buffer('010500000008000000010200000002000000E0008D0506ADED41A07A766D887EB2413CE9A543AA2802C238069D73295BF041010200000002000000EC62245F5089F6418EE6E6AB347A0242F0C5931F3AC4EA41224BAA50E0E7F54101020000000200000040ABD4851D1D0242D4C266CB24F0F3C1F0024A97872DD8C178F4CD6755F7F541010200000002000000F4731B03503E0142DE7E74F6260F0142B422D2D90F8002C284E54C434311F341010200000006000000188E8998AA57E9413839557910BAD0C1C0F707A0D46BA241A0644AE7EC5ACD41B037DFBF7704CCC1F8A3F94B60F6D54120F5F677E9B3EB41F8C7D90076B5F74166F9ED3F9B50E3C182598DA38793F841E645DA9BA1C3FFC1B03ABDB7D0A2F94101020000000200000098F233D6A04DDAC16C5BC3973AA7F341A4537180A0FF01C218E692C97DB5FE41010200000002000000D40E8B36E810E441266651D729A0F7C19C828B1F8119EE412EF53E86243DF7C1010200000002000000686DCBAAAA4FE3419F326A862542FEC12089896EE713D54110DD622C0675F7C1':::GEOMETRY, 3.4028234663852886e+38:::FLOAT8, 32767:::INT8) :1]
    rsg_test.go:769: 1356454 executions, 765077 successful
    rsg_test.go:349: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestRandomSyntaxFunctions783033217
--- FAIL: TestRandomSyntaxFunctions (320.91s)
Reproduce

To reproduce, try: 

make stressrace TESTS=TestRandomSyntaxFunctions PKG=./pkg/sql/tests TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @rafiss

This test on roachdash | Improve this report!

Jira issue: CRDB-8072
@cockroach-teamcity cockroach-teamcity added branch-release-21.1 C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Jun 16, 2021
@cockroach-teamcity cockroach-teamcity added this to the 21.1 milestone Jun 16, 2021
@cockroach-teamcity cockroach-teamcity mentioned this issue Jun 17, 2021
Closed
This was referenced Jun 26, 2021
Closed
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Aug 12, 2021
Closed
This was referenced Aug 29, 2021
Closed
Closed
Closed
@cockroach-teamcity
Copy link
Member Author

sql/tests.TestRandomSyntaxFunctions failed with artifacts on release-21.1 @ a0c06b9fb07ecfd14df8e6a32ad8127d28668a57:

        	/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.go:1339 +0x37e
        github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2(0xc000efa200, 0x5be6b20, 0xc04bfd7800, 0x0, 0x0, 0xc041338fe0)
        	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:446 +0xf3
        created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx
        	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:438 +0x22b
        
        goroutine 3319053 [select, 3 minutes]:
        github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*baseQueue).processLoop.func2(0x5be6b20, 0xc02447efc0)
        	/go/src/github.com/cockroachdb/cockroach/pkg/kv/kvserver/queue.go:823 +0x168
        github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2(0xc000efa200, 0x5be6b20, 0xc02447efc0, 0x0, 0x0, 0xc04a34c060)
        	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:446 +0xf3
        created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx
        	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:438 +0x22b
        
        goroutine 3319320 [select]:
        github.com/cockroachdb/cockroach/pkg/sql/sqlliveness/slinstance.(*Instance).heartbeatLoop(0xc01946ccc0, 0x5be6a60, 0xc001fb8480)
        	/go/src/github.com/cockroachdb/cockroach/pkg/sql/sqlliveness/slinstance/slinstance.go:190 +0x19e
        github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2(0xc000efa200, 0x5be6b20, 0xc002c685d0, 0x0, 0x0, 0xc048b9e020)
        	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:446 +0xf3
        created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx
        	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:438 +0x22b
        
        goroutine 3319113 [select, 3 minutes]:
        github.com/cockroachdb/cockroach/pkg/security.(*CertificateManager).RegisterSignalHandler.func1(0xc000efa200, 0x5be6aa0, 0xc000074120, 0xc045ff62d0)
        	/go/src/github.com/cockroachdb/cockroach/pkg/security/certificate_manager.go:235 +0x159
        created by github.com/cockroachdb/cockroach/pkg/security.(*CertificateManager).RegisterSignalHandler
        	/go/src/github.com/cockroachdb/cockroach/pkg/security/certificate_manager.go:232 +0x65
        
    rsg_test.go:204: SELECT 1 executed successfully: probably a slow statement
    rsg_test.go:773: Crash detected: 
        SELECT st_buffer('0105000020E61000000500000001020000000200000094D5A7371A3C6340FB773FEF6D7E41C088364CDF5C2B554010A0DFD0BFB027C0010200000005000000126B45355DF35CC0C52687750F5349C07EA8F94306DC52C0A44E931EE05E50C01C62822FF1C34B40A96E45CB172C55C020FAC2A9F38D55400EB6669C673643C070793361E6125B4024441AB59D5B3E40010200000002000000C0F2FADB9E8006409319DF132DEF54C0F09D3C9423DF3BC09C6D521E1FD95540010200000004000000B343B7B345BF50C0E80ADC1DC99D35C0AC8D719C97AB46C0486D0B54EBE03CC0BD1B78E532EC61C0264BE23AEFB052C06063864B07991140899B38A86D3251C0010200000002000000C0EA537BD9FD5440003D5871C41B37C02C9D85A406C05F4068728C8833B22040':::GEOGRAPHY, 3.4028234663852886e+38:::FLOAT8, 32767:::INT8) 
        
        Stack trace:
        timeout: "SELECT st_buffer('0105000020E61000000500000001020000000200000094D5A7371A3C6340FB773FEF6D7E41C088364CDF5C2B554010A0DFD0BFB027C0010200000005000000126B45355DF35CC0C52687750F5349C07EA8F94306DC52C0A44E931EE05E50C01C62822FF1C34B40A96E45CB172C55C020FAC2A9F38D55400EB6669C673643C070793361E6125B4024441AB59D5B3E40010200000002000000C0F2FADB9E8006409319DF132DEF54C0F09D3C9423DF3BC09C6D521E1FD95540010200000004000000B343B7B345BF50C0E80ADC1DC99D35C0AC8D719C97AB46C0486D0B54EBE03CC0BD1B78E532EC61C0264BE23AEFB052C06063864B07991140899B38A86D3251C0010200000002000000C0EA537BD9FD5440003D5871C41B37C02C9D85A406C05F4068728C8833B22040':::GEOGRAPHY, 3.4028234663852886e+38:::FLOAT8, 32767:::INT8) ". currently executing: map[SELECT character_length(e'v\x14\fJ=\x1dd\x0e\x05':::STRING) :1 SELECT charout('V':::STRING) :1 SELECT cosd(1.6935149753696397:::FLOAT8) :1 SELECT covar_samp('Infinity':::DECIMAL, 7245233369863131249:::INT8) :1 SELECT covar_samp(234.6605084029131962:::DECIMAL, 'NaN':::FLOAT8) :1 SELECT covar_samp(7558898669728656738:::INT8, (-5.075905727691598672E+34):::DECIMAL) :1 SELECT covar_samp(8573266087308655507:::INT8, 0.3832108282870914:::FLOAT8) :1 SELECT st_buffer('0105000020E61000000500000001020000000200000094D5A7371A3C6340FB773FEF6D7E41C088364CDF5C2B554010A0DFD0BFB027C0010200000005000000126B45355DF35CC0C52687750F5349C07EA8F94306DC52C0A44E931EE05E50C01C62822FF1C34B40A96E45CB172C55C020FAC2A9F38D55400EB6669C673643C070793361E6125B4024441AB59D5B3E40010200000002000000C0F2FADB9E8006409319DF132DEF54C0F09D3C9423DF3BC09C6D521E1FD95540010200000004000000B343B7B345BF50C0E80ADC1DC99D35C0AC8D719C97AB46C0486D0B54EBE03CC0BD1B78E532EC61C0264BE23AEFB052C06063864B07991140899B38A86D3251C0010200000002000000C0EA537BD9FD5440003D5871C41B37C02C9D85A406C05F4068728C8833B22040':::GEOGRAPHY, 3.4028234663852886e+38:::FLOAT8, 32767:::INT8) :1]
    rsg_test.go:749: 4m0s of 5m0s: 1028938 executions, 587379 successful
    rsg_test.go:749: 4m5s of 5m0s: 1051795 executions, 599757 successful
    rsg_test.go:749: 4m10s of 5m0s: 1073257 executions, 611429 successful
    rsg_test.go:749: 4m15s of 5m0s: 1096187 executions, 623894 successful
    rsg_test.go:749: 4m20s of 5m0s: 1119130 executions, 636424 successful
    rsg_test.go:749: 4m25s of 5m0s: 1141616 executions, 648523 successful
    rsg_test.go:749: 4m30s of 5m0s: 1163982 executions, 660710 successful
    rsg_test.go:749: 4m35s of 5m0s: 1186245 executions, 672704 successful
    rsg_test.go:749: 4m40s of 5m0s: 1209203 executions, 685317 successful
    rsg_test.go:749: 4m45s of 5m0s: 1231776 executions, 697619 successful
    rsg_test.go:749: 4m50s of 5m0s: 1254109 executions, 709841 successful
    rsg_test.go:749: 4m55s of 5m0s: 1276849 executions, 722082 successful
    rsg_test.go:782: 1299415 executions, 734339 successful
    rsg_test.go:362: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestRandomSyntaxFunctions516821045
--- FAIL: TestRandomSyntaxFunctions (300.10s)
Reproduce

To reproduce, try: 

make stressrace TESTS=TestRandomSyntaxFunctions PKG=./pkg/sql/tests TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience @rafiss

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity mentioned this issue Sep 10, 2021
Closed
This was referenced Sep 21, 2021
Closed
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Sep 30, 2021
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Oct 8, 2021
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Oct 22, 2021
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Dec 20, 2021
Closed
@cockroach-teamcity
Copy link
Member Author

sql/tests.TestRandomSyntaxFunctions failed with artifacts on release-21.1 @ 4d2b93943c4333cfeabbe240465926f3b1f9e724:

        Stack trace:
        timeout: "SELECT st_buffer('0106000020E6100000090000000103000000010000000600000032E848A7E03C5DC08EF0E4BAA7E14DC00552E7FA622D63C022E22809D85655C0D0B4C64786B32BC02A6E2EC1C8A750C0D0487C98A03923C0205FE9EAB5F10240CC277738BCF740C080BBC5C01756534032E848A7E03C5DC08EF0E4BAA7E14DC0010300000001000000040000007C97958EB2D742C0B2972FC3133544C0F290FE1E14986340701C9D37BB211A402464E8EB9F626340F462BFB6117445407C97958EB2D742C0B2972FC3133544C00103000000010000000600000012ECC2B7618751C0A0EDF38A5AAC25C08C74DF0EE9F849408058E409E2E9E2BF8C1D0D80B7305D4022E3174B000D5140109F560479D331C0E2DB3E7397ED5040364F7A887E9859C0B4300F9C7A88554012ECC2B7618751C0A0EDF38A5AAC25C00103000000010000000C00000020050128304663C0061E7062614A3FC088C76F14BEB43740BC8D0574A91148C0CCA0B3727335454091F709E4CB1745C01CBBA01E8D325D4088B14ECD4AE451C078B77E0D3E684A4040AFE963A716F8BF4086A68835AE6440081F98E0EBDD2340409DFFDA518A534010C9741741DF2940FC57714FD2665440B0646F0AD2343F40D09602AE18CA3F40100E3DCE34F14740BD072663D0AA63C08C93410168B45340F27CB1B765645BC080EFEFBB2749EABF20050128304663C0061E7062614A3FC001030000000100000008000000F039D1E82AC255C020CA405983B50BC00038F18B75EFF63F40FAE3DF8F5C22C0487842E3E5864040AE7D8D45C90553C09890948280B45540FD773287B7BA51C0C681C6CDA4EF5140BEB9288B39075540C0D8BCDEDFD04B40B84E49252B555440E0DC374E4D6D26C0200EF9640B0A5340F039D1E82AC255C020CA405983B50BC00103000000010000000C00000041BEAC3970D958C0F6909606AA2B4BC0001147B3230EE5BF1CF532A9F8A836C064D5C52148EC42400A440038BDCB45C0D0A79E92EB5139406C05F1C37CB83BC09034AB99B5D656403C0187183F4450C048476F9B933363406CEDE440687132C0E005D44B4BA75540685AF855F8713140E070F45F1A352040DCDDA958EBAD3E406EDE3420B3635DC05C7ABC36542E5440CD87E5D8E1FE51C0C4C6256A878933403017927243C15AC0B0D32FAC311E1CC041BEAC3970D958C0F6909606AA2B4BC00103000000010000000C000000FCB037AEF00758C0547BFFFA8FF630409416A9FF505D63C080B29F78F69E1E40169B95E5225F57C0D843861511F9234078634D25AB5E5AC0A05F472E6AA21740509C8F355D915BC0D77AF2A47C9E44C0C0713A70820433C0AE3B04E29B5A52C054EA1BB7EA0245407884A5942B6E4140E09192E9979C5A40DC978171B6394C405C9A99E5B6315E40F8C5E58B2F4A4F40E47CC03E2B964D406C72448D540E5640AA5BCE71E5BC55C04C49204E56CD4340FCB037AEF00758C0547BFFFA8FF630400103000000010000000D00000075C2A2FBF04B61C0102FD86651F129C05394D2B2005062C0063F8E6E251752C0E69E9633BBCE63408FFAB69DB9C753C0606D551D1B765A40C341F979047B43C08CD5A511D3AF5C40ECD12391A38B42C0AEE1E55673C163409F481A712EDD42C0A4725AAAA5076140BC8036F49D163FC09E73BDD88DD6614070143850F6744240C092B60D28355640987EF2F283E74C406A9E3A39CDCD4EC0B4AE8299DA014740A917DF6C365362C0EC75FBDD010B4B40ACB96ABA3DFF44C0A0902F02F2FE304075C2A2FBF04B61C0102FD86651F129C001030000000100000006000000EC36269FE4DF48408E250CA65E2A4BC0A002E998DCC260400E21343303823EC044DFB4C38E005340F8050E6874692CC0A0852B52A5F25E404CE41A48BDAF4340E66F529D15B755C0E0B94FDD6C6E1E40EC36269FE4DF48408E250CA65E2A4BC0':::GEOGRAPHY, 3.4028234663852886e+38:::FLOAT8, 32767:::INT8) ". currently executing: map[SELECT pg_encoding_to_char(550341147894508576:::INT8) :1 SELECT pg_function_is_visible(2924423867:::OID) :1 SELECT pg_sequence_parameters(2512171660:::OID) :1 SELECT pg_table_is_visible((SELECT NULL)::oid) :1 SELECT pg_type_is_visible(3868262755:::OID) :1 SELECT st_buffer('0106000020E6100000090000000103000000010000000600000032E848A7E03C5DC08EF0E4BAA7E14DC00552E7FA622D63C022E22809D85655C0D0B4C64786B32BC02A6E2EC1C8A750C0D0487C98A03923C0205FE9EAB5F10240CC277738BCF740C080BBC5C01756534032E848A7E03C5DC08EF0E4BAA7E14DC0010300000001000000040000007C97958EB2D742C0B2972FC3133544C0F290FE1E14986340701C9D37BB211A402464E8EB9F626340F462BFB6117445407C97958EB2D742C0B2972FC3133544C00103000000010000000600000012ECC2B7618751C0A0EDF38A5AAC25C08C74DF0EE9F849408058E409E2E9E2BF8C1D0D80B7305D4022E3174B000D5140109F560479D331C0E2DB3E7397ED5040364F7A887E9859C0B4300F9C7A88554012ECC2B7618751C0A0EDF38A5AAC25C00103000000010000000C00000020050128304663C0061E7062614A3FC088C76F14BEB43740BC8D0574A91148C0CCA0B3727335454091F709E4CB1745C01CBBA01E8D325D4088B14ECD4AE451C078B77E0D3E684A4040AFE963A716F8BF4086A68835AE6440081F98E0EBDD2340409DFFDA518A534010C9741741DF2940FC57714FD2665440B0646F0AD2343F40D09602AE18CA3F40100E3DCE34F14740BD072663D0AA63C08C93410168B45340F27CB1B765645BC080EFEFBB2749EABF20050128304663C0061E7062614A3FC001030000000100000008000000F039D1E82AC255C020CA405983B50BC00038F18B75EFF63F40FAE3DF8F5C22C0487842E3E5864040AE7D8D45C90553C09890948280B45540FD773287B7BA51C0C681C6CDA4EF5140BEB9288B39075540C0D8BCDEDFD04B40B84E49252B555440E0DC374E4D6D26C0200EF9640B0A5340F039D1E82AC255C020CA405983B50BC00103000000010000000C00000041BEAC3970D958C0F6909606AA2B4BC0001147B3230EE5BF1CF532A9F8A836C064D5C52148EC42400A440038BDCB45C0D0A79E92EB5139406C05F1C37CB83BC09034AB99B5D656403C0187183F4450C048476F9B933363406CEDE440687132C0E005D44B4BA75540685AF855F8713140E070F45F1A352040DCDDA958EBAD3E406EDE3420B3635DC05C7ABC36542E5440CD87E5D8E1FE51C0C4C6256A878933403017927243C15AC0B0D32FAC311E1CC041BEAC3970D958C0F6909606AA2B4BC00103000000010000000C000000FCB037AEF00758C0547BFFFA8FF630409416A9FF505D63C080B29F78F69E1E40169B95E5225F57C0D843861511F9234078634D25AB5E5AC0A05F472E6AA21740509C8F355D915BC0D77AF2A47C9E44C0C0713A70820433C0AE3B04E29B5A52C054EA1BB7EA0245407884A5942B6E4140E09192E9979C5A40DC978171B6394C405C9A99E5B6315E40F8C5E58B2F4A4F40E47CC03E2B964D406C72448D540E5640AA5BCE71E5BC55C04C49204E56CD4340FCB037AEF00758C0547BFFFA8FF630400103000000010000000D00000075C2A2FBF04B61C0102FD86651F129C05394D2B2005062C0063F8E6E251752C0E69E9633BBCE63408FFAB69DB9C753C0606D551D1B765A40C341F979047B43C08CD5A511D3AF5C40ECD12391A38B42C0AEE1E55673C163409F481A712EDD42C0A4725AAAA5076140BC8036F49D163FC09E73BDD88DD6614070143850F6744240C092B60D28355640987EF2F283E74C406A9E3A39CDCD4EC0B4AE8299DA014740A917DF6C365362C0EC75FBDD010B4B40ACB96ABA3DFF44C0A0902F02F2FE304075C2A2FBF04B61C0102FD86651F129C001030000000100000006000000EC36269FE4DF48408E250CA65E2A4BC0A002E998DCC260400E21343303823EC044DFB4C38E005340F8050E6874692CC0A0852B52A5F25E404CE41A48BDAF4340E66F529D15B755C0E0B94FDD6C6E1E40EC36269FE4DF48408E250CA65E2A4BC0':::GEOGRAPHY, 3.4028234663852886e+38:::FLOAT8, 32767:::INT8) :1]
    rsg_test.go:749: 4m35s of 5m0s: 1163443 executions, 665498 successful
    rsg_test.go:749: 4m40s of 5m0s: 1183030 executions, 676081 successful
    rsg_test.go:749: 4m45s of 5m0s: 1203342 executions, 687122 successful
    rsg_test.go:749: 4m50s of 5m0s: 1223048 executions, 697811 successful
    rsg_test.go:749: 4m55s of 5m0s: 1243375 executions, 708881 successful
    rsg_test.go:782: 1263097 executions, 719546 successful
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1  error executing schedules: scheduler-stats: failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +(1) attached stack trace
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  -- stack trace:
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).execInternal.func1.1
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/internal.go:659
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/sql.(*rowsIterator).Next.func1
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/internal.go:273
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/sql.(*rowsIterator).Next
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/internal.go:324
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).queryInternalBuffered
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/internal.go:416
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).QueryRowExWithCols
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/internal.go:468
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/sql.(*InternalExecutor).QueryRowEx
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/internal.go:454
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/jobs.newLoopStats
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/job_scheduler.go:208
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/jobs.(*jobScheduler).executeSchedules
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/job_scheduler.go:267
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/jobs.(*jobScheduler).runDaemon.func1.1
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/job_scheduler.go:368
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/kv.(*DB).Txn.func1
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:773
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/kv.(*Txn).exec
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/txn.go:854
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/kv.(*DB).Txn
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/kv/db.go:772
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/jobs.(*jobScheduler).runDaemon.func1
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/jobs/job_scheduler.go:367
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:446
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | runtime.goexit
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | 	/usr/local/go/src/runtime/asm_amd64.s:1374
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +Wraps: (2) scheduler-stats
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +Wraps: (3) failed to send RPC: sending to all replicas failed; last error: node unavailable; try another peer
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  |
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | (opaque error leaf)
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +  | type name: github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord/kvcoord.sendError
E220120 06:30:54.194826 2948224 jobs/job_scheduler.go:371  [n1] 1 +Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errbase.opaqueLeaf
    rsg_test.go:362: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestRandomSyntaxFunctions034211457
--- FAIL: TestRandomSyntaxFunctions (300.24s)
Reproduce

To reproduce, try: 

make stressrace TESTS=TestRandomSyntaxFunctions PKG=./pkg/sql/tests TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Same failure on other branches

Internal log 

mjibson marked as alumn{us/a}; resolving to rafiss instead

/cc @cockroachdb/sql-experience @rafiss

This test on roachdash | Improve this report!

This was referenced Jan 28, 2022
Closed
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Feb 25, 2022
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Mar 18, 2022
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue May 20, 2022
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue May 29, 2022
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Jun 16, 2022
Closed
This was referenced Sep 1, 2022
Closed
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Sep 8, 2022
Closed
@cockroach-teamcity cockroach-teamcity mentioned this issue Oct 6, 2022
Closed
This was referenced Jan 20, 2023
Closed
Closed
@jordanlewis
Copy link
Member

This hasn't failed since last year.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot.
Projects
None yet
Milestone
21.1
Development

No branches or pull requests
2 participants
@jordanlewis @cockroach-teamcity