Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: pgjdbc failed #42141

Closed
cockroach-teamcity opened this issue Nov 3, 2019 · 5 comments · Fixed by #42338
Closed

roachtest: pgjdbc failed #42141

cockroach-teamcity opened this issue Nov 3, 2019 · 5 comments · Fixed by #42338
Assignees
@rafiss
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot.
Milestone
19.2

Comments

@cockroach-teamcity
Copy link
Member

SHA: https://github.com/cockroachdb/cockroach/commits/b9dc16b9d6cbd4627bac4b6329e87e29e52401b9

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=pgjdbc PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1571295&tab=artifacts#/pgjdbc

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191103-1571295/pgjdbc/run_1
	orm_helpers.go:174,orm_helpers.go:111,java_helpers.go:204,pgjdbc.go:172,pgjdbc.go:182,test_runner.go:697: 
		Tests run on Cockroach v19.2.0-beta.20190930-754-gb9dc16b
		Tests run against pgjdbc REL42.2.8
		5782 Total Tests Run
		4380 tests passed
		1402 tests failed
		0 tests skipped
		1 test ignored
		1 test passed unexpectedly
		0 tests failed unexpectedly
		0 tests expected failed but skipped
		0 tests expected failed but not run
		For a full summary look at the pgjdbc artifacts 
		
		An updated blacklist (pgjdbcBlackList19_2) is available in the artifacts' pgjdbc log
@cockroach-teamcity cockroach-teamcity added C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. labels Nov 3, 2019
@cockroach-teamcity cockroach-teamcity added this to the 19.2 milestone Nov 3, 2019
@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/8b9f54761adc58eb9aecbf9b26f1a7987d8a01e5

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=pgjdbc PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1573251&tab=artifacts#/pgjdbc

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191105-1573251/pgjdbc/run_1
	orm_helpers.go:174,orm_helpers.go:111,java_helpers.go:204,pgjdbc.go:172,pgjdbc.go:182,test_runner.go:697: 
		Tests run on Cockroach v19.2.0-beta.20190930-785-g8b9f547
		Tests run against pgjdbc REL42.2.8
		5782 Total Tests Run
		4380 tests passed
		1402 tests failed
		0 tests skipped
		1 test ignored
		1 test passed unexpectedly
		0 tests failed unexpectedly
		0 tests expected failed but skipped
		0 tests expected failed but not run
		For a full summary look at the pgjdbc artifacts 
		
		An updated blacklist (pgjdbcBlackList19_2) is available in the artifacts' pgjdbc log

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/ca3615568aa509606410d36bc7cd70eec0484c26

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=pgjdbc PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1580962&tab=artifacts#/pgjdbc

The test failed on branch=release-2.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191108-1580962/pgjdbc/run_1
	orm_helpers.go:174,orm_helpers.go:111,java_helpers.go:204,pgjdbc.go:172,pgjdbc.go:182,test_runner.go:697: 
		Tests run on Cockroach v2.1.9-17-gca36155
		Tests run against pgjdbc REL42.2.8
		5783 Total Tests Run
		4377 tests passed
		1406 tests failed
		0 tests skipped
		0 tests ignored
		24 tests passed unexpectedly
		6 tests failed unexpectedly
		0 tests expected failed but skipped
		0 tests expected failed but not run
		For a full summary look at the pgjdbc artifacts 
		
		An updated blacklist (pgjdbcBlackList2_1) is available in the artifacts' pgjdbc log

@jordanlewis jordanlewis assigned rafiss and unassigned andreimatei Nov 8, 2019
@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/33b96613ae532b25a1b6b716453bece9b60ba2d6

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=pgjdbc PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1583742&tab=artifacts#/pgjdbc

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191109-1583742/pgjdbc/run_1
	orm_helpers.go:174,orm_helpers.go:111,java_helpers.go:204,pgjdbc.go:172,pgjdbc.go:182,test_runner.go:697: 
		Tests run on Cockroach v20.1.0-alpha.00000000-789-g33b9661
		Tests run against pgjdbc REL42.2.8
		5782 Total Tests Run
		4380 tests passed
		1402 tests failed
		0 tests skipped
		1 test ignored
		1 test passed unexpectedly
		0 tests failed unexpectedly
		0 tests expected failed but skipped
		0 tests expected failed but not run
		For a full summary look at the pgjdbc artifacts 
		
		An updated blacklist (pgjdbcBlackList20_1) is available in the artifacts' pgjdbc log

@rafiss rafiss mentioned this issue Nov 9, 2019
Merged
@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/35e138aa3c2be545fb4e17a85ea6f1b8d6525e53

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=pgjdbc PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1584763&tab=artifacts#/pgjdbc

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191110-1584763/pgjdbc/run_1
	orm_helpers.go:174,orm_helpers.go:111,java_helpers.go:204,pgjdbc.go:172,pgjdbc.go:182,test_runner.go:697: 
		Tests run on Cockroach v20.1.0-alpha.00000000-795-g35e138a
		Tests run against pgjdbc REL42.2.8
		5782 Total Tests Run
		4380 tests passed
		1402 tests failed
		0 tests skipped
		1 test ignored
		1 test passed unexpectedly
		0 tests failed unexpectedly
		0 tests expected failed but skipped
		0 tests expected failed but not run
		For a full summary look at the pgjdbc artifacts 
		
		An updated blacklist (pgjdbcBlackList20_1) is available in the artifacts' pgjdbc log

@cockroach-teamcity
Copy link
Member Author

SHA: https://github.com/cockroachdb/cockroach/commits/0e9dd73f803247cdcfd06f51ce6b23396af1b9f5

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=pgjdbc PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1587121&tab=artifacts#/pgjdbc

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191112-1587121/pgjdbc/run_1
	orm_helpers.go:174,orm_helpers.go:111,java_helpers.go:204,pgjdbc.go:172,pgjdbc.go:183,test_runner.go:697: 
		Tests run on Cockroach v20.1.0-alpha.00000000-835-gbaec88e
		Tests run against pgjdbc REL42.2.8
		5782 Total Tests Run
		4380 tests passed
		1402 tests failed
		0 tests skipped
		1 test ignored
		1 test passed unexpectedly
		0 tests failed unexpectedly
		0 tests expected failed but skipped
		0 tests expected failed but not run
		For a full summary look at the pgjdbc artifacts 
		
		An updated blacklist (pgjdbcBlackList20_1) is available in the artifacts' pgjdbc log

craig bot pushed a commit that referenced this issue Nov 12, 2019
@rafiss
Merge #42338
2c396f3 
42338: roachtest: update ORM blacklists with new expected passes r=rafiss a=rafiss

Some compatibility issues have been fixed, so more tests are passing
now. Also, some expected failures were missing from the PGJDBC 2.1
blacklist.

closes #42141
closes #41751

Release note: none

Co-authored-by: Rafi Shamim <[email protected]>
@craig craig bot closed this as completed in 6565d0c Nov 12, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rafiss rafiss

Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot.
Projects
None yet
Milestone
19.2
Development

Successfully merging a pull request may close this issue.

roachtest: update ORM blacklists with new expected passes rafiss/cockroach
3 participants
@andreimatei @rafiss @cockroach-teamcity