Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

random failures for MetacelloGithubIssue175TestCase>>testIssue175 Squeak4.5 and Squeak Trunk #286

Closed
dalehenrich opened this issue Sep 29, 2014 · 9 comments
Closed

random failures for MetacelloGithubIssue175TestCase>>testIssue175 Squeak4.5 and Squeak Trunk #286

dalehenrich opened this issue Sep 29, 2014 · 9 comments
Labels
in process
Milestone
1.0.0-beta.32.16

Comments

@dalehenrich
Copy link
Member 

**************************************************************************************
Results for #('BaselineOfMetacello') Test Suite
510 run, 509 passes, 0 expected failures, 0 failures, 1 errors, 0 unexpected passes
**************************************************************************************
*** ERRORS *******************
MetacelloGithubIssue175TestCase debug: #testIssue175.
**************************************************************************************
@dalehenrich dalehenrich added this to the 1.0.0-beta.32.16 milestone Sep 29, 2014
dalehenrich added a commit that referenced this issue Sep 30, 2014
@dalehenrich
Issue #286: add error logging ...
144c1fe
dalehenrich added a commit that referenced this issue Oct 9, 2014
@dalehenrich
reenable Squeak-4.5 and Squeak-Trunk to get handle on Issue #286
bdf10de
@dalehenrich
Copy link
Member Author

and another (Squeak-4.5 only):

**************************************************************************************
    Results for #('BaselineOfMetacello') Test Suite
540 run, 539 passes, 0 expected failures, 0 failures, 1 errors, 0 unexpected passes
**************************************************************************************
*** ERRORS *******************
    MetacelloScriptingDocumentationIssue196TestCase debug: #testLockCommandReference3.
**************************************************************************************

@dalehenrich
Copy link
Member Author

and another (Squeak-4.5 only):

**************************************************************************************
    Results for #('BaselineOfMetacello') Test Suite
540 run, 538 passes, 0 expected failures, 0 failures, 2 errors, 0 unexpected passes
**************************************************************************************
*** ERRORS *******************
    MetacelloScriptingDocumentationIssue196TestCase debug: #testLockCommandReference2.
    MetacelloScriptingDocumentationIssue196TestCase debug: #testLockCommandReference6.
**************************************************************************************

@dalehenrich
Copy link
Member Author

found a random test failure in GemStone

dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: plug a dictionary repository leak and make future leaks a…
9129d63 
… bit less likely
dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: characterize MetacelloScriptingGetTestCase>>testLoadNGet …
fb0839f 
…failure
dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: more repo cleanup
1454b3b
dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: MetacelloScriptingGetTestCase>>testLoadNGet logging
b9d3cfd
dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: MetacelloScriptingFetchRecordTestCase logging
ba7214b
dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: correct some of the repository cleanup code
1fae7fd
dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: remove some of the logging ... clean up repo in Metacello…
6cf8a92 
…LoadOrderTestCase
dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: another crack at proper cleanup for MetacelloScriptingGet…
5529959 
…TestCase>>testLoadNGet
@dalehenrich
Copy link
Member Author

Latest squeak 4 random test failure:

**************************************************************************************
*** ERRORS *******************
MetacelloScriptingIssuesTestCase debug: #testIssue234a.
**************************************************************************************

After the recent spate of test cleanup work ... the earlier test reports can be ignored unless they repeat again ... will add logging for this boyo...

dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: logging for MetacelloScriptingIssuesTestCase>>testIssue23…
6276831 
…4a ... lastest Squeak-4.4 test error
dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: Pharo-1.4 setup/teardown errors logging
94ea1c5
dalehenrich added a commit that referenced this issue Oct 17, 2014
@dalehenrich
Issue #286: fix error in MetacelloScriptingGetTestCase>>tearDownRepos…
d7f2bb7 
…itories ... remove MetacelloScriptingGetTestCase logging ... cross fingers
@dalehenrich
Copy link
Member Author

Official list of supsected random test errors (check them off when root cause determined):

  • MetacelloScriptingIssuesTestCase debug: #testIssue234a (Squeak-4.4).
  • MetacelloScriptingSuccessTestCase debug: #testGitHubTagPatternLoad2 (Pharo-3.0)
  • MetacelloScriptingSuccessTestCase debug: #testGitHubTagPatternLoad2B (Pharo-3.0)
  • MetacelloScriptingSuccessTestCase debug: #testGitHubTagPatternLoad3 (Pharo-3.0)

dalehenrich added a commit that referenced this issue Oct 18, 2014
@dalehenrich
Issue #286: MetacelloScriptingGetTestCase>>testLoadNGet is getting se…
3eece8a 
…emingly random failures (not all platforms)
@dalehenrich
Copy link
Member Author

api rate limits for Pharo-3.0 (only one platform so far):

*** ERRORS *******************
MetacelloScriptingSuccessTestCase debug: #testGitHubTagPatternLoad2.
MetacelloScriptingSuccessTestCase debug: #testGitHubTagPatternLoad2B.
MetacelloScriptingSuccessTestCase debug: #testGitHubTagPatternLoad3.
**************************************************************************************
'API rate limit exceeded for 199.91.170.105. (But here''s the good news: Authenticated requests get a higher rate limit. Check out the documentation for more details.)'

@dalehenrich
Copy link
Member Author

API rate limit exceeded for 199.182.120.5 - GemStone-3.2.2

dalehenrich added a commit that referenced this issue Oct 18, 2014
@dalehenrich
Issue #286: MetacelloScriptingGetTestCase>>testLoadNGet logging
d3b48a9
dalehenrich added a commit that referenced this issue Oct 18, 2014
@dalehenrich
Issue #286: more MetacelloScriptingGetTestCase>>testLoadNGet logging …
36e2c9a 
….... remove MetacelloAtomicLoadOrderTest>>testBaseline10LoadAtomic logging
dalehenrich added a commit that referenced this issue Oct 18, 2014
@dalehenrich
Issue #286: more MetacelloScriptingGetTestCase>>testLoadNGet logging
644fa06
dalehenrich added a commit that referenced this issue Oct 18, 2014
@dalehenrich
Issue #286: more cleanup of potential repository leaks
a2508fa
@dalehenrich
Copy link
Member Author

Let's avoid rate limit-related test failures .. if the test hits a rate limit don't fail ... interesting to know, but not worth failing the test over

dalehenrich added a commit that referenced this issue Oct 18, 2014
@dalehenrich
Issue #286: dont't fail tests because of github rate limiting errors
263fe52
dalehenrich added a commit that referenced this issue Oct 18, 2014
@dalehenrich
issue #286: fix a bug in the logging...
945331e
dalehenrich added a commit that referenced this issue Oct 18, 2014
@dalehenrich
Issue #286: use MCRepositoryGroup>>removeIdenticalRepository: to remo…
a18fbc0 
…ve repos in tests ... the description of repos can morph during a test and that foils the MCRepositoryGroup>>removeRepository: logic which uses description as part of equality test ... revert MetacelloPlatform>>createRepository: to old behavior of not setting description of a dictionary repo on creation ... still in question though
dalehenrich added a commit that referenced this issue Oct 18, 2014
@dalehenrich
Issue #286: portability fix
f661873
dalehenrich added a commit that referenced this issue Oct 18, 2014
@dalehenrich
Issue #286: oops MCRepositoryGroup>>removeIdenticalRepository: was no…
1813cba 
…t in a common test package
@dalehenrich
Copy link
Member Author

clean sheet ... dictionary repositories and random package-cache are very likely the culprits for all of the random test failures I've ben seeing lately ... with the recent move to wipe package-cache clean between tests and the use of MCRepositoryGroup>>removeIdenticalRepository: to clean up repos, I'm going to call this issue closed and wait for the next rash of random failures to start popping up

@dalehenrich dalehenrich mentioned this issue Oct 18, 2014
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
in process
Projects
None yet
Milestone
1.0.0-beta.32.16
Development

No branches or pull requests
1 participant
@dalehenrich