Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test assertion for *passing* a test if it reaches a certain time limit #78

Open
Voileexperiments opened this issue Apr 23, 2018 · 1 comment
Labels
community-package Package that can be maintained by the community help wanted Extra attention is needed

Comments

@Voileexperiments
Copy link

There are currently Test.assertNotEquals, Test.assertNotContains, Test.expectNoError... but there are no controls for the timeout. We can only make tests that fail on timeout, not succeed on timeout.

Use case: When there are 2 versions of a kata and one is the performance version, we'd like to block solutions that can pass the performance version from the easy version, so others can't just look for these solutions in the solution page and solve the performance version for free. @myjinxin2015's Coding 5min/Shortest Code series used to have this feature: if your code is short enough for the challenge version, submitting this code on the non-challenge version will cause tests to fail with the error message telling you to go submit your code in the challenge version instead.

Speaking of which, this also needs codewars/python-test-framework#4.

@kazk kazk transferred this issue from codewars/codewars-runner-cli Oct 6, 2020
@kazk kazk added the community-package Package that can be maintained by the community label Oct 6, 2020
@kazk
Copy link
Member

kazk commented Oct 6, 2020

We can create a community maintained package for something like this. Let me know if anyone is interested to work on it.

@kazk kazk added the help wanted Extra attention is needed label Oct 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
community-package Package that can be maintained by the community help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants