Skip to content
This repository has been archived by the owner on May 7, 2024. It is now read-only.

What are the criteria for the test to pass? #355

Open
Stark-qan opened this issue Sep 29, 2022 · 2 comments
Open

What are the criteria for the test to pass? #355

Stark-qan opened this issue Sep 29, 2022 · 2 comments

Comments

@Stark-qan
Copy link

We run our own test suite and find many errors and failures.
I don't know if many errors and failures are negligible, and if there are some test cases that we can choose not to test (such as our tool chain for testing RISCV-gcc).

@pz9115
Copy link

pz9115 commented Sep 29, 2022

There are many testsuite in gcc/testsuite, and you can use dejagnu to run the regression test and see if there have some errors or failures. For riscv target, most testcases are in the gcc/testsuite/gcc.target/riscv, it use the option aim to riscv target.

After build the toolchain, you can use make report-gcc -j$(nproc) to run the test script, it will generate a report table show if there have some fail cases in gcc part. Some known fail cases was recorded at test/allowlistc/gcc in riscv-gnu-toolchain.

@Stark-qan
Copy link
Author

One more question about testing: the definition of a test case indicator in riscv-gcc/testsuits looks like this:
1665385748188
Where can I see a detailed explanation of them?
Specifically about this "dg-skip-if", shown below:
1665385783845(1)
I got the following error when testing this use case, I don't know what the error and passing criteria are.
1665385887420(1)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants