Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FSharpQA tests migration to xUnit suite - Part 1/? #10669

Merged
merged 8 commits into from
Dec 16, 2020

Conversation

vzarytovskii
Copy link
Member

This is a (semi-)automatic migration of F#QA tests to xUnit suite.

This is pretty much second try of #10415, in previous one, remaining fshsarpqa tests weren't discovered by runner. In this PR, we don't modify tests.lst much.

This PR is migrating only small fraction of simpler tests, which do not require running, IL comparison, or linking other libs - to test the migration script.

After this one is passing, I will start migrating other batches.

@dsyme
Copy link
Contributor

dsyme commented Dec 10, 2020

Is there any automatic way to update all IL baselines after a change that affects multiple ones? Currently I use

set TEST_UPDATE_BSL=1

@vzarytovskii
Copy link
Member Author

Is there any automatic way to update all IL baselines after a change that affects multiple ones? Currently I use

set TEST_UPDATE_BSL=1

Good question, I don't think it's currently easily possible in the new framework. You can delete baseline files, and they will be re-generated, however with different extension.
I will look into better way of doing it.

@KevinRansom
Copy link
Member

I don't automatically do it, so that I can at least eyeball the changes.

@vzarytovskii vzarytovskii requested a review from TIHan December 14, 2020 14:30
Copy link
Member

@KevinRansom KevinRansom left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The only thing I don't really like is the source being in external files, however, this way is probably much better in practice.

@vzarytovskii vzarytovskii merged commit d6a1195 into dotnet:main Dec 16, 2020
nosami pushed a commit to xamarin/visualfsharp that referenced this pull request Feb 23, 2021
* Fixed a bunch of lst files (fixed Expect -> Expects), casing.
Added some helper functions to test framework.

* Fxied missing imports in test framework

* Fixed double quotes around compiler flags in lst file

* Fixed double quotes around compiler flags in lst file

* Migrated a bunch of fsharpqa tests, simpler ones, which do not require run, il

* Removed already migrated tests from fsharpqa env.lst

* Fix some post-migration issues

* Reverted back some fsharpqa changes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants