atlantis/apply check passes before actual apply

[marcbas1]

If I open a Pull Request, and I run atlantis plan, the following status checks are posted:

atlantis/plan — 1/1 projects planned successfully. 
atlantis/policy_check — 0/0 projects policies checked successfully. 
atlantis/apply — 0/0 projects applied successfully. 

And the PR is now mergeable because all the status checks are successful.

However, the atlantis apply command has not been posted yet. Ideally the status check should atlantis/apply — 0/1 projects applied successfully. Instead of 0/0.

We're running with the latest version of atlantis. Is this a bug? Any way to prevent the status checks from passing, until the projects have been applied.

Edit:
This was working previously, when a PR was opened atlantis would report:

atlantis/apply Expected — Waiting for status to be reported 

Not sure what recently changed in the latest version.

[AndreZiviani]

@marcbas1 I implemented what you wanted but theres an issue, if the atlantis/apply status is failing (or pending) the PR is not mergeable.

I wanted to be able to block users from merging the PR without applying via atlantis and limit who can approve it, but looks like this is not possible with current controls, it would require atlantis to ignore its own status when checking if mergeable

[AndreZiviani]

this other issue references something similar #1791

[chenrui333]

Got released under 0.19.0 today. Thanks @AndreZiviani for the work!