PPU LLVM/SPU/Non-TSX: Obnoxiously responsive and obedient PPU for SPU requests

[elad335]

Needs PPU cache removal and rebuilt to test the pr.
Not to be merged before #14404 so perf comparison would accurate to what it was earlier.
Although testers are welcome.
Imnproves Persona 5 performance a bit.
May improve #14386

[brian218]

Since PPU cache needs to be rebuilt after this PR, would you mind refactoring the syscalls in sys_game.cpp (by removing the underline prefix) as well as those in sys_game_.cpp (add underline prefix or suffix) by the way?

[elad335]

I mean, I don't enforce its removal. Its just so the users can access this change of code.

[elad335]

I made the pr automatically create new cache but this commit would be removed before merge.
If you want to clean new cache created with this pr remove the files conatining "removable-14408":

After this pr is merged you still need to rebuild cache to use the new ppu llvm code because of the reverted invalidation.

[solarmystic]

Did the usual 5 game test, wiping all prior PPU cache before hand. Persona 5 did get a modest bump of 4 FPS compared to latest master, the rest are within margin of error (+2 to -1 FPS compared to master).

[elad335]

Added another optimization, idk if it actually improves anything and may behave differently between different CPUs, please retest.

[Ordinary205]

Heres the performance comparison on RDR.

Master: 28.2/29.7/30.6 FPS

Screenshot

PR: 27.4/29.3/30.2 FPS

Screenshot

[elad335]

And if you use the build of the previous commit?

[Ordinary205]

I've haven't tested the previous commit.

[elad335]

I mean, it's available.

[Ordinary205]

Oh, I didn't know you could test the previous commit when the new commit was released, my bad.

[Ordinary205]

Anyways, heres a performance result that was tested on the previous commit.

PR: 27.8/29.5/30.5 FPS

[solarmystic]

After commit 493d4e4 was added, nothing really changed for DeS, GOWA and GOW3, but Persona 5 and TLOU gains from master diminished by 1 FPS compared to the previous commit.

[cipherxof]

Very minor (if any) differences in MGS4.

First commit

Commit 493d4e4

Latest Master