Update E2E LLM Template in main (#383)

# What does this PR do?

Adds a missing commit to `main` that made it only to `e2e-llm` 

TODO: 
- [x] E2E test

---------

Signed-off-by: SumanthRH <[email protected]>
Co-authored-by: GokuMohandas <[email protected]>
Co-authored-by: Galen Wang <[email protected]>
Co-authored-by: Rob de Wit <[email protected]>