Jupyter async error

[austinmw]

Hi, I tried running the following in a Jupyter notebook (in VS Code):

elif mode == "chain_with_guardrails":
  history = [
    {"role": "user", "content": query}
  ]
  result = app.generate(messages=history)

However I got the following error:

---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
Cell In[79], line 15
     11 elif mode == "chain_with_guardrails":
     12   history = [
     13     {"role": "user", "content": query}
     14   ]
---> 15   result = app.generate(messages=history)
     19 print(result)

File [~/anaconda3/envs/nemo/lib/python3.10/site-packages/nemoguardrails/rails/llm/llmrails.py:157](https://vscode-remote+ssh-002dremote-002bsagemaker-002dnotebook.vscode-resource.vscode-cdn.net/home/ec2-user/SageMaker/NeMo-Guardrails/rag-demo/~/anaconda3/envs/nemo/lib/python3.10/site-packages/nemoguardrails/rails/llm/llmrails.py:157), in LLMRails.generate(self, prompt, messages)
    154     loop = None
    156 if loop and loop.is_running():
--> 157     raise RuntimeError(
    158         "You are using the sync `generate` inside async code. "
    159         "You should replace with `await generate_async(...)."
    160     )
    162 return asyncio.run(self.generate_async(prompt=prompt, messages=messages))

RuntimeError: You are using the sync `generate` inside async code. You should replace with `await generate_async(...).

[drazvan]

Hi @austinmw! The sample code that you're referring to is not meant to be run in an async environment (which Jupyter creates), but rather as a standalone script. To make it work, replace the generate call with await generate_async as suggested by the error message.