Log async responses to the database when run using llm --async

[simonw]

I punted on that earlier for:

• Ability to execute prompts against an asyncio (non-blocking) API #507

llm/llm/cli.py

Lines 425 to 431 in a6d62b7

	# Log to the database
	if (logs_on() or log) and not no_log and not async_:
	log_path = logs_db_path()
	(log_path.parent).mkdir(parents=True, exist_ok=True)
	db = sqlite_utils.Database(log_path)
	migrate(db)
	response.log_to_db(db)

[simonw]

In trying to build this I quickly realized the challenge that you need to know to call e.g. await response.duration_ms() or similar to get back the final values to store in the database.

Idea: do this instead:

response = await async_response.to_sync_response()
response.log_to_db(db)