Provide event to access raw audio stream

[nfiacco]

Would be great to have an audio event like this: https://docs.retellai.com/make-calls/web-call#listen-to-events

[nikhilro]

It's a good idea but what's your use case?

[nfiacco]

To show a visualizer element! Honestly just a way of accessing the Audio element/ref would fantastic— because then we'd have a way to control the playback more granularly in addition to being able show a visualization.

[tomashanecak]

Agreed, that would be a great feature. I am currently struggling with visualizing user audio input. When I try to modify the node module I get ocasional weird loud static noise from the assistant. I suppose it might be some concurrent access to audio stream causing it in my case :/

[nikhilro]

we expose volume level updates if that helps

you can likely expose more stuff from daily webrtc connection directly. sdk is a thin wrapper on it. code here: https://github.com/VapiAI/web/blob/main/vapi.ts

happy to merge any PRs!