Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEAT] Speech input should print STT results to the chat UI in addition to response #29

Closed
mikejgray opened this issue Nov 7, 2023 · 0 comments · Fixed by #34
Closed

[FEAT] Speech input should print STT results to the chat UI in addition to response #29

mikejgray opened this issue Nov 7, 2023 · 0 comments · Fixed by #34
Assignees
@NeonDaniel
Labels
enhancement New feature or request

Comments

@mikejgray
Copy link
Contributor

Objective

Speech input should print STT results to the chat UI in addition to response

Initial Implementation Requirements

  • Adjust MQ request to retrieve STT results
  • Re-implement chatbot, or find a way to pass the STT information to it from the audio input

Other Considerations

No response
@mikejgray mikejgray added the enhancement New feature or request label Nov 7, 2023
NeonDaniel added a commit that referenced this issue Nov 15, 2023
@NeonDaniel
Refactor GradIO UI to use Chatbot class directly
ebe555f 
Relocate audio input box next to `Submit` button
Clear audio input upon response to input
Move `Play TTS` button to visually match line above
Updates default web UI labels in Docker config
Closes #30
Closes #29
NeonDaniel added a commit that referenced this issue Nov 15, 2023
@NeonDaniel
Refactor GradIO UI to use Chatbot class directly
3c04a88 
Relocate audio input box next to `Submit` button
Clear audio input upon response to input
Move `Play TTS` button to visually match line above
Updates default web UI labels in Docker config
Closes #30
Closes #29
@NeonDaniel NeonDaniel mentioned this issue Nov 15, 2023
Merged
@NeonDaniel NeonDaniel self-assigned this Nov 18, 2023
NeonDaniel added a commit that referenced this issue Nov 21, 2023
@NeonDaniel
Refactor GradIO UI to use Chatbot class directly
385dab9 
Relocate audio input box next to `Submit` button
Clear audio input upon response to input
Move `Play TTS` button to visually match line above
Updates default web UI labels in Docker config
Closes #30
Closes #29
NeonDaniel added a commit that referenced this issue Nov 21, 2023
@NeonDaniel
Refactor GradIO UI to use Chatbot class directly (#34)
f3ece7b 
Relocate audio input box next to `Submit` button
Clear audio input upon response to input
Move `Play TTS` button to visually match line above
Updates default web UI labels in Docker config
Closes #30
Closes #29

Co-authored-by: Daniel McKnight <[email protected]>
@github-actions github-actions bot mentioned this issue Dec 13, 2023
Merged
NeonDaniel added a commit that referenced this issue Dec 20, 2023
@NeonDaniel
0.1.0 (#49)
146481a 
# Changelog

## [0.0.5a21](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a21)
(2023-12-13)

[Full
Changelog](0.0.5a20...0.0.5a21)

**Merged pull requests:**

- Update Documentation and Logging
[\#48](#48)
([NeonDaniel](https://github.com/NeonDaniel))

## [0.0.5a20](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a20)
(2023-12-13)

[Full
Changelog](0.0.5a19...0.0.5a20)

**Merged pull requests:**

- Improved config handling
[\#46](#46)
([NeonDaniel](https://github.com/NeonDaniel))

## [0.0.5a19](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a19)
(2023-12-11)

[Full
Changelog](0.0.5a18...0.0.5a19)

**Merged pull requests:**

- Update release automation
[\#47](#47)
([NeonDaniel](https://github.com/NeonDaniel))

## [0.0.5a18](https://github.com/NeonGeckoCom/neon-iris/tree/0.0.5a18)
(2023-12-11)

[Full
Changelog](0.0.4...0.0.5a18)

**Implemented enhancements:**

- \[FEAT\] Gradio User Settings Intents
[\#35](#35)
- \[FEAT\] After submitting recorded input audio the UI element should
reset [\#30](#30)
- \[FEAT\] Speech input should print STT results to the chat UI in
addition to response
[\#29](#29)

**Fixed bugs:**

- \[BUG\] Input audio resampling is not efficiently implemented
[\#28](#28)
- \[BUG\] Implement per-user settings in web UI
[\#27](#27)

**Merged pull requests:**

- Add GitHub pre-release automation
[\#45](#45)
([NeonDaniel](https://github.com/NeonDaniel))
- Update neon-mq-connector dependency to stable spec
[\#43](#43)
([NeonDaniel](https://github.com/NeonDaniel))
- Minor fixes to audio input handling
[\#42](#42)
([NeonDaniel](https://github.com/NeonDaniel))
- Refactor audio responses to utilize Chatbot UI
[\#40](#40)
([NeonDaniel](https://github.com/NeonDaniel))
- Get Language Support from Core
[\#37](#37)
([NeonDaniel](https://github.com/NeonDaniel))
- Handle profile updates
[\#36](#36)
([NeonDaniel](https://github.com/NeonDaniel))
- Handle STT Transcripts in Chat UI
[\#34](#34)
([NeonDaniel](https://github.com/NeonDaniel))
- Remove audio resampling and add timing context support
[\#33](#33)
([NeonDaniel](https://github.com/NeonDaniel))
- Fix web\_client language handling to respect configured input language
[\#32](#32)
([NeonDaniel](https://github.com/NeonDaniel))
- Threaded input handling and multi-session support
[\#31](#31)
([NeonDaniel](https://github.com/NeonDaniel))
- Add Gradio web UI with Docker Container
[\#24](#24)
([NeonDaniel](https://github.com/NeonDaniel))
- Add NeonVoiceClient class for minimal remote audio client
[\#23](#23)
([NeonDaniel](https://github.com/NeonDaniel))
- Resolve client compat. bug
[\#22](#22)
([NeonDaniel](https://github.com/NeonDaniel))
- Add CLI endpoints to interact with API and LLM endpoints
[\#21](#21)
([NeonDaniel](https://github.com/NeonDaniel))
- Specify `setup.py` path explicitly
[\#20](#20)
([NeonDaniel](https://github.com/NeonDaniel))
- Update build automation to default branch
[\#19](#19)
([NeonDaniel](https://github.com/NeonDaniel))
- Update to use shared version\_bump.py script
[\#18](#18)
([NeonDaniel](https://github.com/NeonDaniel))
- Remove invalid release Docker action
[\#17](#17)
([NeonDaniel](https://github.com/NeonDaniel))
- Update automation to shared repository
[\#15](#15)
([NeonDaniel](https://github.com/NeonDaniel))
- Add methods with CLI entrypoints to get STT/TTS
[\#12](#12)
([NeonDaniel](https://github.com/NeonDaniel))



\* *This Changelog was automatically generated by
[github_changelog_generator](https://github.com/github-changelog-generator/github-changelog-generator)*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@NeonDaniel NeonDaniel

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Handle STT Transcripts in Chat UI NeonGeckoCom/neon-iris
2 participants
@mikejgray @NeonDaniel