Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make "hey omi" core functionality of the app ($1000) #1388

Open
kodjima33 opened this issue Nov 22, 2024 · 1 comment
Open

make "hey omi" core functionality of the app ($1000) #1388

kodjima33 opened this issue Nov 22, 2024 · 1 comment
Assignees
Labels
Feature Request firmware firmware work flutter flutter work help wanted Extra attention is needed Paid Bounty 💰

Comments

@kodjima33
Copy link
Collaborator

kodjima33 commented Nov 22, 2024

we built "hey omi" as an app and even though it's bad code, people really want to use it
we need to make it core funcitonality of the product but with few changes:

  1. "hey omi" should be triggered with a long press of the button on the omi device and the query should be collected while the user is holding the button.
  2. turnon/turnoff of the device should be switched to short click
  3. after the button is released, we send the question/prompt to LLM, while passing all {facts} and {conversations/memories}, chat history and current conversation
    4 the answer should be shown in the chat and sent via notification

This is a paid task. Reward is $1000 in cash. Simply link your PR to this issue to receive the money

@kodjima33 kodjima33 moved this to To do in omi TODO Nov 22, 2024
@kodjima33 kodjima33 added flutter flutter work firmware firmware work labels Nov 22, 2024
@beastoin beastoin self-assigned this Nov 23, 2024
@BasedHardware BasedHardware deleted a comment from Pethousesmart Nov 23, 2024
@gluonparticle
Copy link

Do you want the "Hey omi" to be triggered only for answering certain questions which the user has?

And you wanna trigger "Hey Omi" for long presses (Answering questions given while the user is holding) , and the usual funcitonality for clicks? ;

beastoin added a commit that referenced this issue Nov 26, 2024
Issue: #1388

## Feature
- "hey omi" should be triggered with a long press of the button on the
omi device and the query should be collected while the user is holding
the button.
 - turnon/turnoff of the device should be switched to short click
- after the button is released, we send the question/prompt to LLM,
while passing all {facts} and {conversations/memories}, chat history and
current conversation
 - 4 the answer should be shown in the chat and sent via notification

## Usages
- Long press to start the voice command (as a message for now), you will
feel the haptic feedback
- Release to send it, then wait for Omi's response.
- To turn the device on / off, use a single tap

## TODOs
- [x] "hey omi" should be triggered with a long press of the button on
the omi device and the query should be collected while the user is
holding the button.
 - [x] turnon/turnoff of the device should be switched to short click
- [x] after the button is released, we send the question/prompt to LLM,
while passing all {facts} and {conversations/memories}, chat history and
current conversation
- [x] 4 the answer should be shown in the chat and sent via notification
- [x] firmware: fix the button changes not notify sometime -> implement
the haptic then control it from the app + add new issue for firmware
fixes: #1412

## Deploy plan
- [ ] deploy backend
- [ ] deploy firmware
- [ ] deploy mobile app
@beastoin beastoin moved this from In review to Done in omi TODO Nov 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature Request firmware firmware work flutter flutter work help wanted Extra attention is needed Paid Bounty 💰
Projects
Status: Done
Development

No branches or pull requests

3 participants