Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enh: call voice input sensitivity #2995

Closed
hsman2 opened this issue Jun 10, 2024 · 4 comments
Closed

enh: call voice input sensitivity #2995

hsman2 opened this issue Jun 10, 2024 · 4 comments
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@hsman2
Copy link

hsman2 commented Jun 10, 2024

It seems when you're using the new call feature when it's speaking (tts) it's hearing itself as if you're talking to it. Which results in it cutting off the tts after a word or 2. Only happens when i'm using it like a speaker phone. If I have my headphones in it works great since it doesn't hear itself talking. I think you need to put in a way to prevent it from listening UNTIL it's done talking, then it can resume listening again. Otherwise the the new call feature works great, just this one bug so far.

@tjbck tjbck changed the title When using call it cuts off TTS after the first word or 2. enh: call voice input sensitivity Jun 11, 2024
@spammenotinoz
Copy link

It seems when you're using the new call feature when it's speaking (tts) it's hearing itself as if you're talking to it. Which results in it cutting off the tts after a word or 2. Only happens when i'm using it like a speaker phone. If I have my headphones in it works great since it doesn't hear itself talking. I think you need to put in a way to prevent it from listening UNTIL it's done talking, then it can resume listening again. Otherwise the call feature works great, just this one bug so far.

Sorry I can't answer your question, but wondering if there is a trick so playback work.
I can engage in conversation with the model via the new call feature, it hears me fine, but I do not hear any response, but when I end I see the text response.

@nextosai
Copy link

There are many ways to address that, but the easiest is using a programmable keyboard, "push key," to talk and release it to get the answer while muting the microphone. This is not the perfect scenario because we have to use our hands :) I agree with @hsman2, but I'm not sure about the complexity of coding that, as we would need to get the "end of audio" callback

@tjbck tjbck added enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed labels Jun 11, 2024
@akhdanfadh
Copy link

I'm getting this bug also (MBP). Agree with either holding the mic button or controlling the mic sensitivity.

@tjbck
Copy link
Contributor

tjbck commented Jun 17, 2024

Updated with the latest!

@tjbck tjbck closed this as completed Jun 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

5 participants