Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: audio input for induced motion #124

Closed
wants to merge 15 commits into from

Conversation

sbaier1
Copy link
Contributor

@sbaier1 sbaier1 commented Apr 8, 2022

closes #102

i started the issue with my thought of making it FFT based, where i sorted frequencies into buckets.
this is a more versatile approach now:
instead of dealing with FFT window sizes and all that sort of stuff, we just take the corresponding audio signal for the time the current frame will last and pass the signal through configurable butterworth band pass filters.

one additional trick: when loading the audio initially, we run the bandpass filters across the whole track and find the maxima to normalize the signal to the 0..1 range for the individual bands so the signal will always end up covering the full 0..1 range in the input, for easier use in functions.

feel free to request whatever else you need, i wouldn't mind writing some docs with some basic examples / hints or adding stuff to the notebook where needed.

@dmarx
Copy link
Member

dmarx commented Apr 10, 2022

regarding docs: if you write up a tutorial as a jupyter notebook, we can add it to pytti-book directly. thanks again for putting this together, will try to poke around this later today!

@dmarx
Copy link
Member

dmarx commented Apr 12, 2022

quick update: just wanted to let you know this is on my radar. I'm working on a really hard-to-nail bug in animation_mode: Video Source that might require some heavy surgery to fix, so I'm holding off on merging new features until I can get that sorted out. Once I've got video source working correctly again, merging your audio reactivity piece will be my next priority :)

@dmarx dmarx changed the base branch from main to test April 15, 2022 18:57
@dmarx dmarx mentioned this pull request Apr 20, 2022
@dmarx
Copy link
Member

dmarx commented Apr 20, 2022

rebased and added some minor fixes, see PR #140

Merged into test branch for time being. Could you add a demo and/or test case? feel free to add a small/short audio file to src/pytti/assets to be distributed for testing and example notebooks.

@dmarx dmarx closed this Apr 20, 2022
@dmarx
Copy link
Member

dmarx commented Apr 27, 2022

thanks again for this amazing contribution! Wanted to let you know the feature has been merged into the main branch and I also added some simple support in the main colab notebook.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add audio input for induced motion
2 participants