aprog_ideas_mini_projects.note (2339B)
1 2 Mini Projects 3 ================================================================================ 4 5 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 6 | 1 C(++) Speech Features | 7 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 8 Make a lower level version of Python Speech Features that can perform the 9 following: 10 - FFT 11 - Filtering (for filter bank aka MFSC) 12 - DCP (for MFSC decorrelation) 13 14 15 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 16 | 2 Pitch detection | 17 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 18 - Python Script / program that lets user whistle melodies and get a Csound / OSC 19 / MIDI melody out (with some adjusting) 20 - First use simple autocorrelation. Maybe use some open source pitch detection 21 later. 22 23 24 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 25 | 3 (JACK) Looper program | 26 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 27 - Triggered by a single button (/ USB foot pedal) 28 - Window functionality for crossfade / smooth transitions 29 30 31 +------------------------------------------------------------------------------+ 32 | 4 CLI sampler component: `detect_start()` | 33 +------------------------------------------------------------------------------+ 34 - `detect_start()` helps finding where the actual audio starts in an audio file. 35 - Just find the biggest leap in RMS (using a window) to approximate where the 36 sound starts. 37 - Arguments: `(double * sound, uint frame_size)`. That should be it... 38 39 40 +------------------------------------------------------------------------------+ 41 | V Far-future / Never | 42 +------------------------------------------------------------------------------+ 43 - RaspPi can be used as sound module for MIDI keyboards / dig. piano w/ Csound. 44 - Can make a complete workstation out of a keyboard connected to a RaspPi (or 45 a more powerful computer...) 46