RE: [Csnd] Spectrum to midi
Date | 2013-02-02 10:23 |
From | Jacques Leplat |
Subject | RE: [Csnd] Spectrum to midi |
That is a really mindboggling idea. Would anyone know if this can be done as a csd? -------- Original Message -------- Subject: [Csnd] Spectrum to midi From: Oeyvind Brandtsegg <oyvind.brandtsegg@ntnu.no> To: Csound mailing list address <csound@lists.bath.ac.uk> CC: Hi, I did some preliminary experiments converting realtime audio input to midi notes. Just a simple pvs analysis, and triggering midi notes with a frequency matchin that of the analysed bins. This was inspired by the work of Peter Ablinger (e.g. Deus Cantando).
As we have a midi controllable church organ here at NTNU, I figured, well, it would be worth a try. Last week we did a concert for Disklaiver and Orgen, playing the piano studies of Conlon Nancarrow, and in connection to that I did a brief demo of this too. The notion of "a talking organ" was picked up quite vigorously by the media... :-)
Perhaps some of you will find it amusing too. (I never said or intended anything about making the organist redundant, but well, headings...) Oeyvind Brandtsegg Professor of Music Technology NTNU 7491 Trondheim Norway Cell: +47 92 203 205 http://flyndresang.no/ http://www.partikkelaudio.com/ http://soundcloud.com/brandtsegg http://soundcloud.com/t-emp |
Date | 2013-02-02 10:30 |
From | Victor.Lazzarini@nuim.ie |
Subject | Re: RE: [Csnd] Spectrum to midi |
Attachments | None None |
Date | 2013-02-02 10:32 |
From | Victor.Lazzarini@nuim.ie |
Subject | Re: RE: [Csnd] Spectrum to midi |
Attachments | None None |
Date | 2013-02-02 14:40 |
From | Oeyvind Brandtsegg |
Subject | Re: RE: [Csnd] Spectrum to midi |
Attachments | audio_to_midi.csd |
Thanks all. And of course, you can get the csd.2013/2/2 <Victor.Lazzarini@nuim.ie> As far as I can see, it is written as a CSD. -- Oeyvind Brandtsegg Professor of Music Technology NTNU 7491 Trondheim Norway Cell: +47 92 203 205 http://flyndresang.no/ http://www.partikkelaudio.com/ http://soundcloud.com/brandtsegg http://soundcloud.com/t-emp |
Date | 2013-02-02 14:41 |
From | Oeyvind Brandtsegg |
Subject | Re: RE: [Csnd] Spectrum to midi |
and btw. next concert tomorrow, ...routing audio from T-EMP (drums, vocals, double bass) to the organ to complement live sampling and other processing2013/2/2 Oeyvind Brandtsegg <oyvind.brandtsegg@ntnu.no>
-- Oeyvind Brandtsegg Professor of Music Technology NTNU 7491 Trondheim Norway Cell: +47 92 203 205 http://flyndresang.no/ http://www.partikkelaudio.com/ http://soundcloud.com/brandtsegg http://soundcloud.com/t-emp |
Date | 2013-02-02 15:12 |
From | Steven Yi |
Subject | Re: RE: [Csnd] Spectrum to midi |
Thanks for sharing that Oeyvind! I found it very concise and easy to read. I remember a company recently announced having this kind of thing built-in to their sequencer. Using this CSD should work with any sequencer to sing in midi data and auto-transcribe. :D (Well, I imagine one would want to recode to assume monophonic source and have a single note at a time, and that might require some working of the algorithm for that, but seems like that'd be a fun thing to explore). I had wanted something like this in blue for a long time, but had not got around to it. Basing the functionality on your code should make it straightforward. Hope the performance goes well! (Will their be a recording?) All best and thanks again! steven On Sat, Feb 2, 2013 at 2:41 PM, Oeyvind Brandtsegg |
Date | 2013-02-02 15:20 |
From | Richard Boulanger |
Subject | Re: [Csnd] Spectrum to midi |
Oeyvind, Have a great performance. It would be really super to add this .csd and capability to the Examples in CsoundQt. Would you consider that Oeyvind? Also, an article on the design and algorithm for The Csound Journal would be awesome too. It would be required reading in my DSP class every semester! Certainly this instrument will be one that we study from now on. Thanks so much for sharing it with us - and again - congratulations on all the exciting press you are getting from this work. Dr.B. -------------------------------- Dr. Richard Boulanger ----------------------------------- On Feb 2, 2013, at 10:12 AM, Steven Yi <stevenyi@gmail.com> wrote: Thanks for sharing that Oeyvind! I found it very concise and easy to |
Date | 2013-02-02 16:30 |
From | JLFerreira |
Subject | Re: RE: [Csnd] Spectrum to midi |
Congrats Oeyvind!!!! I have a lot to learn with this programming - thanks for sharing!!! Have a great concert!!! JLFcomposer On 2 February 2013 14:40, Oeyvind Brandtsegg <oyvind.brandtsegg@ntnu.no> wrote:
-- JLF http://www.youtube.com/user/JLFcompositor |
Date | 2013-02-02 16:35 |
From | Rory Walsh |
Subject | Re: RE: [Csnd] Spectrum to midi |
I just took a look at the code and made a simple audio to midi plugin. I added sliders to control kampThresh, klowNote, and khighNote. The rest of your code works out of the box. I just have to wait till I return to the land of windows or OSX before I can try it out with a host. On 2 February 2013 16:30, JLFerreira |
Date | 2013-02-02 18:01 |
From | Richard Boulanger |
Subject | Re: [Csnd] Spectrum to midi |
post it... we can "try" it out here on our OSX hosts. ;-} -dB -------------------------------- Dr. Richard Boulanger ----------------------------------- On Feb 2, 2013, at 11:35 AM, Rory Walsh <rorywalsh@ear.ie> wrote: I just took a look at the code and made a simple audio to midi plugin. |
Date | 2013-02-02 18:05 |
From | Rory Walsh |
Subject | Re: [Csnd] Spectrum to midi |
I will, as soon as release the upcoming version. Iain is currently testing somnew features, once he gives the ok, we're good to go. He's quite thorough! |
Date | 2013-02-02 18:08 |
From | Richard Boulanger |
Subject | Re: [Csnd] Spectrum to midi |
new features. can't wait. such a great app/resource! thanks. ----------------------------------------- Dr. Richard Boulanger, Ph.D. Professor of Electronic Production and Design Professional Writing and Music Technology Division Berklee College of Music 617-747-2485 (office) 774-488-9166 (cell) ------------------------------------------------------------------------------------------------- On Feb 2, 2013, at 1:05 PM, Rory Walsh <rorywalsh@ear.ie> wrote: I will, as soon as release the upcoming version. Iain is currently |
Date | 2013-02-03 03:55 |
From | William Wignall |
Subject | Re: [Csnd] Spectrum to midi |
Attachments | pitch_tracker.csd |
Oeyvind, This is absolutely amazing. I tried it out with my electric violin. Playing harder yields more partials, as does playing lower on the instrument. It's a great feeling! It feels I'm playing a dynamic additive synth! Coinicendally, I've been working on a similar pitch-to-MIDI csd too! It has some different features like pitch bend (for vibrato), aftertouch, and amplitude inversion analysis (especially useful for bowed stringed instruments). You might wish to look at it so that you might be able to add more features to yours. Also can you explain your csd? I hardly understand it! Trev Wignall On Sat, Feb 2, 2013 at 1:08 PM, Richard Boulanger <rboulanger@berklee.edu> wrote:
|
Date | 2013-02-04 12:45 |
From | Oeyvind Brandtsegg |
Subject | Re: [Csnd] Spectrum to midi |
Yes, it responds quite differently when doing spectrum-to-midi rather than pitchtracker-to-midi. The spectrum-to-midi method allows different response to different vocal wowels, so it is (in a coarse manner) possible to hear the difference between an "a" and an "o" for example. You pitchtracker-to-midi csd has some nice details on tracking pitch deviations, very neat for monophonic operation. The code in brief does this:- for all frequencies (512 bands in this example) in the analysis: - quanize the frequencies to match the frequencies reachable from midi note numbersOeyvind 2013/2/3 William Wignall <wwignall@berklee.edu> Oeyvind, -- Oeyvind Brandtsegg Professor of Music Technology NTNU 7491 Trondheim Norway Cell: +47 92 203 205 http://flyndresang.no/ http://www.partikkelaudio.com/ http://soundcloud.com/brandtsegg http://soundcloud.com/t-emp |