[Csnd] [semi-OT] "synthesizing" graphics from audio
Date | 2025-04-23 00:07 |
From | "Jeanette C." |
Subject | [Csnd] [semi-OT] "synthesizing" graphics from audio |
Hey hey, just today someone asked, if I couldn't add a little more interesting image content to my music on Youtube. I had been thinking about that before. Does anyone here know of a text programmable tool that can create abstract images from music? Based on some kind of audio analysis perhaps? Can Csound be used to achieve that? I was thinking of abstract geometric shapes in varying colours. It's been a while since I've seen a desktop audio player app on an actual screen, but some of them used to have similar features... If you can think of something, it could be a Python library, that can load audio and produce and save moving images, I'd be grateful.x! Thanks and best wishes, Jeanette -- * Website: http://juliencoder.de - for summer is a state of sound * Youtube: https://www.youtube.com/channel/UCMS4rfGrTwz8W7jhC1Jnv7g * Audiobombs: https://www.audiobombs.com/users/jeanette_c * GitHub: https://github.com/jeanette-c I saw your smile Stay with me a while <3 (Britney Spears) Csound mailing list Csound@listserv.heanet.ie https://listserv.heanet.ie/cgi-bin/wa?A0=CSOUND Send bugs reports to https://github.com/csound/csound/issues Discussions of bugs and features can be posted here |
Date | 2025-04-23 00:37 |
From | Richard Knight |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
Hi, I don't know any out-of-the-box solutions but you can use PIL to draw graphics as frames and then string those together into video using ffmpeg or similar. I used this synchronised with Csound for a couple of experimental videos - https://www.youtube.com/watch?v=BTTvcESpaq4 ; https://www.youtube.com/watch?v=qW-Igs75fEE The image opcodes in Csound (https://csound.com/docs/manual/imagecreate.html) could be used similarly to create individual frames, but are very low level - not used them much. moviepy (https://zulko.github.io/moviepy/) is a useful python library for creating more detailed videos as well but more geared towards manipulating existing video. Also I've created an experimental plugin for SDL graphics within Csound - this outputs to the screen rather than a file, but can be quite easily used for basic shapes etc. With all these, there's work to do in mapping audio features to visual features though.. On 2025-04-23 00:07, Jeanette C. wrote: > Hey hey, > just today someone asked, if I couldn't add a little more interesting > image content to my music on Youtube. I had been thinking about that > before. > > Does anyone here know of a text programmable tool that can create > abstract images from music? Based on some kind of audio analysis > perhaps? Can Csound be used to achieve that? I was thinking of > abstract geometric shapes in varying colours. It's been a while since > I've seen a desktop audio player app on an actual screen, but some of > them used to have similar features... > > If you can think of something, it could be a Python library, that can > load audio and produce and save moving images, I'd be grateful.x! > > Thanks and best wishes, > > Jeanette > > -- > * Website: http://juliencoder.de - for summer is a state of sound > * Youtube: https://www.youtube.com/channel/UCMS4rfGrTwz8W7jhC1Jnv7g > * Audiobombs: https://www.audiobombs.com/users/jeanette_c > * GitHub: https://github.com/jeanette-c > > I saw your smile > Stay with me a while <3 > (Britney Spears) > > Csound mailing list > Csound@listserv.heanet.ie > https://listserv.heanet.ie/cgi-bin/wa?A0=CSOUND > Send bugs reports to > https://github.com/csound/csound/issues > Discussions of bugs and features can be posted here Csound mailing list Csound@listserv.heanet.ie https://listserv.heanet.ie/cgi-bin/wa?A0=CSOUND Send bugs reports to https://github.com/csound/csound/issues Discussions of bugs and features can be posted here |
Date | 2025-04-23 13:46 |
From | Si Mills |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
Hi Jeanette A few web-based options: Another Csound wasm option to explore is CABLES.gl if you fancy something a bit more visual programming like Pure Data. Hydrasynth is really cool, though I’ve yet to see a direct integration, but I think something could be done. You can however send midi events to have visuals react :) Other than that: Openframeworks (bit more involved), Touchdesigner, Game engines: Unity, Unreal — but a bit more involved +++ I think web might be the route to faster results though. Simply sending MIDI/OSC events to said options, or in some cases audio analysis Cheers, S
|
Date | 2025-04-23 13:48 |
From | Si Mills |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
Sorry — Hydrasynth = Hydra (https://hydra.ojack.xyz/) The former is an actual synth
|
Date | 2025-04-23 13:53 |
From | "Jeanette C." |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
Hi Richard and S., thanks both of your for your suggestions. @Richard: I've taken a look at PIL (Python Pillow), which comes closest. Though I think with that particular interface, I might almost return to POV-Ray and work that way. Perhaps not that reactive in the end. :) @smills: sorry all those are out. Can't use that GUI stuff, which is why I particularly asked for text-programmable stuff. I should have made myself clearer, in saying that I need something that can be developed and run purely from the commandline. I love the Hydrasynth, though haven't come across the other, even though I'm aware of a few video synthesizers, mostly in hardware, they get shown at synth events now, which is great in itself. Best wishes, Jeanette -- * Website: http://juliencoder.de - for summer is a state of sound * Youtube: https://www.youtube.com/channel/UCMS4rfGrTwz8W7jhC1Jnv7g * Audiobombs: https://www.audiobombs.com/users/jeanette_c * GitHub: https://github.com/jeanette-c I believe We all have one true love Somewhere in this world <3 (Britney Spears) Csound mailing list Csound@listserv.heanet.ie https://listserv.heanet.ie/cgi-bin/wa?A0=CSOUND Send bugs reports to https://github.com/csound/csound/issues Discussions of bugs and features can be posted here |
Date | 2025-04-23 14:09 |
From | Philipp von Neumann <0000119f78f3a4f9-dmarc-request@LISTSERV.HEANET.IE> |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
I did not know that cables has a csound implementation yet. Are there some example patches? Am 23.04.2025 um 14:46 schrieb Si Mills <smills@rootsix.net>:
|
Date | 2025-04-23 14:40 |
From | Richard Knight |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
Hydrasynth does look quite cool. I do actually love POV-ray - in a nostalgic and perhaps slightly masochistic way! Incidentally there's a Python interface for it - https://github.com/Zulko/vapory - which may be of use. On 2025-04-23 13:53, Jeanette C. wrote: > Hi Richard and S., > thanks both of your for your suggestions. > > @Richard: I've taken a look at PIL (Python Pillow), which comes > closest. Though I think with that particular interface, I might almost > return to POV-Ray and work that way. Perhaps not that reactive in the > end. :) > > @smills: sorry all those are out. Can't use that GUI stuff, which is > why I particularly asked for text-programmable stuff. I should have > made myself clearer, in saying that I need something that can be > developed and run purely from the commandline. > > I love the Hydrasynth, though haven't come across the other, even > though I'm aware of a few video synthesizers, mostly in hardware, they > get shown at synth events now, which is great in itself. > > Best wishes, > > Jeanette > > -- > * Website: http://juliencoder.de - for summer is a state of sound > * Youtube: https://www.youtube.com/channel/UCMS4rfGrTwz8W7jhC1Jnv7g > * Audiobombs: https://www.audiobombs.com/users/jeanette_c > * GitHub: https://github.com/jeanette-c > > I believe > We all have one true love > Somewhere in this world <3 > (Britney Spears) > > Csound mailing list > Csound@listserv.heanet.ie > https://listserv.heanet.ie/cgi-bin/wa?A0=CSOUND > Send bugs reports to > https://github.com/csound/csound/issues > Discussions of bugs and features can be posted here Csound mailing list Csound@listserv.heanet.ie https://listserv.heanet.ie/cgi-bin/wa?A0=CSOUND Send bugs reports to https://github.com/csound/csound/issues Discussions of bugs and features can be posted here |
Date | 2025-04-23 14:57 |
From | luis antunes pena <00000fd5d0d20dbf-dmarc-request@LISTSERV.HEANET.IE> |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
Attachments | visualmusic.zip |
Hi Jeanette, you could also try processing + csound via OSC. I've attached a simple example that should work on the fly. Rory Walsh made some years ago an integration of processing and csound. Hope it helps. Best, Luís On 23.04.25 01:07, Jeanette C. wrote:
Hey hey, |
Date | 2025-04-23 15:10 |
From | "Jeanette C." |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
Hi Richard, thanks for the Python POV-Ray library. that might really be the way forwards. So I can combiine two things that I know. I see why you might remember it with some frustration. But if you want to do some graphics design while being blind - or as close as makes no difference - POV-Ray is absolutely ACE! :) Best wishes, Jeanette -- * Website: http://juliencoder.de - for summer is a state of sound * Youtube: https://www.youtube.com/channel/UCMS4rfGrTwz8W7jhC1Jnv7g * Audiobombs: https://www.audiobombs.com/users/jeanette_c * GitHub: https://github.com/jeanette-c I believe We all have one true love Somewhere in this world <3 (Britney Spears) Csound mailing list Csound@listserv.heanet.ie https://listserv.heanet.ie/cgi-bin/wa?A0=CSOUND Send bugs reports to https://github.com/csound/csound/issues Discussions of bugs and features can be posted here |
Date | 2025-04-23 15:14 |
From | Richard Knight |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
Ah great, I am glad that may be helpful. And yes, I can absolutely understand, while 3D modelling has moved to be quite visual in design, for text scene description and scripting, POV-Ray is fantastic! On 2025-04-23 15:10, Jeanette C. wrote: > Hi Richard, > thanks for the Python POV-Ray library. that might really be the way > forwards. So I can combiine two things that I know. I see why you > might remember it with some frustration. But if you want to do some > graphics design while being blind - or as close as makes no difference > - POV-Ray is absolutely ACE! :) > > Best wishes, > > Jeanette > > -- > * Website: http://juliencoder.de - for summer is a state of sound > * Youtube: https://www.youtube.com/channel/UCMS4rfGrTwz8W7jhC1Jnv7g > * Audiobombs: https://www.audiobombs.com/users/jeanette_c > * GitHub: https://github.com/jeanette-c > > I believe > We all have one true love > Somewhere in this world <3 > (Britney Spears) > > Csound mailing list > Csound@listserv.heanet.ie > https://listserv.heanet.ie/cgi-bin/wa?A0=CSOUND > Send bugs reports to > https://github.com/csound/csound/issues > Discussions of bugs and features can be posted here Csound mailing list Csound@listserv.heanet.ie https://listserv.heanet.ie/cgi-bin/wa?A0=CSOUND Send bugs reports to https://github.com/csound/csound/issues Discussions of bugs and features can be posted here |
Date | 2025-04-23 15:18 |
From | "Jeanette C." |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
Hi Luis, thanks for the example. Do you know how you could run Processing on the commandline? The OSC control is a nice feature. Best wishes, Jeanette -- * Website: http://juliencoder.de - for summer is a state of sound * Youtube: https://www.youtube.com/channel/UCMS4rfGrTwz8W7jhC1Jnv7g * Audiobombs: https://www.audiobombs.com/users/jeanette_c * GitHub: https://github.com/jeanette-c I believe We all have one true love Somewhere in this world <3 (Britney Spears) Csound mailing list Csound@listserv.heanet.ie https://listserv.heanet.ie/cgi-bin/wa?A0=CSOUND Send bugs reports to https://github.com/csound/csound/issues Discussions of bugs and features can be posted here |
Date | 2025-04-23 15:41 |
From | Si Mills |
Subject | Re: [Csnd] [semi-OT] "synthesizing" graphics from audio |
Yes of course, sorry https://cables.gl/p/tjO3wp I just need to abstract out the setup to make the op less tied to the patch
|