[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [sc-users] video streaming / pixel analyzing
I don't understand why you'd use SuperCollider to do vision analysis.
It's trivially difficult to get some stream of data from a moving image.
Once you do, SC is great. Before you do, it offers nothing.
Last time I did this, on a BeagleBoard XM, I adapted a blob detector in PD and sent OSC to SuperCollider. Worked fine within constraints. Wasteful but, a working hack. Both on same board.
If I did it again, I'd use as simple a vision component as I could and concentrate on my SC programming bc, audio.
If you're going to do anything more sophisticated for vision, at least in soft real-time, you want to be using the psychological abstractions of the computer vision community. Those are not audio tools.
Alfred
I wonder if Sypon/Spout, i.e., MacOS/PC open source video tools, have
any role in this type of work?
Maybe a big can of worms but nonetheless...
...edN
f@xxxxxxxxxxxxxxxxxxx wrote on 2019-01-19 10:23 AM:
> if you're on macOS there's the option of using the QuartzComposerView class. it still works under 3.10.
>
> here's an example of how to take webcamera input, display the video inside a sc window and control some parameters...
> https://www.fredrikolofsson.com/f0blog/?q=node/609
> it integrates pretty well with sc and it should be easy to extract pixel values from the video.
>
> but you'll need to edit the qtz file to do this extraction and that's one of the drawbacks... i'm not sure QuartzComposer (the qtz editor app that used to come with xcode) is supported and longer and to find it you'll have to log in and dig around apple's webpage. but if you don't need cross platform, and manages to create your qtz files, then you can distribute these to other macOS machines without requiring xcode or quartzcomposer installed.
> _f
>
>> 19 jan. 2019 kl. 16:03 skrev joseph-baader@xxxxxx:
>>
>> Hey all,
>>
>> I'm trying to write a pixel analyzer, based on the SpaceTravel Quark
>> (https://github.com/musikinformatik/SpaceTravel) and started by putting
>> pixel values of a png file in an array, which works fine. Now I thought
>> about doing the same for moving images. Is there any possibility to
>> stream video in SC? Of course I could also use Processing to analyze and
>> send osc, but using space filling curves could have some benefits e.g.
>> in scaleability and why not doing it directly in supercollider if (?)
>> there's a possibility...
>>
>> I'm grateful for any ideas and inspirations!
>>
>> Joseph
>>
>> _______________________________________________
>> sc-users mailing list
>>
>> info (subscription, etc.): http://www.birmingham.ac.uk/facilities/ea-studios/research/supercollider/mailinglist.aspx
>> archive: https://listarc.bham.ac.uk/marchives/sc-users/
>> search: https://listarc.bham.ac.uk/lists/sc-users/search/
>
>
> #|
> fredrikolofsson.com musicalfieldsforever.com
> |#
>
>
> _______________________________________________
> sc-users mailing list
>
> info (subscription, etc.): http://www.birmingham.ac.uk/facilities/ea-studios/research/supercollider/mailinglist.aspx
> archive: https://listarc.bham.ac.uk/marchives/sc-users/
> search: https://listarc.bham.ac.uk/lists/sc-users/search/
>
_______________________________________________
sc-users mailing list
info (subscription, etc.): http://www.birmingham.ac.uk/facilities/ea-studios/research/supercollider/mailinglist.aspx
archive: https://listarc.bham.ac.uk/marchives/sc-users/
search: https://listarc.bham.ac.uk/lists/sc-users/search/