| Both sides previous revision
Previous revision
Next revision
|
Previous revision
|
installation:echo_state_networks [2019/11/16 10:43]
admin |
installation:echo_state_networks [2020/09/09 16:46] (current)
admin |
| ===== Echo State Networks ====== | ===== Echo State Network ====== |
| the sonification of the computing process in an analog neural network, 2019 | the sonification of the computing process in an analog neural network, 2019 |
| | |
| | |
| | The first song a computer intoned was in the 1970s when an IBM 704 at the Bell Labs sang‘ Daisy Bell’. The same song was sung by the artificial intelligence HAL-9000 in the film “2001: A Space Odyssey” by Stanley Kubrick.\\ |
| | But why should an AI sang human songs?\\ |
| | Won’t they prefer their own beats and melodies?\\ |
| | The sonic structures produced by the eternal oscillation of analog neural networks is the more possible soundtrack when the technological singularity is reached and AI takes over. At that point in the future, when technology becomes uncontrollable - like the mathematischen John von Neumann predicted in the 1950s - the remains of the human civilization will probably listen to some kind of “Echo State Network” |
| |
| <html> | <html> |
| <div align="center"> | <div align="center"> |
| <iframe width="640" height="360" src="https://www.youtube.com/embed/XrRH4rHRnms" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe> | <iframe src="https://player.vimeo.com/video/455977563?title=0&byline=0&portrait=0" width="640" height="360" frameborder="0" allow="autoplay; fullscreen" allowfullscreen></iframe> |
| </div> | </div> |
| </html> | </html> |
| |
| Can one hear the firing of neurons? Does their action potential have pitch and timbre? How do patterns and structures of a neural network look and sound? And what will happen if the network listen and sees these sound and pattern – and all that in a feedback loop? | |
| |
| At the core of the light and sound installation “Echo State Network” by Wolfgang Spahn there will be an artificial analog neural network that will generate sound. | The installation raises the question: can one hear the firing of neurons? Does their action potential have pitch and timbre? How do patterns and structures of a neural network look and sound? And what will happen if the network listen to these sound and pattern, too - and feeds this information back into the network? |
| |
| {{ :installation:echo_state_networks_loop2019_02.jpg?600 |}}\\ | At the core of the sound installation “Echo State Network” by Wolfgang Spahn is an artificial analog neural network that generates sonic pattern and audible structures. The circuit of the neuron is an adaption of an early neural model originally designed by Japanese mathematician Shun'ichi Amari to explain the human heart beats. Thus the factor time and feedback are added to the network. Compared to Facebook and Google networks this neural systems is much more complex and manifold in its appearance. One can say this analog artificial network mirrors far more the chaotic human nature than the digital AI implementations. |
| |
| The artist Wolfgang Spahn created an analogue neuron as part of his analogue computer "Confetti". More than 100 of the [[https://paperpcb.dernulleffekt.de/doku.php?id=analog_computer:confetti501_confetti_neuron|Confetti Neurons]] will build an analog version of a so called “Echo State Network”. That is a particular kind of model of a recurrent neural network. At it‘s core is a complex and back coupling neural network, similar to a Liquid-State Machine. | {{ :installation:echo_state_network_181216.jpg?600 |}} |
| |
| The input layer of that network will have sound and light sensors that react on brightness and different frequencies. These information will be processed in the Echo State Network and than outputted with a layer of firing neurons. To make this phenomena hear able 8 speaker will amplifier the action in the network on 8 different nodes. | As part of his [[https://paperpcb.dernulleffekt.de/doku.php?id=analog_computer:analog_computer_main|Analog Computer Confetti]] the artist created an analogue electric circuit that mimic a model of a neuron. More than 150 of the [[https://paperpcb.dernulleffekt.de/doku.php?id=analog_computer:confetti501_confetti_neuron|Confetti Neurons]] will form an analogue version of a so called “Echo State Network”. And because the model for that neuron was developed to explain our heart beat this network will oscillate, pulse and create most complex pattern one can see and listen to. |
| |
| {{ :installation:echo_state_networks_loop2019_03.jpg?600 |}} | {{ :installation:echo_state_networks_loop2019_03.jpg?600 |}} |
| |
| "Echo State Networks" was shown at [[http://altspaceloop.com/exhibitions/echochamber-sfxseoul2019|Alt. Space Loop]] as part of the exhibition [[http://www.sfxseoul.org/2019/|Sound Effects Seoul]] Korea, 2019.\\ | An Echo State Network is a particular kind of model of a recurrent neural network. At it‘s core is a complex, chaotic and back coupling neural network, similar to a Liquid-State Machine. At the networks input layer a couple of sensors will react to sound and light. Brightness and frequencies will be processed and fed back in the Echo State Network. A couple of firing neurons that oscillates in a audible frequency will form the output layer. Indicator LEDs shows the action in the network as well as 8 speakers make these activity hearable at 8 different nodes of the network. Thus the visitor can witness the activity in the neural network and can get an idea of the complexity of these processes. |
| With support of [[https://www.goethe.de/ins/kr/de/index.html|Goethe Institute Korea]].\\ | |
| |
| ... and many thanks to Martin Kuentz for all the soldering help.\\ | {{ :installation:echo_state_networks_loop2019_02.jpg?600 |}}\\ |
| | <html> |
| | <iframe width="100%" height="166" scrolling="no" frameborder="no" allow="autoplay" src="https://w.soundcloud.com/player/?url=https%3A//api.soundcloud.com/tracks/849690328&color=%23a4a19c&auto_play=false&hide_related=false&show_comments=true&show_user=true&show_reposts=false&show_teaser=true"></iframe><div style="font-size: 10px; color: #cccccc;line-break: anywhere;word-break: normal;overflow: hidden;white-space: nowrap;text-overflow: ellipsis; font-family: Interstate,Lucida Grande,Lucida Sans Unicode,Lucida Sans,Garuda,Verdana,Tahoma,sans-serif;font-weight: 100;"><a href="https://soundcloud.com/wolfgang-spahn" title="Wolfgang Spahn" target="_blank" style="color: #cccccc; text-decoration: none;">Wolfgang Spahn</a> · <a href="https://soundcloud.com/wolfgang-spahn/echo-state-network-alt-space-loop-seoul" title="Echo State Network @ Alt Space Loop, Seoul" target="_blank" style="color: #cccccc; text-decoration: none;">Echo State Network @ Alt Space Loop, Seoul</a> |
| | </div> |
| | </html> |
| | |
| | "Echo State Network" was shown at [[http://altspaceloop.com/exhibitions/echochamber-sfxseoul2019|Alt-Space Loop]] as part of the exhibition [[http://www.sfxseoul.org/2019/|Sound Effects Seoul]] Korea, 2019.\\ |
| | With support of [[https://www.goethe.de/ins/kr/de/index.html|Goethe Institute Korea]].\\ |
| |
| | ... and many thanks to Martin Kuentz for helping to solder one million neurons.\\ |