This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
installation:echo_state_networks [2019/11/16 10:43] admin |
installation:echo_state_networks [2020/02/29 00:35] (current) admin |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| - | ===== Echo State Networks ====== | + | ===== Echo State Network ====== |
| the sonification of the computing process in an analog neural network, 2019 | the sonification of the computing process in an analog neural network, 2019 | ||
| Line 8: | Line 8: | ||
| </html> | </html> | ||
| - | Can one hear the firing of neurons? Does their action potential have pitch and timbre? How do patterns and structures of a neural network look and sound? And what will happen if the network listen and sees these sound and pattern – and all that in a feedback loop? | + | Can one hear the firing of neurons? Does their action potential have pitch and timbre? How do patterns and structures of a neural network look and sound? And what will happen if the network listen to these sound and pattern, too - and feeds this information back into the network? |
| - | At the core of the light and sound installation “Echo State Network” by Wolfgang Spahn there will be an artificial analog neural network that will generate sound. | + | At the core of the sound installation “Echo State Network” by Wolfgang Spahn is an artificial analog neural network that generates sonic pattern and audible structures. The circuit of the neuron is an adaption of an early neural model originally designed by Japanese mathematician Shun'ichi Amari to explain the human heart beats. Thus the factor time and feedback are added to the network. Compared to Facebook and Google networks this neural systems is much more complex and manifold in its appearance. One can say this analog artificial network mirrors far more the chaotic human nature than the digital AI implementations, it creates a real neural Doppelganger. |
| - | {{ :installation:echo_state_networks_loop2019_02.jpg?600 |}}\\ | ||
| - | The artist Wolfgang Spahn created an analogue neuron as part of his analogue computer "Confetti". More than 100 of the [[https://paperpcb.dernulleffekt.de/doku.php?id=analog_computer:confetti501_confetti_neuron|Confetti Neurons]] will build an analog version of a so called “Echo State Network”. That is a particular kind of model of a recurrent neural network. At it‘s core is a complex and back coupling neural network, similar to a Liquid-State Machine. | + | {{ :installation:echo_state_network_181216.jpg?600 |}} |
| - | The input layer of that network will have sound and light sensors that react on brightness and different frequencies. These information will be processed in the Echo State Network and than outputted with a layer of firing neurons. To make this phenomena hear able 8 speaker will amplifier the action in the network on 8 different nodes. | + | As part of his [[https://paperpcb.dernulleffekt.de/doku.php?id=analog_computer:analog_computer_main|Analog Computer Confetti]] the artist created an analogue electric circuit that mimic a model of a neuron. More than 150 of the [[https://paperpcb.dernulleffekt.de/doku.php?id=analog_computer:confetti501_confetti_neuron|Confetti Neurons]] will form an analogue version of a so called “Echo State Network”. And because the model for that neuron was developed to explain our heart beat this network will oscillate, pulse and create most complex pattern one can see and listen to. |
| {{ :installation:echo_state_networks_loop2019_03.jpg?600 |}} | {{ :installation:echo_state_networks_loop2019_03.jpg?600 |}} | ||
| - | "Echo State Networks" was shown at [[http://altspaceloop.com/exhibitions/echochamber-sfxseoul2019|Alt. Space Loop]] as part of the exhibition [[http://www.sfxseoul.org/2019/|Sound Effects Seoul]] Korea, 2019.\\ | + | An Echo State Network is a particular kind of model of a recurrent neural network. At it‘s core is a complex, chaotic and back coupling neural network, similar to a Liquid-State Machine. At the networks input layer a couple of sensors will react to sound and light. Brightness and frequencies will be processed and fed back in the Echo State Network. A couple of firing neurons that oscillates in a audible frequency will form the output layer. Indicator LEDs shows the action in the network as well as 8 speakers make these activity hearable at 8 different nodes of the network. Thus the visitor can witness the activity in the neural network and can get an idea of the complexity of these processes. |
| + | |||
| + | {{ :installation:echo_state_networks_loop2019_02.jpg?600 |}}\\ | ||
| + | |||
| + | "Echo State Network" was shown at [[http://altspaceloop.com/exhibitions/echochamber-sfxseoul2019|Alt. Space Loop]] as part of the exhibition [[http://www.sfxseoul.org/2019/|Sound Effects Seoul]] Korea, 2019.\\ | ||
| With support of [[https://www.goethe.de/ins/kr/de/index.html|Goethe Institute Korea]].\\ | With support of [[https://www.goethe.de/ins/kr/de/index.html|Goethe Institute Korea]].\\ | ||
| ... and many thanks to Martin Kuentz for all the soldering help.\\ | ... and many thanks to Martin Kuentz for all the soldering help.\\ | ||
Wolfgang Spahn is a visual & sound artist based in Berlin. His work includes interactive installations, performances of light & sound and miniature-slide-paintings. His art explores the field of analogue and digital media and focuses on both their contradiction and their correlation.
He is faculty member of the Sound Studies and Sonic Arts, University of the Arts, Berlin, Germany.
Here is most of the hard- and software the artist developed for his artwork.
DER NULLEFFEKT
PAPER-PCB
- Analog Computer
- Pop Neuron
- Paper-Duino
- Paper Synthesizer
- Paper Bits
- Raspberry Pi Hats
- VGA Synthesizer
- Sound Boards
ART COOPERATION