Play table

Using proximity sensors for playing midi tones combined with LED visualization


Description

The aim of this project was to create a table sized device with multiple proximity sensors that can play midi tones. Each sensor had a few LEDs to show hand distance above the table. This table could be used by one or more persons at once.


Hardware setup

First I created a prototype from a cardboard to test sensors and some logic behind. Than I ordered a customized plottered sticker with a design which was painted with bare conductive paint. Afterwards I drilled some holes and connected the touchboard with 7 arduino Nanos. Each arduino was connected to 13 LEDs diodes. At the end I added two potentiometers. One for controlling volume and one for changing notes setup.



Programming

Programming consists of two parts. Master(touchboard) program that reads values from proximity sensors and sends messages to slaves(arduinos). Second program for slaves that reads messages from master and toggle LEDs.
Using Arduino IDE for programming was helpful, even more that the touch board has got already built in midi library, so it was quite simple to use it. For communication I created a simple protocol to distribute proximity from master to slaves . There is no delay between real distance and lit up LEDs (baud rare is set to 9600 )

Protocol example:
ID_SEPARATOR # ID # VALUE_SEPARATOR # VALUE #.....



Lesson learned

My very first idea was to control the volume for each sensor by distance. I tried to use separate midi channels, but it didn't worked. So I have to come up with another solution. I decided to use thresholds for the distances.

During the testing version with cardboard I've had some small issues with touchboard. Sending messages out using TX like in any other arduino didn't work here. Later after reading official docs. I've noticed that this board has two serials. So I have to use Serial1 instead (minor issue but didn't find anything mentioned about it anywhere).



Update 2016-11-20


Testing

I've got in touch with Julian who is a musician. After every session of testing we had, he gave me tips for more features or small changes, so he can play something on the table. We've come across few refactoring cycles, some optimalization (the memory limit can be achieved very easily).



New features

Play table provides a USB MIDI output interface. This feature allows us to master the output from the table using a MIDI protocol.

I solved the previous issue that each sensor can use it's own volume by setting a different channel. I've used this feature for two sensor modes which use distance like a trigger to launch single tone or chord.

During testing sessions, we came up with 3 more different sensor modes:

  • chord mode: plays an chord in full sensor range
  • multi chord: toggling multiple chords based on the distance above the sensor
  • arpeggio mode: play tones in tempo that is dynamically changing by the hand distance above the sensor
  • arpeggio auto mode: same as arpeggio mode, but with auto-play after user touches the sensor


Lesson learned

After few sessions the painted sensors were little blurry because the paint would fade away because of touching. I was thinking about adding new thin layer, but transparent spray paint solved this problem for good. The resistance characteristics did not visibly change. So if you are planning to use bare paint you can freely use transparent spray paint to preserve the conductive paint from blurring.

                             

Comments

  1. AlastoNovember 17, 2019 at 10:56 PM

    Hello Sir, Can you teach me how the programming code of your arpeggio mode and arpeggio auto mode. thanks

    ReplyDelete
  2. MiroNovember 17, 2019 at 10:56 PM

    Hi Alasto, thank you for your interest. I'll try to keep it short. It is very simple logic. The arpeggio mode is just repeating notes in loop by tempo that can be changed by distance of your hand. To better understand let's have an example: Remember we are using midi library, so any note can be represented as number. Let's take an array of notes arr[] = {58, 62, 65, 69, 70, 74, 77, 81, 77, 74, 70, 69, 65, 62}; So if I put my hand above the sensor, the distance value will be let's say 100. So we can hear that these notes are playing with changing frequency 1000 milliseconds. Now I'll put my hand closer to the sensor, the distance value will be let's say 50. So the note's tempo are repeating more frequently (with 500 milliseconds frequency). The auto mode is just another option to keep the loop in same frequency without waiving hand above the sensor.

    ReplyDelete
  3. AlastoNovember 17, 2019 at 10:57 PM

    Ok thanks Sir, by the way im have question need to ask again, do the 1 play area where on video above have use 7 play area can use 2 sensor together like touch sensor and distance sensor programing? thanks or just 1 play area just can use 1 sensor between touch or hand distance.hahaha

    ReplyDelete
  4. MiroNovember 17, 2019 at 10:58 PM

    Yes you can use it as a touch and distance sensor at a same time. There is no difference between them. The value, when your hand is very close is the same when you are touching the sensor.

    ReplyDelete
  5. AlastoNovember 17, 2019 at 10:59 PM

    Good night sir , sorry for asking again, may i know the previous reply " Remember we are using midi library " , May i know which midi library sir have use it for make distance sensor with arpegio mode because in im here have many midi example like " midi_interface_generic , Midi_theremin, and Midi_piano " thanks and sorry to bother

    ReplyDelete

Post a Comment

Popular posts from this blog

Counting dice and train wagons using computer vision

Image
Computer vision exercises with preprocessing Before the next project I decided to do some computer vision exercises. Each example is based on a simple logic image preprocessing. No data structure or learning is required. Dice I got this idea while browsing the net. I was curious about how hard can it be to write such a script. I'll describe the algorithm in steps. movement detection : Comparing few frames with thresholds gives us the information, whether something is moving in the frame. Adding some small time frame after the movement stops gives us more precise information. remove background : Thresholding gray frame removes the background and gives us binary image with objects cropping the objects : Using contours to detect object and then separate them by cropping. detecting dots : Inverting the image we get objects that can be again simply detected using contours. filtering dots : If dice is visible also from the side therefore dots from that side can be recogn
Read more

Skate tricks recognition using gyroscope

Image
In this article we're going to describe how to recognize a skateboard trick using a gyroscope. This sensor is already present in most of the smartphones but in case you are not familiar with it, here is a description . Before we begin, small disclaimer. This project was originally as a part of hackathon that was used with Slido and the purpose was to confirm that it's possible to recognize a trick using a gyroscope. For the sake of simplicity of this project we're not considering skater's stance on a board and we're only trying to recognize 2 simple tricks. So, let's begin by splitting the problem into several smaller ones. We need to record the trick, store it, describe it, understand it, and then of course recognize it. Recording the trick Let's start with the trick recording. To have a precise data we need to have a device with a gyroscope that is attached directly to a skateboard. We need to place it on the bottom of the board, otherwise it might interfe
Read more