IoT Can Change The Way Music is Produced Forever

Imagine you are the owner of a commercial music production business and you have been losing a lot of time while choosing the right direction for your compositions and arrangements. Being torn between a few licks or melody alternatives, you are unable to decide confidently.

If only there was a crystal ball to tell the best option and the reason behind the decision. Then shaking hands with prospective clients would be much easier. Well, may be crystal ball is out of the question but an IoT device might work just fine too.

Recently, I've been into Internet of Things concept and its potential of introducing us a new paradigm, more precisely, a tech revolution. So I wanted to see whether I could combine one of my personal interests with it to initiate a small project.

Let me introduce you Deep Emo (Yes, dedicated to Deep Thought). Utilizing wrist-bands with Galvanic Skin Response (GSR) and Pulse Detection Sensors that can track emotional state of the wearer through a data acquisition tool feeding from Arduino, it's supposed to tell how the music affects the listener.

I guess this is not even a minimum viable product. Just a proof of principle prototype that can only show some of the tricks it has in its bag. It has a massive backlog to work on.

Moreover, in the video you probably saw that the dramatic changes occurred only when the subject moved his fingers significantly. By doing this, I wanted to give an idea about the current sensitivity of the system. It can be easily alternated by coding. The difficult part is making a scientifically proper adjustment. Honestly, there are already some researches which could light the way for doing this right such as Impact of Music on College Students: Analysis of Galvanic Skin Responses. And I need to go over them.

All in all, possibilities are endless. This may only be a tiny demonstration elicited from a fad but I'm sure that in the near future we will see much more complicated, automated and integrated solutions in this scope. I hope I will be able to contribute to it and be a part of this progress.

A few outputs...

LED ZEPPELIN - IMMIGRANT SONG

Some early experiments regarding detection of emotional changes with help of GSR + Arduino + Parallax Data Acquisition tool (PLX-DAQ). It was during Immigrant Song by Led Zeppelin. Although the result is somewhat encouraging, I think I need a lot more experiments, additional tools and of course unbiased subjects since it's one of my all time favorite rock bands = )

 

SABINA ZWEIACKER - THE DRAGONBORN COMES (SKYRIM)

Another experiment with an excerpt of The Dragonborn Comes. It is notable that the value increased while Sabina's falsetto was growing up with the instrumental tension. The song starts after 00:50 https://lnkd.in/gg7Dsrq

 

Arduino Code:

float previousVoltage;
float value2;
unsigned long int sec;    //variable to hold the time
float voltage;         //variable to hold the voltage form A2
void setup() {
  Serial.begin(128000);               //Fastest baudrate
  Serial.println("CLEARDATA");        //This string is defined as a 
                                      // commmand for the Excel VBA 
                                      // to clear all the rows and columns
  Serial.println("LABEL,Computer Time,Seconds,Status,Value,Change");  
                                      //LABEL command creates label for 
                                      // columns in the first row with bold font
}
void loop() {
  sec = millis() / 1000;
  voltage = 5.0 * analogRead(A2) / 1023.0;
  value2 = voltage - previousVoltage;
  Serial.print("DATA,TIME,");
  Serial.print(sec);
  Serial.print(",");

  if (previousVoltage == 0) {
      previousVoltage = voltage;
  } else {
      if (voltage - previousVoltage > 0.05) {
        Serial.print("chill out");
      } else if (previousVoltage - voltage > 0.05) {
        Serial.print("excitement");
      }

      previousVoltage = voltage;
  }

  Serial.print(",");
  Serial.print(3-voltage);
  Serial.print(",");
  Serial.println(-1*value2);
  
  delay(1000);                    //Take samples every one second
}

 

Softwares & Tools

Facebook
LinkedIn

Be the first to comment on "IoT Can Change The Way Music is Produced Forever"

Leave a comment

Your email address will not be published.


*