ICM FINAL

-

For my final project I worked with ML5 and Posenet, my interest for Machine learning has deepened every single week since I started ITP.

My intention was to create an interactive interface that would play sound with each movement the viewer does. This is a pre trained model so there are 5 specific poses that are pair with a particular sound. Aside from playing a sound each movement will have a different tint for each window.

This project intends to  create a fun interface that visualizes the color of the solfège with movement.



FINAL SKETCK

https://editor.p5js.org/lolo.ostia/sketches/xTyLXcHVa

https://editor.p5js.org/lolo.ostia/full/xTyLXcHVa

Sources: 


  • MUSIC BY digifishmusic. https://freesound.org/people/digifishmusic/
  • http://www.endolith.com/wordpress/2010/09/15/a-mapping-between-musical-notes-and-colors/
  • https://www.flutopedia.com/sound_color.htm
  • // ORIGINAL SOURCE CODE
  • // ml5.js: Pose Classification
  • // The Coding Train / Daniel Shiffman
  • // https://thecodingtrain.com/Courses/ml5-beginners-guide/7.2-pose-classification.html
  • // https://youtu.be/FYgYyq-xqAw
  • SPECIAL THANKS
  • David Currie, John Bezark and John Henry Thompson

Popular posts from this blog

Socially Engaged Art and Digital Practice week 8

-
What does VR do well, and what is it lacking? For the most part VR has been used as an entertainment form. While the sensorial experience beyond the headset is becoming important, there is still a long way to go. On one hand it can efficiently transport us to a different headspace in a few seconds. I think VR researches needs to think away from the Vision and touch meaning just the physical experience and think more of the psychological effects of "tele transporting" people's minds. Last year I saw the work of VR used as a training tool and thought it was and exciting detour from the traditional VR entertainment. After seeing the new research for people “phantom limb syndrome" I'm looking forward to the new development in using VR as a therapeutic or telemedicine tool. https://www.youtube.com/watch?v=_uArpsDXkvw   VR article 1 VR article 2 **Based off the famous “seeing is believing” idiom, the project involves stimulating an affected area while corresponding ...
Read more

Socially Engaged Art and Digital Practice : week 3

-
What is the role of bias in creating technological tools? I think using technological tools is one of the easiest ways to access a larger demographic therefore it should be created by All TYPES of people. For the past 20 years we have become more and more dependent on the information we consumed and exchange in a tech environment. Bias is real and it wasn't until less than a decade ago that the conversation about bias and the impact on people life's started to become more of a central topic. Now more than ever we need to give tools to people that otherwise don't have a voice in development of said technologies. Also understanding that Bias cannot disappear from one day to another, it a long process and we need to keep the conversation and education going.
Read more

Socially Engaged Art and Digital Practice week 6

-
WEB1 : Static Website  WEB2 : Interactive  (Google, Facebook) WEB3  : NFT market, VR experiences article   Just As Web3 Is Propelling Art, So Art Is Powering Web3 We can’t just copy and paste traditional representation into the Web3 space. The timing of the NFT explosion was during COVID. S hifting from analogue to digital experiences. It was a f inancially necessity for the Art market. **gamification, discoverability, and a sense of responsibility to make these virtual environments alive and trustworthy for visitors. The communities build around NFTs is what is supporting the NFT market in a way it is the opposite of the what is the happening from human connections to digital world. The NFT market is a large consumer of electricity and it is a limited resource. If we focus all resources into this market, we would need to neglect other parts of society that needs electricity. OpenSea :  Ethereum, limited accessibility,  https://web3isgoinggreat.com/ What ...
Read more