What is data manipulation, why does it matter and how does it influence your life? In a world where we’re surrounded with digital media, smartphones, laptops, even smart wearables. Where we get the latest news every minute. In such a world, it’s difficult to get a sense of reality. This makes it possible to give Netflix users a new form of watching content. A show can select the shots following person A instead of person B because you showed more interest. But of course, this can also be used to show specific information in a documentary, like propaganda catered to you.
The first prototype is a small documentary about data manipulation within a filter bubble. The documentary has a couple of shots per scene and different background music. It will select what shot to use depending on the watchers age, gender and facial expression. Instead of giving all kinds of information, you can give “more specific” information. In this case, were going to change data, depending on these factors (since it’s about a filter bubble).
Due to the current corona situation, the documentary is now web based. It uses FaceAPI.js, a JavaScript library for Google’s tensor flow facial recognition. Picking scenes still depends on age, gender and facial expressions, but it runs entirely on JavaScript. This is good for reach of audience, but not so much for optimal viewing experience. (Your experience may vary depending on the strength of your hardware) Once I’m allowed to build a physical installation, this page will get updated, so stay in touch!!!
This framework could be used on interactive Netflix shows, or even games. Where the content you get would be personalized for an optimal experience. For example, you’re watching a show on Netflix and there are some things you like, and some things you don’t. The Netflix show was made for a broad scope of people, therefore there are some joke that land, some that don’t. You sympathize with some characters but not all. What if we would personalize the show, by selecting the following shots as the person watches. Kind of like Netflix’s Black mirror Bandersnatch. But this time, the choices happen unconsciously.
Your online recommended content is just a small spec of the content available to you. that’s due to the filter bubble. Your online personality, search queries and even behavior in the real life all adds up to the scope of content you get when searching something on google, shopping on Amazon, opening your YouTube Homepage, your daily mix on Spotify, but most important, your personalized adds. This isn’t bad by nature. It helps you get the most optimal online experience, but at the cost of your privacy. It makes sure you’re the average male gets adds about getting a new car, and your average female gets adds about lingerie. It makes sure the average space head gets videos about SpaceX while the fashion diva gets beauty YouTube videos.
Currently you have to change all events and video/audio in code. In the future, I would like this to have a user interface, so everyone who has a vision or idea could make an interactive movie, show or documentary.