WHATAREYOULOOKINGAT is an audience-involved, interactive meta-instrument for data sonification. The overarching goal of the performance is to extract data from the audience emulating a type of government-sanctioned privacy infringement, manipulate and share the data between the three primary performers, and present that data in the form of surround sound audio and interactive, three-channel video projection.
2014
TRIGGERFISH
Performs strong and soft selection of target’s real-time activity: indexes every e-mail address seen in a session by both username and domain, logs every file seen in a session by both filename and extension, scans client-side HTTP traffic, collects every phone number and associated content from digital cell phone calls, and aggregates chat activity to include username, buddylist, and machine-specific cookies.
SECONDDATE
Exploitation technique that takes advantage of web-based protocols and man-in-the-middle position. It influences real-time communications between client and server and can quietly redirect web-browsers to FOXACID malware servers for individual client exploitation. This allows mass exploitation potential for clients passing through network choke points, but is configurable to provide surgical target selection as well.
A variety of technologies are employed to create the immersive, data gathering environment that forms the centerpiece of WHATAREYOULOOKINGAT. One of the primary sources of personal information collection is the Facebook API. Using a publicly available URL standard, WHATAREYOULOOKINGAT retrieves a wealth of information uploaded to a person’s Facebook page including their profile picture, birthdate, city of residence, profession, and assorted tastes in music, movies, and books. The text from this rich source of data is presented via the Apple text-to-speech tool, modified for streamlined generation and vocal variation in Max.
fixed 5-channel projection and 2-channel audio
interactive projection and generative 2-channel audio
interactive VR installation
