A Collective Photographic City Portrait
Today, we collectively and continuously document our city experience on social media platforms, shaping a virtual city image. Multiplicity reveals a novel view of this photographic landscape of attention and interests. How does Paris look as seen through the lens of thousands of photographers? What are the hotspots of attraction, what are the neglected corners? What are recurring poses and tropes? And how well do the published pictures reflect your personal view of the city?
This interactive installation provides an immersive dive into the image space spanned by hundreds of thousands of photos taken across the Paris city area. Using machine learning techniques, the images are organized by similarity and image contents, allowing to visually explore niches and microgenres of image styles and contents.
Special emphasis is put on tight clusters of very similar images around a specific location: collective re-enactments of typical poses—same, same, but different.
To me, these very tight clusters of almost identical images became the most interesting aspect. How often can people take the same photos? At the same time, each of them is slightly different indeed, and the continuous re-enactment of rituals and re-discovery of photo ideas has a comforting charm to it as well.
Installation and Interaction
The projection spans three 1080p squares arranged in a slightly angled triptych structure, allowing an immersive dive into the image space.
Visitors can navigate the map using a touch device as well as a physical joystick. Manual annotations help with identification of the main map areas. The application goes to sleep and starts to dream of Paris after a while of inactivity.
The projected display seamlessly zooms from the cloudy overview map over a gridded version of the cloud to a full grid. This layering allows to understand the clustering and neighborhood structure well in the zoomed out view, while providing a tidy and efficient image display in zoomed views.
Content Selection and Data Processing Based on a sample of 6.2m geo-located social media photos posted in Paris in 2017, a custom selection of 25,000 photos was chosen and forms the basis for the map.
It consists of:
The images were analyzed using neural networks which were trained for image classification (from tensorflow with keras). I used feature vectors normally intended for classification to calculate pairwise similarities between the images. The map arrangement was calculated using t-SNE— an algorithm that finds an optimal 2D layout so that similar images are close together.
Bridging the cloudy overview and the griddy detail view was an interesting challenge. After a couple of failed approaches, here’s how I solved it:
Altogether, this strategy makes sure that as little pixels change between the different transitions, thus leading to a consistent and satisfying zoom experience.
As a final remark—it has been my intention not to measure the city, but to portray it, using social media contents as material. Rather than statistics, the project presents a stimulating arrangement of qualitative contents, open for exploration and to interpretation—consciously curated and pre-arranged, but not pre-interpreted.
At the same time, data was instrumental in arranging these contents in a human-digestible way. How else would one scan and assemble hundreds of thousands of images into a coherent whole?
So, one could say, data was used as a vehicle for the experience and design process, but neither as the object nor the end point of the visualization.
The interplay between automatic analysis, inspection of the results—what does the machine suggest and conclude—and my own actions (in terms of layout, content selection, parameter tweaking…) was inspiring to explore.
As a design hint, the use of handwriting for the map annotations hints at the involvement of me as an active author and a subjective sense-making process.
The final result emerged from a dialogue between me and the city, the image contents and the algorithms, which actually managed to surprise and inspire me throughout the project.
Comissioned by Fondation EDF, Paris on occasion of the exhibition 123 data
Multiplicity is part of a series of investigations of digital city images by Moritz Stefaner:
Stadtbilder investigates the digital layers of the city, beyond physical infrastructure.
Selfiecity takes a closer look at the selfie phenomenon, and among other things, aims to identify unique styles of self-photography in different cities.
On Broadway starts with a single street, and stacks all kinds of quantitative and qualitative information on top of each other.
Moritz Stefaner is a “Truth and Beauty Operator” on the crossroads of data visualization, information aesthetics and user interface design. With a background in Cognitive Science and Interface Design, his work balances analytical and aesthetic aspects in mapping abstract and complex phenomena, working with a wide range of clients.