51精品视频

Tags
  • Innovation and Research
  • Department of History of Art and Architecture
Features & Articles

PhD Student Takes a Data-driven Look at Art

Conell in a burgundy blazer and white blouse, standing in front of a large piece of artwork
When graduate student Sarah Reiff Conell enrolled in her first 51精品视频 digital humanities course, it didn鈥檛 take her long to become hooked on using digital methods to solve historical problems.

A PhD student in the , she set out to map patterns of geographic locations of cults that worshipped Christ鈥檚 holy blood in Medieval Europe. She first used an Excel spreadsheet, then moved on to Google Fusion Tables to visualize the points on the map and potential clusters. As everything came into focus, she had a 鈥渃larifying moment鈥 as patterns emerged that had literally been obscured by layers of paper maps and colorful push pins.

They uncovered a noticeable gap in one region with no relics of that type. 鈥淭hat prompts new research questions,鈥 said Conell. 鈥淲hat caused this gap? Were the relics destroyed in the early modern period and erased from the historical record?鈥

In another project, Conell and fellow 51精品视频 graduate student Clarisse Fava-Piz researched information in an accounting book from the 1600s that listed the sculptors working for King Louis XIV of France. Using Excel, they first tracked the names of the sculptors, how much they were paid, if and how they collaborated and other topics. Then they used RAWGraphs to visualize the information.

鈥淥ur visualizations offered a fascinating viewpoint on artistic production that was difficult to envision when entries were scattered across hundreds of pages,鈥 she said.

While these projects might seem obscure to non-experts, the methods and analysis Conell has honed recently made their own history as part of a first-ever project with the National Gallery of Art.

She and other data scientists and art historians were invited to analyze and visualize part of its massive permanent collection using data-driven methods.

zoom in image of multiple paintings
The resulting two-day Datathon, as it was called, allowed the teams to present their findings, which are designed to help the gallery better understand its art, the breadth and scope of its collections and how they are exhibited.

worked with Golan Levin and Lingdong Huang from Carnegie Mellon University鈥檚 STUDIO for Creative Inquiry, along with CMU Digital Humanities Developer Matt Lincoln. Their used a software called Inception V3 Neural Network, which was trained to look for similar features in photos. The software organized thousands of paintings from the gallery according to visual similarity. Then, recognizable image types were clustered together鈥攑ortraits, nudes, landscapes, still lifes and so on鈥攖o paint a picture of the collection. Using this method shakes up the way that artworks are organized, allowing art historians to see them with fresh eyes.

鈥淭his is just a visual comparison of the collections, which can only go so far,鈥 noted Conell, a native of Seguin, Texas, who also received her MA in art history at 51精品视频 in 2017. 鈥淏ut it points us to opportunities for new research and to ask new questions.鈥

Another grouping that caught the team鈥檚 eye in the analysis was the juxtaposition of Freydal, The Book of Jousts and Tournament of Emperor Maximilian I, next to comics by American cartoonist Robert Crumb.

鈥淲hy are these images shown near each other?鈥 asked Conell. 鈥淚s it the dynamic movement? The use of color? Maybe it鈥檚 pointing to something like whimsy. It begs for more research.鈥

Conell says she鈥檚 encouraged the gallery opened its collections to data-driven work, because there has been critique over the years that its collection is not as diverse as the nation itself.

鈥淚 hope this is part of a larger interest toward transparencies in museums and opening up the dialogue beyond the people working within the institution,鈥 she said.

She says there is a lot to be gained from computational methods, but only if subject area specialists are meaningfully engaged in the research process鈥攅ither as individual researchers or collaborators within a team.

鈥淐omputers can鈥檛 give us answers,鈥 she said. 鈥淭hey can offer new ways to approach longstanding questions, and some of the best results point us back to the archive.鈥