Audiovisual (AV) archives are invaluable for holistically preserving the past. Unlike other forms, AV archives can be difficult to explore. This is not only because of its complex modality and sheer volume but also the lack of appropriate interfaces beyond keyword search. The recent rise in text-to-video retrieval tasks in computer science opens the gate to accessing AV content more naturally and semantically, able to map natural language descriptive sentences to matching videos. However, applications of this model are rarely seen. The contribution of this work is threefold. First, working with RTS (Télévision Suisse Romande), we identified the key blockers in a real archive for implementing such models. We built a functioning pipeline for encoding raw archive videos to the text-to-video feature vectors. Second, we designed and verified a method to encode and retrieve videos using emotionally abundant descriptions not supported in the original model. Third, we proposed an initial prototype for immersive and interactive exploration of AV archives in a latent space based on the previously mentioned encoding of videos. 

Latent Wander: an Alternative Interface for Interactive and Serendipitous Discovery of Large AV Archives

We propose a half-day workshop at IEEE VIS 2023 on the topic of communication and collaboration around data. Speciﬁcally, we aim to gather researchers interested on multimodal, synchronous, and remote or hybrid forms of communication and collaboration within organizational and educational settings. This topic lies at the intersection of data visualization, human-computer interaction

A Workshop on New Multimodal Experiences for Remote Communication and Collaboration Around Data

Abstract The use of digital museum objects has become an essential part of museums' communication and marketing strategies, research and teaching, and curatorial practices. This new visibility, amplified by the COVID‐19 crisis, has not only revealed the possibilities of digital museum objects but has also underscored significant challenges, including the intricate relationship between digital museum objects and physical objects, the impact of digital museum objects on knowledge creation, and the online interaction with art and cultural heritage. Furthermore, it has drawn attention to the digital platforms that host digital museum objects, ranging from museum collection databases to online encyclopedias, cultural heritage platforms, and social media. The present paper explores these issues by examining how digital platforms are changing the way digital reproductions of artworks are used and reimagined, both inside and outside the institutions that house the artworks. To illuminate these dynamics, it looks at specific case studies, including the Getty Challenge, the online circulation of Delacroix's La liberté guidant le peuple , and the collection databases of Belgian museums and of the Mauritshuis. Theoretically, it combines the art historical concept of circulation with the notion of gray and colored memory drawn from digital memory studies. In doing so, it conceives of museum databases and cultural heritage platforms, as spaces of participation and neglect, of memory and oblivion, with a vast potential for producing new perspectives on art and cultural heritage and telling new (art) histories. In conclusion, the paper advocates for “circulation” as a key concept for revitalizing online collections of digital reproductions of artworks. 

Art in circulation: Creating content and context for digital reproduction of artworks

This research paper compared the use of advanced technology like AI in modern art museums with the traditional art museums. It focused on the display of art forms that help create a more immersive experience for visitors by engaging the five senses with the help of sensory factors such as sound effects, visual stimuli, haptic design, and tactile forms. In the digital age, it is essential to enhance spaces using growing AI technology to accommodate emerging art forms. In India where culture is rich and timeless, it is imperative we welcome new changes to the perceptions of art. A comparative analytic table has been prepared by using associated keywords to find research papers from various sources (Google Scholar, Springer, Research Gate). Furthermore, national and international case studies were explored, and a thorough analysis of the space and usage of AI technology was conducted. After collecting the secondary data, the primary data was collected using the interview method through digital forms. The collected information through both online and offline methods underwent a comparative analysis, from which a conclusion was derived. As such, this paper proposes how art museums can be further developed and designed using AI technology and multi-sensory features to increase visitor engagement and understanding, by creating a space that can accommodate all art forms in the Indian context. It thereby discourages prejudices against introducing AI into artistic and cultural spaces. Keywords: visitor experience, AI technology, interactive spaces, art museum, sensory factors 

AI Implementation in Art Museums Through Sensory Design

Augmented data storytelling enhances narrative delivery by integrating visualizations with physical environments and presenter actions. Existing systems predominantly rely on body gestures or speech to control visualizations, leaving interactions with physical objects largely underexplored. We introduce augmented physical data storytelling, an approach enabling presenters to manipulate visualizations through physical object interactions. To inform this approach, we first conducted a survey of data-driven presentations to identify common visualization commands. We then conducted workshops with nine HCI/VIS researchers to collect mappings between physical manipulations and these commands. Guided by these insights, we developed InSituTale, a prototype that combines object tracking via a depth camera with Vision-LLM for detecting real-world events. Through physical manipulations, presenters can dynamically execute various visualization commands, delivering cohesive data storytelling experiences that blend physical and digital elements. A user study with 12 participants demonstrated that InSituTale enables intuitive interactions, offers high utility, and facilitates an engaging presentation experience.

pdf/insitutale-enhancing-augmented-data-storytelling-with-xrxwgvoa3bab.pdf

InSituTale: Enhancing Augmented Data Storytelling with Physical Objects


 Surprise Machines is a project of experimental museology that
 sets out to visualize the entire image collection of the Harvard Art Museums,
 with a view to opening up unexpected vistas on more than 200,000 objects usually
 inaccessible to visitors. The project is part of the exhibition organized by
 metaLAB (at) Harvard entitled Curatorial A(i)gents and explores the limits of
 artificial intelligence to display a large set of images and create surprise
 among visitors. To achieve this feeling of surprise, a choreographic interface
 was designed to connect the audience’s movement with several unique views of the
 collection.

Surprise machines

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

metaLAB

Author Tools

Chat about Author

Papers

Surprise machines