Designing Responsible AI: Adaptations of UX Practice to Meet Responsible AI Challenges
Qiaosi Wang,Michael Madaio,Shaun K. Kane,Shivani Kapania,Michael Terry,Lauren Wilcox +5 more
- 19 Apr 2023
TL;DR: In this paper , the authors conducted an interview study with industrial UX practitioners and subject matter experts, both of whom are actively involved in addressing RAI concerns throughout the early design and development of new AI-based prototypes, demos, and products, at a large technology company.
read more
Abstract: Technology companies continue to invest in efforts to incorporate responsibility in their Artificial Intelligence (AI) advancements, while efforts to audit and regulate AI systems expand. This shift towards Responsible AI (RAI) in the tech industry necessitates new practices and adaptations to roles—undertaken by a variety of practitioners in more or less formal positions, many of whom focus on the user-centered aspects of AI. To better understand practices at the intersection of user experience (UX) and RAI, we conducted an interview study with industrial UX practitioners and RAI subject matter experts, both of whom are actively involved in addressing RAI concerns throughout the early design and development of new AI-based prototypes, demos, and products, at a large technology company. Many of the specific practices and their associated challenges have yet to be surfaced in the literature, and distilling them offers a critical view into how practitioners’ roles are adapting to meet present-day RAI challenges. We present and discuss three emerging practices in which RAI is being enacted and reified in UX practitioners’ everyday work. We conclude by arguing that the emerging practices, goals, and types of expertise that surfaced in our study point to an evolution in praxis, with associated challenges that suggest important areas for further research in HCI.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Design Principles for Generative AI Applications
Justin D. Weisz,Jessica He,Michael Muller,Gabriela Hoefer,Rachel Miles,Werner Geyer +5 more
- 25 Jan 2024
TL;DR: Six principles for the design of generative AI applications are presented that address unique characteristics of generative AI UX and offer new interpretations and extensions of known issues in the design of AI applications.
Creating Design Resources to Scaffold the Ideation of AI Concepts
Nur Yildirim,Chang Yoon Oh,Deniz Sayar,Violet Turri,Jodi Forlizzi,James McCann,John Zimmerman +6 more
- 10 Jul 2023
TL;DR: In this paper , the authors developed a design resource capturing AI capabilities based on 40 AI features commonly used across various domains and incorporated capabilities into their own design process to brainstorm concepts with domain experts and data scientists.
35
Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology
Nur Yildirim,Hannah Richardson,M. Wetscherek,Junaid Bajwa,Joseph Jacob,Mark A. Pinnock,Stephen Harris,Daniel C. Castro,Shruthi Bannur,Stephanie L. Hyland,Pratik Ghosh,Mercy Prasanna Ranjit,Kenza Bouzid,Anton Schwaighofer,Fernando P'erez-Garc'ia,Harshita Sharma,Ozan Oktay,M. Lungren,Javier Alvarez-Valle,Aditya Nori,Anja Thieme +20 more
- 22 Feb 2024
TL;DR: This work engaged in an iterative, multidisciplinary design process to envision clinically relevant VLM interactions, and co-designed four VLM use concepts: Draft Report Generation, Augmented Report Review, Visual Search and Querying, and Patient Imaging History Highlights.
26
Farsight: Fostering Responsible AI Awareness During AI Application Prototyping
Zijie J. Wang,Chinmay Kulkarni,Lauren Wilcox,Michael Terry,Michael Madaio +4 more
- 23 Feb 2024
TL;DR: After using Farsight, AI prototypers in the authors' user study are better able to independently identify potential harms associated with a prompt and find the tool more useful and usable than existing resources.
16
Charting the Future of AI in Project-Based Learning: A Co-Design Exploration with Students
Chengbo Zheng,Kangyu Yuan,Bingcan Guo,Reza Hadi Mogavi,Zhenhui Peng,Shuai Ma,Xiaojuan Ma +6 more
TL;DR: A co-design study to explore the potential of students' AI usage data as a novel material for PBL assessment and found students with different attitudes toward AI exhibited distinct preferences in how to analyze and understand the use of AI.
13
References
Using thematic analysis in psychology
Virginia Braun,Victoria Clarke +1 more
TL;DR: Thematic analysis is a poorly demarcated, rarely acknowledged, yet widely used qualitative analytic method within psychology as mentioned in this paper, and it offers an accessible and theoretically flexible approach to analysing qualitative data.
145.8K
•Proceedings Article
Language Models are Few-Shot Learners
Tom B. Brown,Benjamin Mann,Nick Ryder,Melanie Subbiah,Jared Kaplan,Prafulla Dhariwal,Arvind Neelakantan,Pranav Shyam,Girish Sastry,Amanda Askell,Sandhini Agarwal,Ariel Herbert-Voss,Gretchen Krueger,Thomas Henighan,Rewon Child,Aditya Ramesh,Daniel M. Ziegler,Jeffrey Wu,Clemens Winter,Christopher Hesse,Mark Chen,Eric Sigler,Mateusz Litwin,Scott Gray,Benjamin Chess,Jack Clark,Christopher Berner,Samuel McCandlish,Alec Radford,Ilya Sutskever,Dario Amodei +30 more
- 28 May 2020
TL;DR: GPT-3 achieves strong performance on many NLP datasets, including translation, question-answering, and cloze tasks, as well as several tasks that require on-the-fly reasoning or domain adaptation, such as unscrambling words, using a novel word in a sentence, or performing 3-digit arithmetic.
Reflecting on reflexive thematic analysis
Virginia Braun,Victoria Clarke +1 more
TL;DR: Since initially writing on thematic analysis in 2006, the popularity of the method as mentioned in this paper has exploded, the variety of TA approaches have expanded, and, not least, our thinking has developed a...
10.1K
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Emily M. Bender,Timnit Gebru,Angelina McMillan-Major,Shmargaret Shmitchell +3 more
- 03 Mar 2021
TL;DR: The authors take a step back and ask: How big is too big? What are the possible risks associated with this technology and what paths are available for mitigating those risks? They provide recommendations including weighing the environmental and financial costs first, investing resources into curating and carefully documenting datasets rather than ingesting everything on the web, carrying out pre-development exercises evaluating how the planned approach fits into research and development goals and supports stakeholder values, and encouraging research directions beyond ever larger language models.
4.3K
•Proceedings Article
Zero-Shot Text-to-Image Generation
Aditya Ramesh,Mikhail Pavlov,Gabriel Goh,Scott Gray,Chelsea Voss,Alec Radford,Mark Chen,Ilya Sutskever +7 more
- 18 Jul 2021
TL;DR: This work describes a simple approach based on a transformer that autoregressively models the text and image tokens as a single stream of data that is competitive with previous domain-specific models when evaluated in a zero-shot fashion.