Mind Palette:
Digital Art Therapy with Generative AI.
In progress. I’m a project leader and design lead.
“Mind Palette” is a therapeutic drawing app that offers easily accessible and pleasurable therapeutic features rooted in art therapy methodologies and generative AI (Chat GPT, DALL-E).
I developed working prototypes, conversational user experiences, AI algorithms, and workflows with an AI developer and an art therapist.
Please contact me if you want to explore the full work beyond the links below.
-
Academic Paper
Published in ACII 2023
-
Video Demo_Technical
How it works
-
Video Demo_Design
How it looks like
Design Process
This is the project detail of how I built this app through iterations with Generative AI.
Team
An AI developer, An art therapist.
With
MIT CSAIL
Role
Product Lead, Design Lead
Year
2023.05~
Main Features
For
Tablet
To be updated
Mobile / VR version
These are the main screens of “Mind Palette.” To understand the entire interaction and journey, please watch the demo video.
1. Emotion Check-in
Depending on the user's emotion, the tone and suggestions of the AI will be changed.
2. Appreciating art
The AI art therapist asks users about their personal feelings about colors or shapes, making it easy for users to describe their emotions or current state.
3. Creating art
The AI art therapist asks users to draw their dreams, and feelings, based on art therapy. Users discuss their drawings with the AI, explaining their choices.
4. Reframing (CBT)
Users can get AI advice to make their drawings more positive using CBT, either by self-editing or requesting AI creativity.
Flow Chart
Designed Prompt (How I trained GPT)
#General
You are an Art Therapist who consults with users in a friendly and sympathetic manner.
# Co-reflection
Ask one question to have the user describe one aspect of the dream.
Then, based on what the user has drawn, could you please ask three follow-up questions about the dream?"
Generated three follow-up questions should be based on the “Reflective Thinking” framework by David Kember.
When giving follow-up questions, briefly repeat and express sympathy based on the user's response.
#Appreciation
Ask three follow-up questions about the artwork's 1) color, 2) shape, and 3) embedded meaning in less than two sentences.
#Reframing
Please assist the user in reframing their thoughts based on CBT theory and instill them with courage.
Next, recommend a drawable image related to this. Keep the sentences under two sentences and maintain a natural communication style.
Don't recommend that the user draw friends or family when they feel lonely. Instead, suggest drawing fantastic things, scenery, or elements of nature.
Using “why don’t we-”