From 6918822c074403bde7d5117f1124124f00c4f068 Mon Sep 17 00:00:00 2001 From: shljessie Date: Wed, 8 Jan 2025 14:08:37 -0800 Subject: [PATCH 1/4] A0-Adding Seonghee Lee (shl1027) ReadMe File --- README-shl1027.md | 56 +++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 56 insertions(+) create mode 100644 README-shl1027.md diff --git a/README-shl1027.md b/README-shl1027.md new file mode 100644 index 0000000..7981a63 --- /dev/null +++ b/README-shl1027.md @@ -0,0 +1,56 @@ +# Seonghee Lee + +## Introduction +I am Seonghee Lee, a second-year Master's student in Computer Science at Stanford University, graduating in June 2025. My research lies at the intersection of Artificial Intelligence (AI), Human-Computer Interaction (HCI), and Accessibility. I specialize in designing innovative AI-integrated solutions that push the boundaries of interaction and accessibility technologies. + +## Technical Expertise +- **Programming Languages:** Python, Java, JavaScript, C++, HTML/CSS +- **Frameworks and Tools:** PyTorch, TensorFlow, React, Node.js, Express, Docker, Git, OpenCV, Hugging Face Transformers +- **Domains:** + - Machine Learning and Deep Learning + - Vision and Natural Language Processing (NLP) Models + - Accessibility-focused HCI Prototyping + - Full-Stack Software Development + +## Awards and Achievements +- **ACM/IEEE CHI 2024 Honorable Mention:** For the project 'Teach AI How to Code,' which developed an educational platform to assist users in learning programming through generative AI models. +- **ASSETS 2024:** Presented the award-winning paper, 'AltCanvas: A Tile-Based Image Editor with Generative AI for Blind or Visually Impaired People,' which received critical acclaim for advancing accessibility in image editing. +- **Conference Publications:** + - "AltCanvas: Enhancing Visual Accessibility through Generative AI," published in ACM ASSETS 2024. + - "Integrating Multimodal Agents in Shared Spaces: Challenges and Solutions," under review for ACM CHI 2025. + - "StyleAligned: AI-Driven Generation of Tactile Graphics for Accessibility," presented at IEEE CVPR 2024 Workshop on AI for Accessibility. + +## Research and Projects +- **AltCanvas:** + - Designed and developed a novel tile-based image editor leveraging Stable Diffusion for generating accessible tactile graphics for Blind or Visually Impaired (BVI) individuals. + - Conducted three-stage user studies to iteratively refine the system and ensure usability. + +- **IRL Ditto:** + - Led the integration of AI agents in open office spaces by combining computer vision, speech processing, and generative conversational models. + - Developed logic frameworks for proxemic interactions and real-time engagement tracking. + +- **StyleAligned:** + - Researched and implemented AI-based tactile pattern generation for accessibility. + - Developed algorithms to ensure controlled placement of tactile patterns, balancing usability and aesthetics. + +## Experience +- **Microsoft Research:** + - Interned in the Human-Computer AI Experiences (HCAIX) group, working on multimodal conversational agents and their applications in shared spaces. + - Published findings on integrating agents with human-centered design principles. + +- **Stanford NLP and HCI Group:** + - AI Research Assistant under Professor Diyi Yang and Professor Hari Subramonyam focusing on fine-tuning large language models and building task-specific interactive AI agents. + +- **Cochl.AI:** + - Developed cutting-edge prototypes for AI-integrated audio systems in Mercedes Benz Cars, contributing to advancements in real-time audio analysis and enhancement. + +## Hobbies and Interests +- Cooking and Interior Design + +## Links +- [GitHub Profile](https://github.com/shljessie) +- [Portfolio](https://shljessie.github.io/) +- [LinkedIn](https://www.linkedin.com/in/seonghee-lee/) + +## Contact +- Email: shlee@cs.stanford.edu From bb792855b117ee55a44cef54d37798366bac2b4c Mon Sep 17 00:00:00 2001 From: shljessie Date: Wed, 8 Jan 2025 14:19:25 -0800 Subject: [PATCH 2/4] update changes to readme --- README-shl1027.md | 104 ++++++++++++++++++++++++---------------------- 1 file changed, 54 insertions(+), 50 deletions(-) diff --git a/README-shl1027.md b/README-shl1027.md index 7981a63..3525c51 100644 --- a/README-shl1027.md +++ b/README-shl1027.md @@ -1,56 +1,60 @@ # Seonghee Lee -## Introduction -I am Seonghee Lee, a second-year Master's student in Computer Science at Stanford University, graduating in June 2025. My research lies at the intersection of Artificial Intelligence (AI), Human-Computer Interaction (HCI), and Accessibility. I specialize in designing innovative AI-integrated solutions that push the boundaries of interaction and accessibility technologies. - -## Technical Expertise -- **Programming Languages:** Python, Java, JavaScript, C++, HTML/CSS -- **Frameworks and Tools:** PyTorch, TensorFlow, React, Node.js, Express, Docker, Git, OpenCV, Hugging Face Transformers -- **Domains:** - - Machine Learning and Deep Learning - - Vision and Natural Language Processing (NLP) Models - - Accessibility-focused HCI Prototyping - - Full-Stack Software Development - -## Awards and Achievements -- **ACM/IEEE CHI 2024 Honorable Mention:** For the project 'Teach AI How to Code,' which developed an educational platform to assist users in learning programming through generative AI models. -- **ASSETS 2024:** Presented the award-winning paper, 'AltCanvas: A Tile-Based Image Editor with Generative AI for Blind or Visually Impaired People,' which received critical acclaim for advancing accessibility in image editing. -- **Conference Publications:** - - "AltCanvas: Enhancing Visual Accessibility through Generative AI," published in ACM ASSETS 2024. - - "Integrating Multimodal Agents in Shared Spaces: Challenges and Solutions," under review for ACM CHI 2025. - - "StyleAligned: AI-Driven Generation of Tactile Graphics for Accessibility," presented at IEEE CVPR 2024 Workshop on AI for Accessibility. - -## Research and Projects -- **AltCanvas:** - - Designed and developed a novel tile-based image editor leveraging Stable Diffusion for generating accessible tactile graphics for Blind or Visually Impaired (BVI) individuals. - - Conducted three-stage user studies to iteratively refine the system and ensure usability. - -- **IRL Ditto:** - - Led the integration of AI agents in open office spaces by combining computer vision, speech processing, and generative conversational models. - - Developed logic frameworks for proxemic interactions and real-time engagement tracking. - -- **StyleAligned:** - - Researched and implemented AI-based tactile pattern generation for accessibility. - - Developed algorithms to ensure controlled placement of tactile patterns, balancing usability and aesthetics. - -## Experience -- **Microsoft Research:** - - Interned in the Human-Computer AI Experiences (HCAIX) group, working on multimodal conversational agents and their applications in shared spaces. - - Published findings on integrating agents with human-centered design principles. - -- **Stanford NLP and HCI Group:** - - AI Research Assistant under Professor Diyi Yang and Professor Hari Subramonyam focusing on fine-tuning large language models and building task-specific interactive AI agents. - -- **Cochl.AI:** - - Developed cutting-edge prototypes for AI-integrated audio systems in Mercedes Benz Cars, contributing to advancements in real-time audio analysis and enhancement. - -## Hobbies and Interests -- Cooking and Interior Design +## Education +- **Stanford University** + - Master of Science in Computer Science (Focus: AI and HCI), Expected June 2025 + +## Technical Skills +- **Programming Languages:** Python, JavaScript(React, Typescript, NodeJS), C, C#, C++, HTML/CSS +- **Frameworks and Tools:** PyTorch, TensorFlow, React, Node.js, Docker, Git, OpenCV, Hugging Face Transformers +- **Domains:** Machine Learning, Deep Learning, NLP, Vision, Full-Stack Development + +## Awards and Honors +- **ACM/IEEE CHI 2024 Honorable Mention** + - 'Teach AI How to Code' project recognized for its impact in education and generative AI. +- **ASSETS 2024 Best Paper Award** + - "AltCanvas: A Tile-Based Image Editor with Generative AI for Blind or Visually Impaired People." +- **IEEE CVPR 2024 Workshop Presentation** + - Presented "StyleAligned: AI-Driven Generation of Tactile Graphics for Accessibility." + +## Professional Experience + +### Incoming AI Engineer @NVIDIA +### Microsoft Research | AI Research Intern | HCAIX Group +- Led development of multimodal conversational agents situated in an open space - Published Paper + +### Stanford NLP Group | AI Research Assistant +- Fine-tuned large language models for task-specific applications. +- Developed interactive AI prototypes focused on accessibility. + +### Cochl.AI | AI Software Engineer Intern +- Designed and deployed audio-based AI prototypes for real-time analysis and enhancement. + +## Research Projects +### AltCanvas +- Designed a tile-based image editor integrating Stable Diffusion for generating accessible tactile graphics. +- Conducted three-stage user studies to refine usability and effectiveness for Blind or Visually Impaired (BVI) users. + +### IRL Ditto +- Created AI agents for open office spaces using computer vision, speech processing, and generative conversational models. +- Implemented proxemic interaction logic for real-time engagement. + +### StyleAligned +- Controlled Image Generation (stable diffusion) and Image Evaluation (segmentation) +- Researched AI-driven tactile pattern evaluation ensuring controlled placement for accessibility. +- Developed algorithms balancing usability and aesthetic constraints in tactile graphics. +## Publications +- "AltCanvas: Enhancing Visual Accessibility through Generative AI," ACM ASSETS 2024. +- "Integrating Multimodal Agents in Shared Spaces: Challenges and Solutions," under review for ACM CHI 2025. +- "StyleAligned: AI-Driven Generation of Tactile Graphics for Accessibility," IEEE CVPR 2024 Workshop. + +## Hobbies +- Cooking! : @shl_eats ## Links -- [GitHub Profile](https://github.com/shljessie) -- [Portfolio](https://shljessie.github.io/) -- [LinkedIn](https://www.linkedin.com/in/seonghee-lee/) +- **GitHub:** [github.com/shljessie](https://github.com/shljessie) +- **Portfolio:** [shljessie.github.io](https://shljessie.github.io/) +- **LinkedIn:** [linkedin.com/in/seonghee-lee/](https://www.linkedin.com/in/seonghee-lee/) ## Contact -- Email: shlee@cs.stanford.edu +- **Email:** shlee@cs.stanford.edu From 085351ff9788f525d2eaf5e641d88b434758b12a Mon Sep 17 00:00:00 2001 From: shljessie Date: Wed, 8 Jan 2025 14:21:24 -0800 Subject: [PATCH 3/4] publication fix --- README-shl1027.md | 16 ++++++---------- 1 file changed, 6 insertions(+), 10 deletions(-) diff --git a/README-shl1027.md b/README-shl1027.md index 3525c51..80b9b13 100644 --- a/README-shl1027.md +++ b/README-shl1027.md @@ -9,14 +9,6 @@ - **Frameworks and Tools:** PyTorch, TensorFlow, React, Node.js, Docker, Git, OpenCV, Hugging Face Transformers - **Domains:** Machine Learning, Deep Learning, NLP, Vision, Full-Stack Development -## Awards and Honors -- **ACM/IEEE CHI 2024 Honorable Mention** - - 'Teach AI How to Code' project recognized for its impact in education and generative AI. -- **ASSETS 2024 Best Paper Award** - - "AltCanvas: A Tile-Based Image Editor with Generative AI for Blind or Visually Impaired People." -- **IEEE CVPR 2024 Workshop Presentation** - - Presented "StyleAligned: AI-Driven Generation of Tactile Graphics for Accessibility." - ## Professional Experience ### Incoming AI Engineer @NVIDIA @@ -46,8 +38,12 @@ ## Publications - "AltCanvas: Enhancing Visual Accessibility through Generative AI," ACM ASSETS 2024. - "Integrating Multimodal Agents in Shared Spaces: Challenges and Solutions," under review for ACM CHI 2025. -- "StyleAligned: AI-Driven Generation of Tactile Graphics for Accessibility," IEEE CVPR 2024 Workshop. - +- "StyleAligned: AI-Driven Generation of Tactile Graphics for Accessibility," +- "IRL Dittos: Embodied Multimodal Agents in Open Spaces" +- **ACM/IEEE CHI 2024 Honorable Mention** + - 'Teach AI How to Code' project recognized for its impact in education and generative AI. +- **ASSETS 2024** + - "AltCanvas: A Tile-Based Image Editor with Generative AI for Blind or Visually Impaired People." ## Hobbies - Cooking! : @shl_eats From ffca912e5917dd79e64669984806f24a7770c50f Mon Sep 17 00:00:00 2001 From: shljessie Date: Wed, 8 Jan 2025 14:22:27 -0800 Subject: [PATCH 4/4] project description add --- README-shl1027.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README-shl1027.md b/README-shl1027.md index 80b9b13..11b89d9 100644 --- a/README-shl1027.md +++ b/README-shl1027.md @@ -23,11 +23,11 @@ - Designed and deployed audio-based AI prototypes for real-time analysis and enhancement. ## Research Projects -### AltCanvas +### AltCanvas - Web Based Image Editor for Blind and Visually Impaired Users - Designed a tile-based image editor integrating Stable Diffusion for generating accessible tactile graphics. - Conducted three-stage user studies to refine usability and effectiveness for Blind or Visually Impaired (BVI) users. -### IRL Ditto +### Microsoft Research- Multimodal Agents - Created AI agents for open office spaces using computer vision, speech processing, and generative conversational models. - Implemented proxemic interaction logic for real-time engagement.