This paper presents a transformer-based machine learning model that aligns gaze trajectory with corresponding text and decodes the probability of unknown words within the text in real time with high precision. 
FlowRing enables both quick, discreet in-air microgestures (left) and precise on-surface interactions (right), allowing for always-available, ad-hoc interactions. Such a peripheral could control wearable devices quickly like changing earbud volume while on-the-go or be used to control an immersive desktop environment in a mixed reality headset.
FaceOri tracks user’s face orientation towards the device with acoustic ranging using microphones in an earphone. 
AcousLink enables ad-hoc calibration-free unltrasonic ranging via bluetooth. 
Our method locates the content the user is reading in real-time through gaze, and inputs the gaze data and text data to the transform-based model to detect unknown words. 
The Smart Frisbee project aims to address the limitations of traditional Ultimate Frisbee games by utilizing Bluetooth and IMU sensors in a smart frisbee and wristbands to collect and analyze data on throws, catches, and player performance. This data will be used to provide automated tracking, feedback, and analysis capabilities, enabling players to identify areas for improvement and enhance their gameplay experience.
Published in CHI, 2022
Recommended citation: Yuntao Wang*, Jiexin Ding*, Ishan Chatterjee, Farshid Salemi Parizi, Yuzhou Zhuang, Yukang Yan, Shwetak Patel, and Yuanchun Shi. 2022. FaceOri: Tracking Head Position and Orientation Using Ultrasonic Ranging on Earphones. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI 22). http://djx06.github.io/files/paper1_faceori.pdf
Published in CHI, 2023
Recommended citation: Jiexin Ding, Bowen Zhao, Yuqi Huang, Yuntao Wang, and Yuanchun Shi. 2023. GazeReader: Detecting Unknown Word Using Webcam for English as a Second Language (ESL) Learners. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA 23). http://djx06.github.io/files/paper2_gazereader.pdf
Published in UIST, 2023
Recommended citation: Anandghan Waghmare, Jiexin Ding, Ishan Chatterjee, and Shwetak Patel. 2023. Demo of Z-Ring: Context-Aware Subtle Input Using Single-Point Bio-Impedance Sensing. In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST 23 Adjunct). Association for Computing Machinery, New York, NY, USA, Article 79, 1–3. http://djx06.github.io/files/paper4_ZRingDemo.pdf
Published in UIST, 2024
Recommended citation: Jiexin Ding, Ishan Chatterjee, Alexander Ching, Anandghan Waghmare, and Shwetak Patel. 2024. Demo of FlowRing: Seamless Cross-Surface Interaction via Opto-Acoustic Ring. In Adjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST Adjunct 24). Association for Computing Machinery, New York, NY, USA, Article 40, 1–3. http://djx06.github.io/files/paper5_FlowRingDemo.pdf
Published in CHI, 2025
Recommended citation: Jiexin Ding, Bowen Zhao, Yuntao Wang, Xinyun Liu, Rui Hao, Ishan Chatterjee, and Yuanchun Shi. 2025. Unknown Word Detection for English as a Second Language (ESL) Learners using Gaze and Pre-trained Language Models. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI 25). https://dl.acm.org/doi/full/10.1145/3706598.3714181
Published in MobileHCI, 2025
Recommended citation: Ishan Chatterjee*, Jiexin Ding*, Anandghan Waghmare*, Joseph Breda, Yuquan Deng, Bo Liu, Yuntao Wang, and Shwetak Patel. 2025. FlowRing: Integrated Microgesture and Surface Interaction Ring for Versatile XR Input. Proc. ACM Hum.-Comput. Interact. 9, 5, Article MHCI010 (September 2025), 28 pages. https://dl.acm.org/doi/full/10.1145/3743706
Published in hotMobile, 2026
Recommended citation: Jiexin Ding, Yizhuo Zhang, Xinyun Liu, Ke Chen, Yuntao Wang, Shwetak Patel, and Akshay Gadre. 2026. GazeSummary: Exploring Gaze as an Implicit Prompt for Personalization in Text-based LLM Tasks. In The 27th International Workshop on Mobile Computing Systems and Applications (HotMobile 26), February 25–26, 2026, Atlanta, GA, USA. ACM, New York, NY, USA, 9 pages. https://arxiv.org/abs/2601.17676
Published:
This is a description of your talk, which is a markdown files that can be all markdown-ified like any other post. Yay markdown!
Published:
This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.
Undergraduate course, University 1, Department, 2014
This is a description of a teaching experience. You can use markdown like any other post.
Workshop, University 1, Department, 2015
This is a description of a teaching experience. You can use markdown like any other post.
