Multimodal models for neurological disorders
ETRIKR Method and apparatus for building a multimodal foundation model for predicting diverse neurological disorders
Curriculum Vitae
Education, appointments and professional activities.
- Appointments
- Education
- Publications
- Projects
- Technology transfer and deployment
- Patents
- Presentations
- Awards
- Teaching
- Peer review
- Other activities
Appointments
Aug 2021 – present
Senior Researcher, Electronics and Telecommunications Research Institute (ETRI)
Integrated Intelligence Research Section (Jan 2024 – present) · Cyber Brain Research Section (Aug 2021 – Dec 2023)
Mar 2019 – Jul 2021
Staff Engineer, Samsung Research, Samsung Electronics
Global AI Center, Big Data Team, Data Analytics Lab
Education
Mar 2012 – Feb 2019
Ph.D. in Physics, POSTECH (integrated M.S./Ph.D. program)
Statistical physics and complex systems. Advisors: Woo-Sung Jung, Hang-Hyun Jo
Thesis: Generative Model and Method for Correlated Bursty Dynamics
Mar 2007 – Feb 2012
B.S. in Physics, POSTECH
Mar 2005 – Feb 2007
Incheon Science High School
Graduated early after two years
Publications
9 peer-reviewed publications (2018 – 2025), 5 as first author, 3 of them also as corresponding author. Selected:
- Multimodal Alzheimer's disease recognition from image, text and audio
- Alzheimer's disease recognition using graph neural network by leveraging image-text similarity from vision language model
- Burst and Memory-aware Transformer: capturing temporal heterogeneity
Full list with summaries and key results →
Projects
Jan 2026 - present
Scientific representation learning
ETRI · Encoder and tokenizer development, model evaluation
Jan 2024 - Aug 2026
Speech and multimodal learning for cognitive assessment
ETRI · Cognitive modelling, field deployment and model integration
Aug 2021 - Dec 2023
Event-sequence learning and collaborative machine learning
ETRI · Temporal modelling, model development and analysis
Mar 2019 - Jul 2021
Industrial machine learning at Samsung Research
Samsung Electronics, Samsung Research (Global AI Center) · Staff Engineer
Descriptions, roles and outputs of each project →
Technology transfer and deployment
2026
Korean speech-based classification model for mild cognitive impairment (MCI) screening, ETRI
Transferred to two companies under two technology-transfer agreements. Primary developer of the classification model and lead contributor to its field deployment (2024 – 2026); contributed to the transfer.
2026
Digital-human cognitive assessment system, ETRI
Developed the user interface, real-time voice and session handling and server integration for the interactive assessment system; managed system operation during field deployment.
2025
Tablet app for MCI screening from speech, ETRI
Developed the speech-based MCI prediction engine behind the app and ran its field deployment. The app's user interface was developed separately.
Patents
Status as of September 2026. Within each section, entries are ordered by filing date, newest first (KR filing date for patent families; US filing date for additional co-inventor applications).
First-inventor patent families
Multimodal cognitive assessment
ETRIKR Method and apparatus for predicting degenerative brain function decline and cognitive impairment using a vision-language model and a graph neural network
US Method and apparatus for predicting degenerative brain function decline and cognitive impairment using vision language model and graph neural network
Event-cluster-based forecasting
ETRIKR Event-cluster-based time-series prediction apparatus and method of operating the same
Time-series pattern prediction
ETRIKR Apparatus for time-series pattern prediction and method of operating the same
US Time series pattern prediction device and method of operating the same
Constrained network generation
ETRIKR Apparatus and method for generating networks using complex network metrics
US Device and method for generating network using complex network properties
Advertising engagement prediction
Samsung ElectronicsKR Electronic apparatus and control method thereof
US Electronic apparatus and control method thereof
Additional U.S. applications as co-inventor
Tabular data generation
US Apparatus and method for reproducing tabular data
Adaptive feature selection
US Machine learning device using adaptive feature selection and method of operating the same
Presentations
International Conferences
Apr 2025
Intelligent System for Early Detection of Mild Cognitive Impairment and Dementia Risk Through Spoken Language Analysis
IEEE ICASSP 2025, Show & Tell · Byung Ok Kang, Byounghwa Lee, Jeong-Uk Bang, Hwa Jeon Song, Young Jin Park
Jun 2016
Analyzing the Urban Street Networks of Korea
NetSci 2016 · Byoung-Hwa Lee, Woo-Sung Jung
Nov 2014
Centrality in Urban Street Networks of Korea: From Classification to Model
International Conference on Social Modeling and Simulations & Econophysics Colloquium · Byoung-Hwa Lee, Woo-Sung Jung
Oct 2014
Complex Network Analysis of the Korean Transportation Network
15th Asia Pacific Industrial Engineering and Management Systems Conference (APIEMS) · Byoung-Hwa Lee, Inho Hong, Woo-Sung Jung
Sep 2014
Statistical Properties of the Korean Transportation Network as a Complex Network
European Conference on Complex Systems (ECCS) '14 · Byoung-Hwa Lee, Inho Hong, Woo-Sung Jung, Okyu Kwon
Jul 2013
Prediction of Congestion Sites in Pohang
Econophysics Colloquium 2013 & Asia Pacific Econophysics Conference 2013 · Byoung-Hwa Lee, Woo-Sung Jung
International Workshops
Dec 2016
Complex Network Analysis of the Urban Street Structure of Korean Cities
APCTP 2016 Workshop on Frontiers of Physics: Push the Envelope of Statistical Physics · Byoung-Hwa Lee, Woo-Sung Jung
Feb 2016
Industrial Dynamics in Urban Areas
Application of Econophysics and Social Physics: Winter Workshop · Inho Hong, Byoung-Hwa Lee, Hang-Hyun Jo, Woo-Sung Jung, Hyejin Youn
Nov 2015
Classification of the Street Patterns by Using Centrality Analysis
Physics of Social Complexity · Byoung-Hwa Lee, Woo-Sung Jung
Jul 2013
Roads Network in Pohang
5th International Symposium on IT Convergence Engineering · Byoung-Hwa Lee
Domestic Conferences
Apr 2018
Hierarchical Modeling for Correlated Bursty Dynamics
2018 Korean Physical Society Spring Meeting · Byoung-Hwa Lee, Hang-Hyun Jo
Aug 2017
Hierarchical Model for Correlated Bursty Dynamics
19th Workshop for Statistical Physics · Byoung-Hwa Lee, Hang-Hyun Jo
Apr 2015
Complex Network Analysis of the Korean Urban Street Structure
2015 Korean Physical Society Spring Meeting · Byoung-Hwa Lee, Woo-Sung Jung
Oct 2014
Centrality Analysis in Street Networks of Korea: From Classification to Model
2014 Korean Physical Society Fall Meeting · Byoung-Hwa Lee, Woo-Sung Jung
Aug 2014
Centrality Analysis in the Korean Street Networks: From Classification to Model
Application of Econophysics and Social Physics: Summer Workshop · Byoung-Hwa Lee, Woo-Sung Jung
Nov 2013
Analysis of Road Networks Using Complex Network: Predicting Traffic Congestion Areas in Pohang and Changwon via Betweenness Centrality
8th Conference on Complexity (in Korean) · Byoung-Hwa Lee, Woo-Sung Jung
Nov 2013
Investigation of Road Networks in Two Korean Cities: Pohang and Changwon
17th Workshop for Statistical Physics · Byoung-Hwa Lee, Woo-Sung Jung
Oct 2013
Investigation of Road Networks in Two Korean Cities: Pohang and Changwon
2013 Korean Physical Society Fall Meeting · Byoung-Hwa Lee, Woo-Sung Jung
Awards
2025
IEEE Access Exceptional Reviewer
Teaching
Spring 2012
General Physics I
Teaching Assistant, POSTECH
Fall 2012
General Physics II
Teaching Assistant, POSTECH
Spring 2013
Statistical Mechanics
Teaching Assistant, POSTECH
Selected peer review
2025
Journal of Big Data
2025
The Journal of Supercomputing
2025
Nonlinear Dynamics
2025
Multimedia Systems
2025, 2026
Wireless Networks
2025
Scientific Reports
2026
Journal of King Saud University - Computer and Information Sciences
2025
IEEE Access
Other activities
2025
Contributor, DementiaBank Korean Kang Corpus (DOI 10.21415/PJVS-9X49).
Feb 2015
Short research visit, Aalto University, Finland.