Ethical and Inclusive Design of AI Care Agents for People with Disabilities

Vivi Meilinda; Umi Narimawati; Thomas Sumarsan Goh; Irene Apriani Widjaya; Kamal Arif Al-Farouqi

Authors

Vivi Meilinda Muhammadiyah Kuningan College of Health Sciences https://orcid.org/0000-0002-8223-6644
Umi Narimawati Indonesia Computer University https://orcid.org/0000-0001-8160-6263
Thomas Sumarsan Goh Methodist University of Indonesia https://orcid.org/0000-0002-3389-8107
Irene Apriani Widjaya Alfabet Inkubator Group https://orcid.org/0009-0000-1723-8144
Kamal Arif Al-Farouqi Eduaward Incorporation https://orcid.org/0009-0007-4074-3545

Keywords:

Ethical Artificial Intelligence, Inclusive Design, AI Care Agents, Humanistic Well-Being, Disabilities

Abstract

The increasing use of Artificial Intelligence (AI) in care services offers significant potential to improve the quality of life for people with disabilities, while also raising important ethical and inclusivity concerns. This study examines the ethical and inclusive design of AI care agents, emphasizing human-centered principles that support autonomy, dignity, and emotional well-being. This study employs a quantitative research approach using a cross-sectional survey design. Data were collected from individuals with diverse physical, sensory, and cognitive disabilities who have experience interacting with AI care agents. Measurement instruments were adapted from established ethical AI, inclusive design, and technology acceptance frameworks. Humanistic well-being was assessed using the WHO-5 Well-Being Index. The data were analyzed using Structural Equation Modeling (SEM) to examine the relationships between ethical AI design, inclusive features, user trust, technology acceptance, emotional support, and well-being outcomes. The findings indicate that ethical AI design significantly enhances user trust and perceived emotional support, while inclusive design features positively influence technology acceptance and emotional engagement. User trust, technology acceptance, and emotional support significantly contribute to humanistic well-being, with emotional support emerging as the strongest predictor. This study contributes a quantitative empirical model demonstrating how ethical and inclusive AI design principles translate into measurable well-being outcomes for people with disabilities. The findings highlight the importance of integrating humanistic values into AI care agent development to ensure equitable, responsible, and sustainable digital care innovation.

References

[1] D. B. Olawade, O. A. Bolarinwa, Y. A. Adebisi, and S. Shongwe, “The role of artificial intelligence in enhancing healthcare for people with disabilities,” Social Science & Medicine, vol. 364, p. 117560, 2025.

[2] M. F. Almufareh, S. Kausar, M. Humayun, and S. Tehsin, “A conceptual model for inclusive technology: advancing disability inclusion through artificial intelligence,” Journal of Disability Research, vol. 3, no. 1, p. 20230060, 2024.

[3] C. El Morr, D. Singh, V. Sawhney, S. Fernandes, Y. El-Lahib, and R. Gorman, “Exploring the intersection of ai and inclusive design for people with disabilities,” Digital Health and Informatics Innovations for Sustainable Health Care Systems, pp. 556–559, 2024.

[4] T. S. Agustina, A. T. GENC¸ , and A. Prasetyo, “Spiritual capital innovative work behavior and subjective well being of startup founders,” Aptisi Transactions on Technopreneurship (ATT), vol. 8, no. 1, pp. 365-376, 2026.

[5] E. Umucu, “Artificial intelligence and health equity for people with disabilities: An integrated framework for disability-inclusive ai design,” INQUIRY: The Journal of Health Care Organization, Provision, and Financing, vol. 62, p. 00469580251365472, 2025.

[6] H. Klabi and O. Smith, “Ethical and policy considerations in ai-enabled assistive communication: Balancing innovation with accessibility and equity,” Journal of Intelligent Assistive Communication Technologies, pp. 25–32, 2026.

[7] J. J. White, “Artificial intelligence and people with disabilities: a reflection on human–ai partnerships,” in Humanity Driven AI: Productivity, Well-being, Sustainability and Partnership. Springer, 2021, pp. 279–310.

[8] M. Kchaou, Y. Munusamy, K. A. Alharthi, and A. F. Al-Mahmodi, “Industry 5.0 adaptation for disabilityinclusive healthcare: A review of emergent and ai technologies for assistive digital health,” Digital Health, vol. 11, p. 20552076251395558, 2025.

[9] T. F. Sudarma, F. Festiyed, M. Fadilah, S. Diliarosta, R. Tanjung, and G. Yao, “Effects of mobile learning on critical thinking skills using problem based learning,” Aptisi Transactions on Technopreneurship (ATT), vol. 8, no. 1, pp. 339–350, 2026.

[10] S. Ferebee, “Ai and accessibility: Breaking barriers for people with disabilities,” Premier Journal of Artificial Intelligence, vol. 2, p. 100012, 2025.

[11] J. Bricout, J. Greer, N. Fields, L. Xu, P. Tamplain, K. Doelling, and B. Sharma, “The “humane in the loop”: Inclusive research design and policy approaches to foster capacity building assistive technologies in the covid-19 era,” Assistive Technology, vol. 34, no. 6, pp. 644–652, 2022.

[12] A. Alsaleh, “The influence of artificial intelligence on individuals with disabilities,” Acta Psychologica, vol. 262, p. 106010, 2026.

[13] N. I. Susanthi, M. Ali, and A. H. Hernawan, “Digital learning platforms as facilitator for university business collaboration in logistics management curriculum design,” International Journal of Cyber and IT Service Management (IJCITSM), vol. 6, no. 1, pp. 37–50, 2026.

[14] G. Ricchezze, L. Tomassini, and M. Bacci, “Ethical reflections on integrating artificial intelligence in care practices,” Community Health Equity Research & Policy, p. 2752535X251370928, 2025.

[15] R. Cersosimo and V. Pennazio, “Learning to design, designing to care: High school students co-designing ai for disability inclusion,” Journal of Inclusive Methodology and Technology in Learning and Teaching, vol. 5, no. 3, 2025.

[16] J. Shuford, “Contribution of artificial intelligence in improving accessibility for individuals with disabilities,” Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (Online), vol. 2, no. 2, pp. 421–433, 2023.

[17] N. Lutfiani, D. A. Astrieta, V. Wildan, H. Sulistyaningrum, M. R. Anwar, and E. D. Astuti, “Emotional well-being and psychological support in infertility a multi-modal ai approach,” International Journal of Cyber and IT Service Management (IJCITSM), vol. 5, no. 1, pp. 81–92, 2025.

[18] K. Joamets and A. Chochia, “Access to artificial intelligence for persons with disabilities: Legal and ethical questions concerning the application of trustworthy ai.” Acta Baltica Historiae et Philosophiae Scientiarum, vol. 9, no. 1, 2021.

[19] M. Schaur and K. Matausch-Mahr, “Assistive technology using artificial intelligence in the long-term care sector for persons with disabilities: A systematic literature review,” Technology and Disability, vol. 37, no. 3, pp. 259–269, 2025.

[20] C. El Morr, B. Kundi, F. Mobeen, S. Taleghani, Y. El-Lahib, and R. Gorman, “Ai and disability: A systematic scoping review,” Health Informatics Journal, vol. 30, no. 3, p. 14604582241285743, 2024.

[21] W. Usino, M. M. Sari, F. P. Oganda, O. P. M. Daeli, and E. Smith, “Artificial intelligence integration for sustainable business model innovation insights from global startups,” Sundara Advanced Research on Artificial Intelligence, vol. 1, no. 2, pp. 82–89, 2025.

[22] R. Nacheva and M. Czaplewski, “Artificial intelligence in helping people with disabilities: Opportunities and challenges,” HR and Technologies, vol. 1, pp. 102–124, 2024.

[23] R. Binns and R. Kirkham, “How could equality and data protection law shape ai fairness for people with disabilities?” ACM Transactions on Accessible Computing (TACCESS), vol. 14, no. 3, pp. 1–32, 2021.

[24] D. Newman-Griffis, J. S. Rauchberg, R. Alharbi, L. Hickman, and H. Hochheiser, “Definition drives design: Disability models and mechanisms of bias in ai technologies,” arXiv preprint arXiv:2206.08287, 2022.

[25] A. S. George and A. H. George, “Towards a super smart society 5.0: Opportunities and challenges of integrating emerging technologies for social innovation,” Partners Universal International Research Journal, vol. 3, no. 2, pp. 01–29, 2024.

[26] A. Lillywhite and G. Wolbring, “Coverage of ethics within the artificial intelligence and machine learning academic literature: The case of disabled people,” Assistive Technology, 2021.

[27] Nordic Welfare Centre, “Ai for all – inclusive technology is a collective responsibility,” Jun. 2025, accessed: 2026-03-08. [Online]. Available: https://nordicwelfare.org/en/nyheter/ai-for-all-inclusive-technology-is-a-collective-responsibility/

[28] U. Rahardja, L. Sulistyo, D. Safarina, M. R. Kusuma, N. Silawati, and Z. Nanle, “Hibahqu education monitoring platform based on human-centric orange technology laravel 12 vue. js,” ADI Bisnis Digital Interdisiplin Jurnal, vol. 6, no. 2, pp. 203–218, 2025.

[29] G. C. K. Yew, “Trust in and ethical design of carebots: the case for ethics of care,” International Journal of Social Robotics, vol. 13, no. 4, pp. 629–645, 2021.

[30] T. Zidaru, E. M. Morrow, and R. Stockley, “Ensuring patient and public involvement in the transition to ai-assisted mental health care: A systematic scoping review and agenda for design justice,” Health Expectations, vol. 24, no. 4, pp. 1072–1124, 2021.

[31] C. Lukita, A. W. A. Rahman, I. N. Hikam, and U. Rahardja, “Integrating strategic management with sdg 10 for sustainable development and equity,” Aptisi Transactions on Technopreneurship (ATT), vol. 7, no. 2, pp. 638–649, 2025.

[32] D. A. Adepoju and A. G. Adepoju, “Establishing ethical frameworks for scalable data engineering and governance in ai-driven healthcare systems,” Int. J. Res. Publ. Rev, vol. 6, no. 4, pp. 8710–8726, 2025.

[33] V.-A. Melo-Lopez, A. Basantes-Andrade, C.-B. Gudi ´ no-Mej ˜ ´ıa, and E. Hernandez-Mart ´ ´ınez, “The impact of artificial intelligence on inclusive education: A systematic review,” Education Sciences, vol. 15, no. 5, p. 539, 2025.

[34] G. Pisoni, N. D´ıaz-Rodr´ıguez, H. Gijlers, and L. Tonolli, “Human-centered artificial intelligence for designing accessible cultural heritage,” Applied Sciences, vol. 11, no. 2, p. 870, 2021.

[35] S. Ha, S. H. Ho, Y.-H. Bae, M. Lee, J. H. Kim, J. H. Kim, and J. Lee, “Digital health equity and tailored health care service for people with disability: user-centered design and usability study,” Journal of medical Internet research, vol. 25, p. e50029, 2023.

[36] S. Umbrello, M. Capasso, M. Balistreri, A. Pirni, and F. Merenda, “Value sensitive design to achieve the un sdgs with ai: A case of elderly care robots,” Minds and Machines, vol. 31, no. 3, pp. 395–419, 2021.

[37] T. Nadarzynski, N. Knights, D. Husbands, C. A. Graham, C. D. Llewellyn, T. Buchanan, I. Montgomery, and D. Ridge, “Achieving health equity through conversational ai: A roadmap for design and implementation of inclusive chatbots in healthcare,” PLOS Digital Health, vol. 3, no. 5, p. e0000492, 2024.

[38] D. E. Van Norren, “The ethics of artificial intelligence, unesco and the african ubuntu perspective,” Journal of Information, Communication and Ethics in Society, vol. 21, no. 1, pp. 112–128, 2023.

[39] S. Pancholi, J. P. Wachs, and B. S. Duerstock, “Use of artificial intelligence techniques to assist individuals with physical disabilities,” Annual Review of Biomedical Engineering, vol. 26, 2024.

[40] A. Chalkiadakis, A. Seremetaki, A. Kanellou, M. Kallishi, A. Morfopoulou, M. Moraitaki, and S. Mastrokoukou, “Impact of artificial intelligence and virtual reality on educational inclusion: A systematic review of technologies supporting students with disabilities,” Education Sciences, vol. 14, no. 11, p. 1223, 2024.

[41] H. Habib, S. A. K. Jelani, and S. Najla, “Revolutionizing inclusion: Ai in adaptive learning for students with disabilities,” Multidisciplinary Science Journal, vol. 1, no. 01, pp. 1–11, 2022.

[42] N. Tilmes, “Disability, fairness, and algorithmic bias in ai recruitment,” Ethics and Information Technology, vol. 24, no. 2, p. 21, 2022.

[43] A. Iannone and D. Giansanti, “Breaking barriers—the intersection of ai and assistive technology in autism care: A narrative review,” Journal of Personalized Medicine, vol. 14, no. 1, p. 41, 2023.

[44] J. Sin, R. L. Franz, C. Munteanu, and B. Barbosa Neves, “Digital design marginalization: New perspectives on designing inclusive interfaces,” in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, pp. 1–11.

[45] G. Rubeis, M. L. Fang, and A. Sixsmith, “Equity in agetech for ageing well in technology-driven places: The role of social determinants in designing ai-based assistive technologies,” Science and Engineering Ethics, vol. 28, no. 6, p. 49, 2022.

[46] S. Ahmed, M. S. Rahman, M. S. Kaiser, and A. S. Hosen, “Advancing personalized and inclusive education for students with disability through artificial intelligence: perspectives, challenges, and opportunities,” Digital, vol. 5, no. 2, p. 11, 2025.

[47] R. Fitas, “Inclusive education with ai: Supporting special needs and tackling language barriers,” AI and Ethics, vol. 5, no. 6, pp. 5729–5757, 2025.

[48] J. Donia and J. A. Shaw, “Co-design and ethical artificial intelligence for health: An agenda for critical research and practice,” Big Data & Society, vol. 8, no. 2, p. 20539517211065248, 2021.

[49] E. Grassini, M. Buzzi, B. Leporini, and A. Vozna, “A systematic review of chatbots in inclusive healthcare: insights from the last 5 years,” Universal Access in the Information Society, vol. 24, no. 1, pp. 195–203, 2025.

[50] J. Frenette, “Ai for ethical travel curation: Supporting inclusive, culturally sensitive itineraries in global resort and cruise services,” INTERNATIONAL JOURNAL, vol. 2583, p. 1062.

[51] F. Li, N. Ruijs, and Y. Lu, “Ethics & ai: A systematic review on ethical concerns and related strategies for designing with ai in healthcare,” Ai, vol. 4, no. 1, pp. 28–53, 2022.

[52] E. Harris, A. Franz, and S. O’Hara, “Promoting social equity and building resilience through value inclusive design,” Buildings, vol. 13, no. 8, p. 2081, 2023.

[53] C. Rudschies and I. Schneider, “Ethical, legal, and social implications (elsi) of virtual agents and virtual reality in healthcare,” Social Science & Medicine, vol. 340, p. 116483, 2024.

[54] S. Kohnke and T. Zaugg, “Artificial intelligence: an untapped opportunity for equity and access in stem education,” Education Sciences, vol. 15, no. 1, p. 68, 2025.

[55] J. Sun, B. Ma, and X. Li, “Inclusive yet unconvincing: when robot-delivered inclusive service undermines customer citizenship behavior,” Journal of Hospitality Marketing & Management, vol. 35, no. 2, pp. 166–202, 2026.

[56] A. Jetha, S. Bonaccio, A. Shamaee, C. G. Banks, U. Bultmann, P. M. Smith, E. Tompa, L. B. Tucker, ¨ C. Norman, and M. A. Gignac, “Divided in a digital economy: Understanding disability employment inequities stemming from the application of advanced workplace technologies,” SSM-Qualitative Research in Health, vol. 3, p. 100293, 2023.

57] W. H. Organization, Ethics and governance of artificial intelligence for health: large multi-modal models. WHO guidance. World Health Organization, 2024.

[58] W. H. Organization et al., Ethics and governance of artificial intelligence for health: WHO guidance. World Health Organization, 2021.

[59] F. Miao, W. Holmes et al., AI and education: A guidance for policymakers. Unesco Publishing, 2021.

[60] A. Mouta, A. M. Pinto-Llorente, and E. M. Torrecilla-Sanchez, “Uncovering blind spots in education ethics: Insights from a systematic literature review on artificial intelligence in education,” International Journal of Artificial Intelligence in Education, vol. 34, no. 3, pp. 1166–1205, 2024.

[61] O. Ozmen Garibay, B. Winslow, S. Andolina, M. Antona, A. Bodenschatz, C. Coursaris, G. Falco, S. M. Fiore, I. Garibay, K. Grieman et al., “Six human-centered artificial intelligence grand challenges,” International Journal of Human–Computer Interaction, vol. 39, no. 3, pp. 391–437, 2023.

[62] H. R. Saeidnia, S. G. Hashemi Fotami, B. Lund, and N. Ghiasi, “Ethical considerations in artificial intelligence interventions for mental health and well-being: Ensuring responsible implementation and impact,” Social Sciences, vol. 13, no. 7, p. 381, 2024.

[63] S. E. Nugent and S. Scott-Parker, “Recruitment ai has a disability problem: anticipating and mitigating unfair automated hiring decisions,” in Towards trustworthy artificial intelligent systems. Springer, 2022, pp. 85–96.

[64] S. Bulathwela, M. Perez-Ortiz, C. Holloway, M. Cukurova, and J. Shawe-Taylor, “Artificial intelligence alone will not democratise education: On educational inequality, techno-solutionism and inclusive tools,” Sustainability, vol. 16, no. 2, p. 781, 2024.

[65] S. Borau, “Deception, discrimination, and objectification: Ethical issues of female ai agents: Deception, discrimination, and objectification: Ethical issues of female ai agents,” Journal of Business Ethics, vol. 198, no. 1, pp. 1–19, 2025.

[66] P. Acosta-Vargas, B. Salvador-Acosta, S. Novillo-Villegas, D. Sarantis, and L. Salvador-Ullauri, “Generative artificial intelligence and web accessibility: Towards an inclusive and sustainable future,” Emerging Science Journal, vol. 8, no. 4, pp. 1602–1621, 2024

[67] E. Abdelhalim, K. S. Anazodo, N. Gali, and K. Robson, “A framework of diversity, equity, and inclusion safeguards for chatbots,” Business Horizons, vol. 67, no. 5, pp. 487–498, 2024.

[68] C. Zaga and M. L. Lupetti, Diversity equity and inclusion in embodied AI: reflecting on and re-imagining our future with embodied AI. 4TU. Federation, 2022.

[69] L. Devillers, “Human–robot interactions and affective computing: The ethical implications,” in Robotics, AI, and humanity: Science, ethics, and policy. Springer, 2021, pp. 205–211.

[70] C. Dumitru, G. Muttashar Abdulsahib, O. Ibrahim Khalaf, and A. Bennour, “Integrating artificial intelligence in supporting students with disabilities in higher education: An integrative review,” Technology and Disability, vol. 38, no. 1, pp. 3–24, 2026.

[71] S. Sands, V. Demsar, C. Ferraro, C. Campbell, and J. Cohen, “Inauthentic inclusion: Exploring how intention to use ai-generated diverse models can backfire,” Psychology & Marketing, vol. 41, no. 6, pp. 1396–1413, 2024.

[72] A. Chopra, H. Patel, D. S. Rajput, and N. Bansal, “Empowering inclusive education: Leveraging ai-ml and innovative tech stacks to support students with learning disabilities in higher education,” in Applied assistive technologies and informatics for students with disabilities. Springer, 2024, pp. 255–275.

[73] J. Xie and M. F. Rice, “Professional and social investment in universal design for learning in higher education: Insights from a faculty development programme,” Journal of Further and Higher Education, vol. 45, no. 7, pp. 886–900, 2021.