Evaluation of Psychometric Properties of Thai Version Telehealth Usability Questionnaire (T-TUQ)

Authors

  • Parima Hirunwiwatkul Department of Ophthalmology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
  • Punnaka Pongpanich Department of Ophthalmology, King Chulalongkorn Memorial Hospital (KCMH), Bangkok, Thailand
  • Wasee Tulvatana Department of Ophthalmology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
  • Supharat Jariyakosol Department of Ophthalmology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
  • Warongporn Phuenpathom Chulalongkorn Centre of Excellence for Parkinson's Disease & Related Disorders, King Chulalongkorn Memorial Hospital, Thai Red Cross Society, Bangkok, Thailand
  • Supaporn Krittanupong Chula Neuroscience Center, King Chulalongkorn Memorial Hospital, Thai Red Cross Society, Bangkok, Thailand
  • Ruttanabhorn Chonramak Chula Neuroscience Center, King Chulalongkorn Memorial Hospital, Thai Red Cross Society, Bangkok, Thailand
  • Tidarat Pichedvanichok Nursing Department, King Chulalongkorn Memorial Hospital, Bangkok, Thailand
  • Roongroj Bhidayasiri Chulalongkorn Centre of Excellence for Parkinson's Disease & Related Disorders, King Chulalongkorn Memorial Hospital, Thai Red Cross Society, Bangkok, Thailand
  • Chaichana Nimnuan Department of Psychiatry, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand

DOI:

https://doi.org/10.5195/ijt.2023.6577

Keywords:

Questionnaire, Telehealth, Telehealth Usability Questionnaire (TUQ), Thai, Translation, Usability, Validation

Abstract

This cross-sectional validation study aimed to translate, cross-culturally adapt, and investigate the psychometric properties of a Thai version of the Telehealth Usability Questionnaire (T-TUQ). Two hundred and ten Thai participants, mean age of 61.2±15.2 years, were recruited from three specialty clinics: 50 (23.8%) hematology, 70 (33.3%) movement disorders, and 90 (42.9%) general neurology. The T-TUQ was translated from the original English version to produce a Thai language version. Back translation and pilot cognitive interviews were completed. All five subscales (usefulness, ease of use, effectiveness, reliability, and satisfaction) showed excellent internal consistency (alpha >0.80), displayed by Cronbach's alpha coefficient of 0.83, 0.94, 0.86, 0.83, and 0.92, respectively. For construct validity, exploratory factor analysis revealed two dimensions from eigenvalues and scree plot, defined as utility and accessibility subscales. In conclusion, the T-TUQ could be a reliable and valid instrument to evaluate the usability of telehealth with a Thai population.

  

References

Awais-e-yazdan, M., Birau, R., Spulbar, C., & Florescu, I. (2022). Urdu version of the telemedicine satisfaction questionnaire and telehealth usability questionnaire: An introductory investigation among pakistani transgender individuals. Research and Science Today, 24(2), 133–151. https://doi.org/10.38173/RST.2022.24.2.10:133-151

Barsom, E. Z., van Hees, E., Bemelman, W. A., & Schijven, M. P. (2020). Measuring patient satisfaction with video consultation: A systematic review of assessment tools and their measurement properties. International Journal of Technology Assessment in Health Care, 36(4), 356–362. https://doi.org/10.1017/S0266462320000367

Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186–3191. https://doi.org/10.1097/00007632-200012150-00014

Bender, C., Nielsen, M. G., Hejlesen, O., & Hangaard, S. (2022). Assessing the use of telemedicine among people with diabetes: A Danish translation and cross-cultural adaptation of the Telemedicine Usability Questionnaire. In Proceedings of the 18th Scandinavian Conference on Health Informatics (pp. 14-20). Linköping University Electronic Press. https://doi.org/10.3384/ecp187003

Bibiloni, N., Torre, A., Angles, M., Terrasa, S., Peña, F., Sommer, J., Plazzotta, F., Luna, D., & Mazzuoccolo, L. (2020). Validation of a Spanish questionnaire on telemedicine usability. Medicina, 80(6), 649–653. https://www.medicinabuenosaires.com/PMID/33254109.pdf

Comrey, A. L. (1988). Factor-analytic methods of scale development in personality and clinical psychology. Journal of Consulting and Clinical Psychology, 56(5), 754–761. https://doi.org/10.1037/0022-006X.56.5.754

Finn, M. T. M., Brown, H. R., Friedman, E. R., Kelly, A. G., & Hansen, K. (2021). Preference for telehealth sustained over three months at an outpatient center for integrative medicine. Global Advances in Health and Medicine, 10, 1–9. https://doi.org/10.1177/2164956121997361

Grossman, S. N., Han, S. C., Balcer, L. J., Kurzweil, A., Weinberg, H., Galetta, S. L., & Busis, N. A. (2020). Rapid implementation of virtual neurology in response to the COVID-19 pandemic. Neurology, 94(24), 1077–1087. https://doi.org/10.1212/WNL.0000000000009677

Guadagnoli, E., & Velicer, W. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103, 265–275. https://doi.org/10.1037//0033-2909.103.2.265

Hajesmaeel-Gohari, S., & Bahaadinbeigy, K. (2021). The most used questionnaires for evaluating telemedicine services. BMC Medical Informatics and Decision Making, 21(36), 2–11. https://doi.org/10.1186/s12911-021-01407-y

Hvalič Touzery, S., Dolnicar, V., Prevodnik, K., Škafar, M., & Petrovčič, A. (2020). The importance of patients’ user experience with a telehealth system for their evaluation of its psychosocial impacts. Smart Living Form 2019, 19–25.

Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. https://doi.org/10.1007/BF02291575

Kruse, C. S., Krowski, N., Rodriguez, B., Tran, L., Vela, J., & Brooks, M. (2017). Telehealth and patient satisfaction: A systematic review and narrative analysis. BMJ Open, 7(e016242), 1–12. https://doi.org/10.1136/bmjopen-2017-016242

Lai, K. E., Ko, M. W., Rucker, J. C., Odel, J. G., Sun, L. D., Winges, K. M., Ghosh, A., Bindiganavile, S. H., Bhat, N., Wendt, S. P., Scharf, J. M. M., Dinkin, M. J., Rasool, N., Galetta, S. L., & Lee, A. G. (2020). Tele-Neuro-Ophthalmology during the age of COVID-19. Journal of Neuro-Ophthalmology, 40(3), 292–304. https://doi.org/10.1097/WNO.0000000000001024

Langbecker, D., Caffery, L. J., Gillespie, N., & Smith, A. C. (2017). Using survey methods in telehealth research: A practical guide. Journal of Telemedicine and Telecare, 23(9), 770–779. https://doi.org/10.1177/1357633X17721814

Nunnally, J. D. (1978). Psychometric theory (2nd ed), New York: McGraw-Hill.

Özkeskin M, Özden F, Ekmekçi Ö, & Yüceyar N. (2022). The reliability and validity of the Turkish version of the Telemedicine Satisfaction and Usefulness Questionnaire (TSUQ) and Telemedicine Patient Questionnaire (TPQ) in individuals with multiple sclerosis. Neurological Science, 43(3), 1921-1927. https://doi.org/10.1007/s10072-021-05519-1.

Park, H.-Y., Kwon, Y.-M., Jun, H.-R., Jung, S.-E., & Kwon, S.-Y. (2021). Satisfaction survey of patients and medical staff for telephone-based telemedicine during hospital closing due to COVID-19 transmission. Telemedicine and E-Health, 27(7), 724–732. https://doi.org/10.1089/tmj.2020.0369

Parmanto, B., Lewis, Jr., A. N., Graham, K. M., & Bertolet, M. H. (2016). Development of the Telehealth Usability Questionnaire (TUQ). International Journal of Telerehabilitation, 8(1), 3–10. https://doi.org/10.5195/ijt.2016.6196

Portney, L. G., & Watkins, M. P. (2009). Foundations of clinical research: Applications to practice. 3rd edition (Vol. 3). Pearson Education, Inc.

Santos MR, Malaguti C, Cabral LA, Soares AL, Neves LHG, Sena LDA, Parmanto B, Sauers AL, José A, Oliveira CC. (2023). The Brazilian version of the telehealth usability questionnaire (telehealth usability questionnaire Brazil): Translation, cross-cultural adaptation, and psychometric properties. Revista da Associação Médica Brasileira, 69(12), e20230228. https://doi.org/10.1590/1806-9282.20230228.

Schutte, J. L., Gales, S., Filipponi, A., Saptono, A., Bambang, P., & McCue, M. (2012). Evaluation of a telerehabilitation system for community-based rehabilitation. International Journal of Telerehabilitation, 4(1), 15–24. https://doi.org/10.5195/ijt.2012.6092

Weaver, M. S., Lukowski, J., Wichman, B., Navaneethan, H., Fisher, A. L., & Neumann, M. L. (2021). Human connection and technology connectivity: A systematic review of available telehealth survey instruments. Journal of Pain and Symptom Management, 61(5), 1042–1051. https://doi.org/10.1016/j.jpainsymman.2020.10.010

Downloads

Published

2023-12-12

How to Cite

Hirunwiwatkul, P., Pongpanich, P., Tulvatana, W., Jariyakosol, S., Phuenpathom, W., Krittanupong, S., Chonramak, R., Pichedvanichok, T., Bhidayasiri, R., & Nimnuan, C. (2023). Evaluation of Psychometric Properties of Thai Version Telehealth Usability Questionnaire (T-TUQ). International Journal of Telerehabilitation, 15(2). https://doi.org/10.5195/ijt.2023.6577

Issue

Vol. 15 No. 2 (2023)

Section

Clinical Research

License

Copyright (c) 2023 Parima Hirunwiwatkul, Punnaka Pongpanich, Wasee Tulvatana, Supharat Jariyakosol, Warongporn Phuenpathom, Supaporn Krittanupong, Ruttanabhorn Chonramak, Tidarat Pichedvanichok, Roongroj Bhidayasiri, Chaichana Nimnuan

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

  1. The Author retains copyright in the Work, where the term “Work” shall include all digital objects that may result in subsequent electronic publication or distribution.
  2. Upon acceptance of the Work, the author shall grant to the Publisher the right of first publication of the Work.
  3. The Author shall grant to the Publisher and its agents the nonexclusive perpetual right and license to publish, archive, and make accessible the Work in whole or in part in all forms of media now or hereafter known under a Creative Commons Attribution 4.0 International License or its equivalent, which, for the avoidance of doubt, allows others to copy, distribute, and transmit the Work under the following conditions:
    1. Attribution—other users must attribute the Work in the manner specified by the author as indicated on the journal Web site;
    with the understanding that the above condition can be waived with permission from the Author and that where the Work or any of its elements is in the public domain under applicable law, that status is in no way affected by the license.
  4. The Author is able to enter into separate, additional contractual arrangements for the nonexclusive distribution of the journal's published version of the Work (e.g., post it to an institutional repository or publish it in a book), as long as there is provided in the document an acknowledgement of its initial publication in this journal.
  5. Authors are permitted and encouraged to post online a prepublication manuscript (but not the Publisher’s final formatted PDF version of the Work) in institutional repositories or on their Websites prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. Any such posting made before acceptance and publication of the Work shall be updated upon publication to include a reference to the Publisher-assigned DOI (Digital Object Identifier) and a link to the online abstract for the final published Work in the Journal.
  6. Upon Publisher’s request, the Author agrees to furnish promptly to Publisher, at the Author’s own expense, written evidence of the permissions, licenses, and consents for use of third-party material included within the Work, except as determined by Publisher to be covered by the principles of Fair Use.
  7. The Author represents and warrants that:
    1. the Work is the Author’s original work;
    2. the Author has not transferred, and will not transfer, exclusive rights in the Work to any third party;
    3. the Work is not pending review or under consideration by another publisher;
    4. the Work has not previously been published;
    5. the Work contains no misrepresentation or infringement of the Work or property of other authors or third parties; and
    6. the Work contains no libel, invasion of privacy, or other unlawful matter.
  8. The Author agrees to indemnify and hold Publisher harmless from Author’s breach of the representations and warranties contained in Paragraph 6 above, as well as any claim or proceeding relating to Publisher’s use and publication of any content contained in the Work, including third-party content.

Revised 7/16/2018. Revision Description: Removed outdated link.