Hostname: page-component-7479d7b7d-8zxtt Total loading time: 0 Render date: 2024-07-12T21:19:36.780Z Has data issue: false hasContentIssue false
  • English
  • Français

Traded and combined cooperative control of a smart wheelchair

Published online by Cambridge University Press:  07 January 2022

Youssef Ech-Choudany Open the ORCID record for Youssef Ech-Choudany [Opens in a new window] ,
Régis Grasse ,
Romuald Stock ,
Odile Horn  and
Guy Bourhis
Youssef Ech-Choudany*
Affiliation:
LCOMS, Université de Lorraine, ISEA, 7 rue Marconi, 57070 Metz, France
Régis Grasse
Affiliation:
LCOMS, Université de Lorraine, ISEA, 7 rue Marconi, 57070 Metz, France
Romuald Stock
Affiliation:
LCOMS, Université de Lorraine, ISEA, 7 rue Marconi, 57070 Metz, France
Odile Horn
Affiliation:
LCOMS, Université de Lorraine, ISEA, 7 rue Marconi, 57070 Metz, France
Guy Bourhis
Affiliation:
LCOMS, Université de Lorraine, ISEA, 7 rue Marconi, 57070 Metz, France
*
*Corresponding author. E-mail: y.echchoudany@gmail.com
Get access Rights & Permissions [Opens in a new window]

Abstract

This article deals with a human–machine cooperative system for the control of a smart wheelchair for people with motor disabilities. The choice of a traded control mode is first argued. The paper then pursues two objectives. The first is to describe the design of the cooperative system by focusing on the dialogue and the interaction between the pilot and the robot. The second objective is to introduce a new cooperative mode. In this one, three features are proposed: two semi-autonomous features, a wall following and a doorway crossing, during which the user can intervene punctually to rectify a trajectory or a path, and an assisted mode where, conversely, the machine intervenes in a manual control to avoid obstacles. This mode of intervention of an entity, human or machine, supervising a movement controlled by the other is referred as “combined control.” Examples of scenarios exploiting the cooperative capabilities of the system are presented and discussed.

Keywords

smart wheelchairhuman–machine cooperationtraded controlcombined control
Type
Research Article
Information
Robotica , Volume 40 , Issue 8 , August 2022 , pp. 2630 - 2650
Copyright
© The Author(s), 2022. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Fehr, L., Langbein, W. E. and Skaar, S. B., “Adequacy of power wheelchair control interfaces for persons with severe disabilities: A clinical survey,” J. Rehabil. Res. Dev. 37, 8 (2000).Google ScholarPubMed
Simpson, R. C., LoPresti, E. F. and Cooper, R. A., “How many people would benefit from a smart wheelchair?” J. Rehabil. Res. Dev. 45(1), 53–71 (2008). doi: 10.1682/jrrd.2007.01.0015.CrossRefGoogle ScholarPubMed
Madarasz, R., Heiny, L., Cromp, R. and Mazur, N., “The design of an autonomous vehicle for the disabled,” IEEE J. Robot. Autom. 2(3), 117–126 (1986). doi: 10.1109/JRA.1986.1087052.CrossRefGoogle Scholar
Bourhis, B., Pruski, A., Moumen, K. and Bop, C., “The V.A.H.M. Project (Autonomous Vehicle for Disabled),” In: European Conference on the Avancenient of Rehabilitation Technology (Maastricht, Pays-Bas, November 1990) pp. 95–96.Google Scholar
Levine, S., Borenstein, J. and Koren, Y., “The Navchair Control System for Automatic Assistive Wheelchair Navigation,” In: RESNA: Proceedings of the 13th Annual Conference, Washington, D.C. (1990).Google Scholar
Nisbet, P., “The CALL Centre Smart Wheelchair,” In: 1st International Workshop on RobotIC Appllications Medical Health Care Ott. (1988).Google Scholar
Leaman, J. and La, H. M., “A comprehensive review of smart wheelchairs: Past, present, and future,” . 47(4), 486–499 (2017).Google Scholar
Simpson, R. C., “Smart wheelchairs: A literature review,” J. Rehabil. Res. Dev. 42, 423 (2005).CrossRefGoogle ScholarPubMed
Abbink, D. A. et al., “A topology of shared control systems—finding common ground in diversity,” IEEE Trans. Hum.-Mach. Syst. 48(5), 509–525 (2018).CrossRefGoogle Scholar
Nisbet, P. D., “Who’s Intelligent? Wheelchair, Driver or Both?” In: Proceedings of the International Conference on Control Applications, vol. 2 (September 2002) pp. 760–765. doi: 10.1109/CCA.2002.1038696.CrossRefGoogle Scholar
Rushton, P. W. et al., “Intelligent power wheelchair use in long-term care: Potential users’ experiences and perceptions,” Disabil. Rehabil. Assist. Technol. 12(7), 740–746 (2017). doi: 10.1080/17483107.2016.1260653.CrossRefGoogle ScholarPubMed
Tamura, H., Manabe, T., Goto, T., Yamashita, Y. and Tanno, K., “A Study of the Electric Wheelchair Hands-Free Safety Control System Using the Surface-Electromygram of Facial Muscles,” In: Intelligent Robotics and Applications, Berlin, Heidelberg (2010) pp. 97–104. doi: 10.1007/978-3-642-16587-0_10.CrossRefGoogle Scholar
Eid, M. A., Giakoumidis, N. and El Saddik, A., “A novel eye-gaze-controlled wheelchair system for navigating unknown environments: Case study with a person with ALS,” IEEE Access 4, 558–573 (2016).CrossRefGoogle Scholar
Tang, J., Liu, Y., Hu, D. and Zhou, Z., “Towards BCI-actuated smart wheelchair system,” Biomed. Eng. OnLine 17(1), 111 (2018). doi: 10.1186/s12938-018-0545-x.CrossRefGoogle ScholarPubMed
Flemisch, F., Abbink, D. A., Itoh, M., M.-P. Pacaux-Lemoine and G. Weßel, “Joining the blunt and the pointy end of the spear: Towards a common framework of joint action, human–machine cooperation, cooperative guidance and control, shared, traded and supervisory control,” Cogn. Technol. Work 21(4), 555–568 (2019). doi: 10.1007/s10111-019-00576-1.CrossRefGoogle Scholar
Bourhis, G. and Agostini, Y., “Man-machine cooperation for the control of an intelligent powered wheelchair,” J. Intell. Robot. Syst. 22(3–4), 269–287 (1998).Google Scholar
Rasmussen, J., “Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models,” IEEE Trans. Syst. Man Cybern. 3, 257–266 (1983).CrossRefGoogle Scholar
Sheridan, T. B., Telerobotics, Automation, and Human Supervisory Control (MIT Press Camb., 1992).Google Scholar
Hadj-Abdelkader, M.-A., Bourhis, G. and Cherki, B., “Haptic feedback control of a smart wheelchair,” Appl. Bionics Biomech. 9(2), 181–192 (2012).CrossRefGoogle Scholar
Devigne, L., Pasteau, F., Babel, M., Narayanan, V. K., Guegan, S. and Gallien, P., “Design of a Haptic Guidance Solution for Assisted Power Wheelchair Navigation,” In: 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (2018) pp. 3231–3236.Google Scholar
Borenstein, J. and Koren, Y., “The vector field histogram-fast obstacle avoidance for mobile robots,” IEEE Trans. Robot. Autom. 7(3), 278–288 (1991).CrossRefGoogle Scholar
Carlson, T. and Demiris, Y., “Human-Wheelchair Collaboration through Prediction of Intention and Adaptive Assistance,” In: 2008 IEEE International Conference on Robotics and Automation (2008) pp. 3926–3931.CrossRefGoogle Scholar
Ghorbel, M., Pineau, J., Gourdeau, R., Javdani, S. and Srinivasa, S., “A decision-theoretic approach for the collaborative control of a smart wheelchair,” Int. J. Soc. Robot. 10(1), 131–145 (2018).CrossRefGoogle ScholarPubMed
Maciel, G. M., Pinto, M. F., I. C. da S. Júnior, F. O. Coelho, A. L. M. Marcato and M. M. Cruzeiro, “Shared control methodology based on head positioning and vector fields for people with quadriplegia,” Robotica, 1–17, undefined/ed, doi: 10.1017/S0263574721000606.CrossRefGoogle Scholar
Urdiales, C., Fernandez-Espejo, B., Annicchiaricco, R., Sandoval, F. and Caltagirone, C., “Biometrically Modulated Collaborative Control for an Assistive Wheelchair,” IEEE Trans. Syst, Neural. Rehabil. Eng., vol. 18, no. 4, pp. 398–408, Aug. 2010, doi: 10.1109/TNSRE.2010.2056391.Google ScholarPubMed
Burhanpurkar, M., Labbé, M., Guan, C., Michaud, F. and Kelly, J., Cheap or Robust? The Practical Realization of Self-Driving Wheelchair Technology (July 2017).CrossRefGoogle Scholar
Pasteau, F., Narayanan, V. K., Babel, M. and Chaumette, F., “A visual servoing approach for autonomous corridor following and doorway passing in a wheelchair,” Robot. Auton. Syst. 75, 28–40 (2016).CrossRefGoogle Scholar
Lee, Y., Chiu, C. and Kuo, I., “Fuzzy Wall-Following Control of a Wheelchair,” In: 2017 Joint 17th World Congress of International Fuzzy Systems Association and 9th International Conference on Soft Computing and Intelligent Systems (IFSA-SCIS) (June 2017) pp. 1–6. doi: 10.1109/IFSA-SCIS.2017.8023223.CrossRefGoogle Scholar
Panzarella, T., Schwesinger, D. and Spletzer, J., “CoPilot: Autonomous Doorway Detection and Traversal for Electric Powered Wheelchairs,” In: Field and Service Robotics: Results of the 10th International Conference (Wettergreen, D. S. and Barfoot, T. D., eds.) (Springer International Publishing, Cham, 2016) pp. 233–248. doi: 10.1007/978-3-319-27702-8_16.Google Scholar
Leigh, A., Pineau, J., Olmedo, N. and Zhang, H., “Person Tracking and Following with 2D Laser Scanners,” In: 2015 IEEE International Conference on Robotics and Automation (ICRA) (May 2015) pp. 726–733. doi: 10.1109/ICRA.2015.7139259.CrossRefGoogle Scholar
Iturrate, I., Antelis, J. M., Kubler, A. and Minguez, J., “A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation,” IEEE Trans. Robot. 25(3), 614–627 (2009).CrossRefGoogle Scholar
Leishman, F., Horn, O. and Bourhis, G., “Smart wheelchair control through a deictic approach,” Robot. Auton. Syst. 58(10), 1149–1158 (2010). doi: 10.1016/j.robot.2010.06.007.CrossRefGoogle Scholar
Chacon Quesada, R. and Demiris, Y., Augmented Reality Control of Smart Wheelchair Using Eye-Gaze–Enabled Selection of Affordances (2018).Google Scholar
Nguyen, V. T., Sentouh, C., Pudlo, P. and Popieul, J.-C., “Joystick Haptic Force Feedback for Powered Wheelchair - A Model-based Shared Control Approach,” In: 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (October 2020) pp. 4453–4459. doi: 10.1109/SMC42975.2020.9283235.CrossRefGoogle Scholar
Parikh, S. P., Grassi, V., Kumar, V. and Okamoto, J., “Incorporating User Inputs in Motion Planning for a Smart Wheelchair,” In: IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA 2004. 2004, vol. 2 (April 2004) pp. 2043–2048. doi: 10.1109/ROBOT.2004.1308124.CrossRefGoogle Scholar
Ciabattoni, L., Ferracuti, F., Freddi, A., Iarlori, S., Longhi, S. and Monteriù, A., “Human-in-the-Loop Approach to Safe Navigation of a Smart Wheelchair via Brain Computer Interface,” In: Ambient Assisted Living, vol. 725 (Monteriù, A., Freddi, A. and Longhi, S., eds.) (Springer International Publishing, Cham, 2021) pp. 197–209. doi: 10.1007/978-3-030-63107-9_16.CrossRefGoogle Scholar
“ROS.org | Powering the world’s robots”. https://www.ros.org/ (accessed January 02, 2021).Google Scholar
Michon, J. A., “A Critical View of Driver Behavior Models: What Do We Know, What Should We Do?” In: Human Behavior and Traffic Safety (Evans, L. and Schwing, R. C., eds.) (Springer US, Boston, MA, 1985) pp. 485–524. doi: 10.1007/978-1-4613-2173-6_19.CrossRefGoogle Scholar
Leishman, F., Monfort, V., Horn, O. and Bourhis, G., “Driving assistance by deictic control for a smart wheelchair: The assessment issue,” IEEE Trans. Hum.-Mach. Syst. 44(1), 66–77 (2014). doi: 10.1109/TSMC.2013.2287792.CrossRefGoogle Scholar