Estudio de técnicas de aprendizaje automático para el monitoreo de un dedo robótico utilizando un sensor de fibra óptica por macrocurvatura basado en imágenes

Keyla Ospino-Manjarres, Daniel Zambrano-Gutierrez, Jorge M. Cruz-Duarte, Daniel Jauregui-Vazquez, Carlos E. Osornio-Martinez, Juan G. Avina-Cervantes, Kristy Escalante-Sanchez, R. Rojas-laguna


Descargar artículo

Información básica

Volumen

V58 - N1 / 2025 Especial: Óptica y Fotónica en México

Referencia

51187

DOI

http://dx.doi.org/10.7149/OPA.58.1.51187

Idioma

English

Etiquetas

Optical fiber bending system, Robotic arm, Database, Image processing, Machine Learning.

Resumen

This study presents an optical-fiber system incorporating machine learning algorithms for accurately detecting a robotic arm's angular index finger position. The robotic index finger's motion monitoring is possible using only a single-mode optical fiber designed for the visible spectrum. The proposed methodology is based on image analysis applied to the light output profile emitted by the fiber opticupon experiencing curvature, which generates wavelength attenuation in the green band. The images analyzed correspond to the range motion between 0° and 85° with 22 statistical features. We evaluate several machine learning algorithms and enhance their performance by reducing the data dimensionality using neighborhood component analysis. Results show that the methodology achieves an accuracy of 92.88% and befalls a high-performance optical sensing approach for creating new competitive trends compared to traditional fiber sensing techniques. The proposed method does notuse any special optical fiber structure and the results show that the machine learning techniques allow the robotic index finger motion through simple image processing profile of an output optical fiber.

Referencias

1

T. Augousti, A. Raza, and M. Gravest, “Design and characterization of a Fibre Optic Respiratory Plethysmograph (FORP)”, Proc. SPIE 2676. (1996).

2

J. Guo, C. Shang, S. Gao, Y. Zhang, B. Fu, and L. Xu, “Flexible Plasmonic Optical Tactile Sensor for Health Monitoring and Artificial Haptic Perception,” Adv Mater Technol 8, (2023).

3

A. Leal-Junior, L Avellar, A. Frizera, and C. Marques, “Smart textiles for multimodal wearable sensing using highly stretchable multiplexed optical fiber system,” Sci Rep 10, (2020)

4

D. Wang, B. Sheng, L. Peng, Y. Huang, and Z. Ni, “Flexible and optical fiber sensors composited by graphene and PDMS for motion detection,” Polymers (Basel) 11, (2019).

5

H. Di, Y. Li, K. Liu, L. An, and J. Dong, “Hand gesture monitoring using fiber-optic curvature sensors,” Appl Opt. 58 (29), 7935 (2019).

6

K. K. Kim et al., “A deep-learned skin sensor decoding the epicentral human motions,” Nat Commun 11, (2020).

7

A. Venketeswaran et al., “Recent Advances in Machine Learning for Fiber Optic Sensor Application”, Adv. Intell. Syst. 4, (2022).

8

E. Kavuncuoğlu, F. Yıldız, and A. T. Özdemir, “Artificial Intelligence (AI) algorithms for evaluation of optical fiber scintillation detector performance”, Optik (Stuttg) 258, (2022).

9

S. Shimadera, K. Kitagawa, K. Sagehashi, Y. Miyajima, T. Niiyama, and S. Sunada, “Speckle-based high-resolution multimodal soft sensing”, Sci Rep 12 (1), (2022).

10

R. Martínez-Manuel, L. M. Valentín-Coronado, J. Esquivel-Hernández, K. J.-J. Monga, and S. LaRochelle, “Machine Learning Implementation for Unambiguous Refractive Index Measurement Using a Self-Referenced Fiber Refractometer”, IEEE Sens J 22 (14), 14134–14141 (2022).

11

R. Martínez-Manuel, J. Esquivel-Hernández, L. M. Valentín-Coronado, and S. LaRochelle, “Fiber-Optic Sensor for Directional Bending Monitoring Based on a Pattern Recognition Algorithm”, IEEE Sens J 23 (5), 4819–4824 (2023).

12

V. Pegorini et al., “In vivo pattern classification of ingestive behavior in ruminants using FBG sensors and machine learning”, Sensors (Switzerland) 15 (11), 28456–28471 (2015).

13

K. Sun, Z. Ding, and Z. Zhang, “Fiber directional position sensor based on multimode interference imaging and machine learning,” Appl Opt. 59 (19), 5745 (2020).

14

Y. Zhuang et al., “Fiber optic sensor embedded smart helmet for real-time impact sensing and analysis through machine learning”, J Neurosci Methods 351, (2021).

15

L. Avellar, A. Frizera, and A. Leal Junior, “POF Smart Pants - A fully portable opticalfiber-integrated smart textile for remotemonitoring of lower limb biomechanics”, Biomed Opt Express 14, (2023).

16

A. Nava-Téllez, M. C. Elias-Espinosa, H. Cervantes-Culebro, and A. E. Flores-González, “Parametric Design of a Finger Rehabilitation Mechanism with Double Action and Two Degrees of Freedom”, Appl. Sci. (Switzerland) 12 (21), (2022).

17

Y. Park and J. Bae, “A three-dimensional finger motion measurement system of a thumb and an index finger without a calibration process”, Sensors (Switzerland) 20 (3), (2020).

18

T. H. Hsu, Y. C. Chiang, W. T. Chan, and S. J. Chen, “A finger exoskeleton robot for finger movement rehabilitation”, Inventions 2 (3), (2017).

19

Hernández-Santos, Y. A. Davizón, A. R. Said, R. Soto, L. C. Felix-Herrán, and A. Vargas-Martínez, “Development of a wearable finger exoskeleton for rehabilitation”, Appl. Sci. (Switzerland) 11 (9), (2021).

20

H. Yu, D. Zheng, Y. Liu, S. Chen, X. Wang, and W. Peng, “Low-Cost Self-Calibration Data Glove Based on Space-Division Multiplexed Flexible Optical Fiber Sensor”, Polymers (Basel) 14 (19), (2022).

21

L. Massari et al., “Functional mimicry of Ruffini receptors with fibre Bragg gratings and deep neural networks enables a bio-inspired large-area tactile-sensitive skin”, Nat Mach Intell 4 (5), 425–435 (2022).

22

L. Zhao et al., “Soft Optoelectronic Sensors with Deep Learning for Gesture Recognition”, Adv Mater Technol 7 (11), (2022).

23

M. Arduengo, A. Arduengo, A. Colomé, J. Lobo-Prat, and C. Torras, “Human to Robot Whole-Body Motion Transfer”, in 2020 IEEE-RAS 20th Humanoids, (2020).

24

T. B. Tuli, M. Manns, and S. Zeller, “Human motion quality and accuracy measuring method for human–robot physical interactions”, Intell Serv Robot 15 (4), 503–512 (2022).

25

X. Cheng, F. Zhang, and W. Dong, “Soft Conductive Hydrogel-Based Electronic Skin for Robot Finger Grasping Manipulation”, Polymers (Basel), 14 (19), (2022).

26

D. Marcuse, “Curvature loss formula for optical fibers”, J. Opt. Soc. Am., 66(3), 216–220, (1976).

27

M. Bullock, J. Borras, and A. M. Dollar, “Assessing assumptions in kinematic hand models: A review”, 2012 4th IEEE RAS & EMBS BioRob, 39–146 (2012).

28

Philipp and T. Rath, “Improving plant discrimination in image processing by use of different colour space transformations”, Computers and Electronics in Agriculture 35, 1-15 (2002).

29

Dibya Jyoti Bora, Anil Kumar Gupta, and Fayaz Ahmad Khan, “Comparing the Performance of L*A*B* and HSV Color Spaces with Respect to Color Image Segmentation”, ArXiv 5 (2), (2015)

30

A. Koschan and M.A. Abidi, Digital Color Image Processing. New Jersey, John Wiley & Sons, Inc (2007).

31

R. C. Gonzalez and R. E. Woods, Digital Image Processing. New Jersey, Pearson Prentice Hall. (2007).

32

A. Bar-Hillel, T. Hertz, N. Shental, and D. Weinshall, “Learning distance functions using equivalence relation”, In International Conference on Machine Learning (2003).

33

W. Yang, K. Wang, and W. Zuo, “Neighborhood component feature selection for high-dimensional data”, J Comput (Taipei) 7 (1), 162–168 (2012).

34

T. T. Wong and N. Y. Yang, “Dependency Analysis of Accuracy Estimates in k-Fold Cross Validation”, IEEE Trans Knowl Data Eng 29 (11), 2017.

35

T. Mitchell, Machine Learning. McGraw Hill (1997).

36

Christopher M. Bishop, Pattern Recognition and Machine Learning. Cambridge, Springer (2006).

37

P. A. Lachenbruch and M. Goldstein, “Discriminant Analysis”, Biometrics 35 (1), 69–85 (1979).

38

T. U. Rehman, M. S. Mahmud, Y. K. Chang, J. Jin, and J. Shin, “Current and future applications of statistical machine learning algorithms for agricultural machine vision systems”, Comput. Electron. Agric. 156. Elsevier B.V., 585– 605 (2019).

39

E. Frank and S. Lanteri, “Classification Models: Discriminant Analysis, SIMCA, CART”, Chemometrics Intell. Lab. Syst. 5, 241–256 (1989).

40

Richard O. Duda, Peter E. Hart, and David G. Stork, Pattern Classification. Wiley-Interscience (2012).

41

T. Hastie, R. Tibshirani, and J. Friedman, The elements of statistical learning: Data mining, inference and prediction. Springer (2009).

42

L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone, Classification and regression trees. U.K. (2017).

43

Z. H. Zhou, Machine Learning. Springer Nature (2021).

44

J. C. Burges, “A Tutorial on Support Vector Machines for Pattern Recognition,” 1998.

45

V. N. Vapnik, The Nature of Statistical Learning Theory. New York, Springer (2000).

46

L. Van der Maaten & E. Hinton. “Visualizing Data Using T-SNE”, Journal of Machine Learning Research 9 (86), 2579–605 (2008).