Fotónica aplicada a la virtualización del patrimonio cultural

M.M. Morita, D.A. Loaiza Carvajal, G.M. Bilmes


Descargar artículo

Información básica

Volumen

V56 - N2 / 2023 Especial: Óptica y Fotónica en Argentina

Referencia

51146

DOI

http://dx.doi.org/10.7149/OPA.56.2.51146

Idioma

Spanish

Etiquetas

Fotónica y patrimonio cultural, fotogrametría 3D, virtualización, realidad aumentada.

Resumen

Se presenta una breve revisión del estado del arte de las aplicaciones de la fotónica para la virtualización del patrimonio cultural, centradas principalmente en técnicas de registro y digitalización 3D, realidad virtual y realidad aumentada. Se muestran algunas de las contribucionesdel LALFI-CIOp. Estas son: el mejoramiento de la resolución y la exactitud de las reconstrucciones 3D mediante el uso de speckle, o la combinación de fotogrametría con Structure from Motion e imágenes por transformación de reflectancia; el desarrollo de sistemas de bajo costo para su empleo en museose instituciones culturales y aplicaciones de realidad virtual y aumentada para la difusión del patrimonio cultural. Finalmente, se discute una experiencia de transferencia de la tecnología dedigitalización 3D a varios museos e instituciones de Argentina y se presentan algunas propuestas para ampliar el uso de las tecnologías de la luz en este campo.

Referencias

1

J. F. Asmus, G. Guattari, L. Lazzarini, G. Musumeci, R. F. Wuerker, “Holography in the Conservation of Statuary,” Studies in Conservation, 18(2), 49–63 (1973).

2

J. F. Asmus, “Light for Art Conservation,” Interdisciplinary Science Reviews, 12(2), 171–179 (1987).

3

J.S. Pozo-Antonio, T. Rivas, A.J. López, M.P. Fiorucci, A. Ramil, “Effectiveness of granite cleaning procedures in cultural heritage: A review,” Science of The Total Environment, Volume 571, 2016, 1017-1028 (2016).

4

Boris Lukyanchuk. (Ed.) and International Workshop on Laser Cleaning. Laser Cleaning: Optical Physics Applied Physics and Materials Science. River Edge N.J: World Scientific (2002).

5

M. Bertasa, C. Korenberg, “Successes and challenges in laser cleaning metal artefacts: A review,” Journal of Cultural Heritage, Volume 53, 2022, 100-117 (2022).

6

L. Pereira-Pardo, C. Korenberg, “The use of erbium lasers for the conservation of cultural heritage. A review,” Journal of Cultural Heritage, Volume 31, Pages 236-247 (2018).

7

C. Wang, Y. Cao, F. Tie, M. Camaiti, “Er:YAG Laser Cleaning of Painted Surfaces: Functional Considerations to Improve Efficacy and Reduce Side Effects,” Coatings, 11(11):1315 (2021).

8

B. Borg, M. Dunn, A. Ang, and C. Villis, "The application of state-of-the-art technologies to support artwork conservation: Literature review," J. Cult. Herit. 44, 239–259 (2020).

9

A. T. Taylor, E.P.C. Lai, “Current State of Laser-Induced Fluorescence Spectroscopy for Designing Biochemical Sensors,” Chemosensors, 9, 275 (2021).

10

F. Ruan, T. Zhang, H. Li, “Laser-induced breakdown spectroscopy in archeological science: a review of its application and future perspectives,” Applied Spectroscopy Reviews, 54:7, 573-601 (2019).

11

S. Paoloni, F. Mercuri, N. Orazi, G. Caruso, U. Zammit, "Photothermal approach for cultural heritage research," J. Appl. Phys. 128 (2020).

12

C. M. Freisztav, A. Orsetti, G. M. Bilmes, “Aplicaciones del láser en limpieza y eliminación de manchas sobre papel,” Proceedings of “Seminario Iberoamericano sobre procesamiento de materiales por láser, Programa de materiales. Red CyTED (Editors: F. Audebert y S. Suhalde), Edited by Facultad de Ingeniería University of Buenos Aires, Argentina, 1, 5p (1999).

13

G. M. Bilmes, C. Freisztava, D. Schinca, A. Orsetti, “Cleaning and characterization of objects of cultural value by laser ablation,” Optical Methods for Arts and Archaeology. Salimbeni, Renzo; Pezzati, Luca. (Eds.) Proceedings of the SPIE, Volume 5857, 19-25 (2005).

14

G. M. Bilmes, C. M. Freisztav, N. Cap, H. Rabal, A.Orsetti, “Laser cleaning of 19th century papers and manuscripts assisted by digital image processing,” Lasers in the Conservation of Artworks, Castillejo et all. (EDS). Taylor & Francis Group, London, 361-365 (2008).

15

G. M. Bilmes, J. Vallejo. C. C. Vera, M. E. García, “High efficiencies for laser cleaning of glassware irradiated from the back: application to glassware historical objects,” Appl. Phys. A 124, 4, 347 (2018).

16

M. M. Morita, G. M. Bilmes, “Laser Cleaning applied to metal, wooden and plaster objects,” Proceeding of APLAR 6 Aplicazioni laser nel restauro. A. Brunetto, G. Lanterna, B. Mazzei (Eds.) 553-559 (2019).

17

F. C. Alvira, F. Ramirez Rozzi, G. M. Bilmes, “Laser-Induced Breakdown Spectroscopy Microanalysis of Trace Elements in Homo sapiens Teeth,” Applied Spectroscopy 64 (3) 313-319 (2010).

18

F. C. Alvira, F. Ramirez Rozzi, G. A. Torchia, L. Roso, G. M. Bilmes, “A new method for relative Sr determination in human teeth enamel,” Journal of Anthropological Sciences, Vol. 89, 1-12 (2011).

19

G. M. Bilmes, F. C. Alvira, N. Perez Zoloza, A. Orsetti, “Libs analysis and laser cleaning of metal objects rescued from the corvette h.m.s. SWIFT,” In LACONA IX Proccedeings. Archetype Publications Ltd. Fitzroy Square, London, 179-181 (2012).

20

L. Zilio, M. M. Morita, G. M. Bilmes, “Composition and possible provenance of metallic archaeological objects found in Patagonia Argentina,” Journal of Archaeological Science: Reports 33, 102575 (2020).

21

G. Pavlidis, A. Koutsoudis, “3D Digitization of Tangible Heritage,” In: D'Amico, S., Venuti, V. (Eds) Handbook of Cultural Heritage Analysis. Springer, Cham. (2022).

22

L. Acke, K. De Vis, S. Verwulgen, J. Verlinden, "Survey and literature study to provide insights on the application of 3D technologies in objects conservation and restoration,” Journal of Cultural Heritage, Volume 49, 272-288 (2021).

23

M. Andruchow, M. M. Morita, A. Delucchi, “Estudio histórico y recreación virtual 3D del Panteón de los Ciudadanos Meritorios Cementerio de la Recoleta de Carlo Zucchi,” Estudios Del hábitat, 18(1), 082 (2020).

24

P. Perakis, C. Schellewald, K. F. Kebremariam, T. Theoharis, "Simulating Erosion on Cultural Heritage Monuments," International Conference on Cultural Heritage and New Technologies, Vienna, 1–21 (2015).

25

F. I. Apollonio, V. Basilissi, M. Callieri, M. Dellepiane, M. Gaiani, F. Ponchio, G. Sobra, “A 3D-centered information system for the documentation of a complex restoration intervention,” Journal of Cultural Heritage, 29, 89–99 (2018).

26

P. Mavridis, I. Sipiran, A. Andreadis, G. Papaioannou, “Object Completion using k-Sparse Optimization,” Computer Graphics Forum, The Eurographics Association and John Wiley & Sons Ltd., Volume 34, Number 7 (2015).

27

D. Abate, "FRAGMENTS A fully automatic photogrammetric fragments recomposition workflow," J. Cult. Herit. 47, 155–165 (2021).

28

L. Arbace, E. Sonnino, M. Callieri, M. Dellepiane, M. Fabbri, A. Iaccarino Idelson, R. Scopigno, “Innovative uses of 3D digital technologies to assist the restoration of a fragmented terracotta statue,” Journal of Cultural Heritage, Volume 14, Issue 4, 332-345 (2013).

29

C. Balletti, M. Ballarin, F. Guerra, "3D printing: State of the art and future perspectives," J. Cult. Herit. 26, 172–182 (2017).

30

Digital Repository of the Laboratorio de Ablación Láser, Fotofísica e Imágenes 3D (LALFI) of the Centro de Investigaciones Ópticas (CIOp) Available in: https://lalficiop.cic.gba.gob.ar/objetos-digitalizados/

31

P. Pistofidis, F. Arnaoutoglou, G. Ioannakis, N. Michailidou, M. Karta, C. Kiourt, G. Pavlidis, S. G. Mouroutsos, D. Tsiafaki, A. Koutsoudis, “Design and evaluation of smart-exhibit systems that enrich cultural heritage experiences for the visually impaired,” Journal of Cultural Heritage, Volume 60, 1-11 (2023).

32

E. Y. Putra, A. K. Wahyudi, C. Dumingan, “A proposed combination of photogrammetry, Augmented Reality and Virtual Reality Headset for heritage visualization,” 2016 International Conference on Informatics and Computing (ICIC) (2016).

33

G. Sansoni, M. Trebeschi, F. Docchio, "State-of-the-art and applications of 3D imaging sensors in industry, cultural heritage, medicine, and criminal investigation," Sensors 9, 568–601 (2009).

34

E. Adamopoulos, F. Rinaudo, L. Ardissono, "A Critical Comparison of 3D Digitization Techniques for Heritage Objects," Int. J. Geo-Information 10 (2021)

35

A. Georgopoulos, E. K. Stathopoulou, “Data Acquisition for 3D Geometric Recording: State of the Art and Recent Innovations,” In Heritage and Archaeology in the Digital Age; Vincent, M.L., López-Menchero Bendicho, V.M., Ioannides, M., Levy, T.E., Eds.; Springer International Publishing: Cham, Switzerland, 1–26 (2017).

36

F. Hassani, “Documentation of cultural heritage; techniques, potentials, and constraints,” Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2015, XL-5/W7, 207–214 (2015)

37

A. Kaneda, T. Nakagawa, K. Tamura, K. Noshita, and H. Nakao, "A proposal of a new automated method for SfM/MVS 3D reconstruction through comparisons of 3D data by SfM/MVS and handheld laser scanners," PLoS One 17, (2022)

38

E. Agosto, P. Ardissone, L. Bornaz, F. Dago, “3D Documentation of Cultural Heritage: Design and Exploitation of 3D Metric Surveys,” In Applying Innovative Technologies in Heritage Science; Pavlidis, G., Ed.; Advances in Religious and Cultural Studies; IGI Global: Hershey, PA, USA, 1–15 (2020).

39

V. Mousavi, M. Khosravi, M. Ahmadi, N. Noori, S. Haghshenas, A. Hosseininaveh, M. Varshosaz, “The Performance Evaluation of Multi-Image 3D Reconstruction Software with Different Sensors,” Measurement, 120, 1–10 (2018).

40

I. Kadhim, F. M. Abed, "A Critical Review of Remote Sensing Approaches and Deep Learning Techniques in Archaeology," Sensors 23(6), 2918 (2023)

41

Z. Chen, W. Zhang, R. Huang, Z. D-ong, C. Chen, L. Jiang, H. Wang, “3D model-based terrestrial laser scanning (TLS) observation network planning for large-scale building facades,” Automation in Construction, Volume 144, (2022).

42

Y. Li, L. Zhao, Y. Chen, N. Zhang, H. Fan, Z. Zhang, "3D LiDAR and multi-technology collaboration for preservation of built heritage in China: A review," Int. J. Appl. Earth Obs. Geoinf. 116, 103156 (2023).

43

F. Remondino, M.G. Spera, E. Nocerino, F. Menna, F. Nex, “State of the art in high density image matching,” The Photogrammetric Record, 29(146), 144-166 (2014).

44

T. Van Damme, “Computer Vision Photogrammetry for Underwater Archaeological Site Recording,” University of Southern Denmarck, 2015

45

M. M. Morita, D. A. Loaiza Carvajal, G. M. Bilmes, “New Photogrammetric Systems for Easy Low-Cost 3D Digitization of Cultural Heritage,” In: D'Amico S., Venuti V. (eds) Handbook of Cultural Heritage Analysis. Springer, Cham. (2022)

46

C. Marín-Buzón, A. Pérez-Romero, J. L. López-Castro, I. Ben Jerbania, F. Manzano-Agugliaro, "Photogrammetry as a New Scientific Tool in Archaeology: Worldwide Research Trends," Sustainability 13, 1–27 (2021).

47

M. M. Morita, G. M. Bilmes, “Applications of low-cost 3D imaging techniques for the documentation of heritage objects,” Optica Pura y Aplicada. 51 (2) 50026:1-11 (2018)

48

A. Shalaby, M. Elmogy, A. Abo El-Fetouh, "Algorithms and Applications of Structure from Motion (SFM): A Survey," Int. J. Comput. Inf. Technol. 358 (2017).

49

F. Remondino, E. Nocerino, I. Toschi, F. Menna, "A critical review of automated photogrammetric processing of large datasets," in The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLII-2/W5, 2017 26th International CIPA Symposium 2017, 28 August–01 September 2017, Ottawa, Canada (The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2017), Vol. XLII, pp. 591–599 (2017).

50

S. Bianco, G. Ciocca, D. Marelli, "Evaluating the performance of structure from motion pipelines," J. Imaging 4, 1–18 (2018).

51

H. Rahaman, E. Champion, “To 3D or not 3D: choosing a photogrammetry workflow for cultural heritage groups,” Heritage 2(3):1835–1851 (2019).

52

R. Niederheiser, M. Mokroš, J. Lange, H. Petschko, G. Prasicek, S.O. Elberink, “Deriving 3D point clouds from terrestrial photographs-comparison of different sensors and software,” Int Arch Photogramm Remote Sens Spat Inf Sci ISPRS Arch 41:685–692 (2016).

53

J. H. R. Burns, D. Delparte, “Comparison of commercial structure-from-motion photogrammety software used for underwater three-dimensional modeling of coral reef environ-ments,” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 42(2)/W3. 3D virtual reconstruction and visualization of complex architectures, 1–3 March 2017, Nafplio, Greece (2017).

54

F. Alidoost, H. Arefi H, “Comparison of UAS-based photogrammetry software for 3D point cloud generation: a survey over a historical site,” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 4(4)/W4. 4th international GeoAdvances workshop, 14–15 October 2017, Safranbolu, Karabuk, Turkey (2017).

55

D. Sims-Waterhouse, P. Bointon, S. Piano, R. K. Leach, “Experimental comparison of photogrammetry for additive manufactured parts with and without laser speckle projection,” In P. Lehmann, W. Osten, & A. A. G. Jr (Eds.), Optical Measurement Systems for Industrial Inspection X. Proc. of SPIE Vol. (Vol. 10329, p. 103290W) (2017).

56

D. Sims-Waterhouse, P. Bointon, S. Piano, R. K. Leach, “Verification of micro-scale photogrammetry for smooth three-dimensional object measurement,” Measurement Science and Technology, 28(5), 7 pp. (2017).

57

D. Khan, M. A. Shirazi, M. Y. Kim, “Single shot laser speckle based 3D acquisition system for medical applications,” Optics and Lasers in Engineering, 105, 43–53 (2018).

58

A. Koutsoudis, G. Ioannakis, C. Chamzas, “Using noise function-based patterns to enhance photogrammetric 3D reconstruction performance of featureless surfaces,” Journal of Cultural Heritage, 16, 664–670 (2015).

59

S. A. K. Tareen, Z. Saleem, “A comparative analysis of SIFT, SURF, KAZE, AKAZE, ORB, and BRISK.”. 2018 International Conference on Computing, Mathematics and Engineering Technologies: Invent, Innovate and Integrate for Socioeconomic Development, ICoMET 2018 - Proceedings, 2018-January, 1–10 (2018).

60

C. Li, Y. Yang, K. He, S. Lin, J. Hopcrof, “Single Image Reflection Removal through Cascaded Refinement,” Computer Science 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 15 November 2019.

61

Y. Shih, D. Krishnan, F. Durand, W. T. Freeman, "Reflection removal using ghosting cues," 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 3193-3201 (2015).

62

X. Zhang, R. Ng, Qifeng Chen, “Single image reflection separation with perceptual losses,” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4786–4794 (2018).

63

K. Wei, J. Yang, Y. Fu, D. Wipf, H. Huang, “Single image reflection removal exploiting misaligned training data and network enhancements,” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 8178–8187 (2019).

64

T. Malzbender, D. Gelb, H. Wolters, “Polynomial Texture Maps,” Proc. 28th Annu. Conf. Comput. Graph. Interact. Tech. - SIGGRAPH '01, 519–528 (2001).

65

G. Palma, M. Corsini, P. Cignoni, R. Scopigno, M. Mudge, “Dynamic shading enhancement for reflectance transformation imaging,” J. Comput. Cult. Herit. 3, 1–20 (2010).

66

T. Çapar, B. Eberhardt, H. Gürçay, "Improving the Use of Reflectance Transformation Imaging for Material Culture," Eurasia Graphics (2020).

67

J. Min, S. Jeong, K. Park, Y. Choi, D. Lee, J. Ahn, D. Har, S. Ahn, "Reflectance transformation imaging for documenting changes through treatment of Joseon dynasty coins," Herit. Sci. 9, 1–13 (2021).

68

Cultural Heritage Imaging (CHI): http://culturalheritageimaging.org/

69

M. M. Morita, F. Novoa, G. M. Bilmes, “Reflectance transformation imaging. First applications in cultural heritage in Argentina,” Journal of Archaeological Science: Reports., Vol 26 (2019).

70

M. Hughes-Hallett, C. Young, P. Messier, “A Review of RTI and an Investigation into the Applicability of Micro-RTI as a Tool for the Documentation and Conservation of Modern and Contemporary Paintings,” Journal of the American Institute for Conservation, 60(1), 18–31 (2021).

71

S. Florindi, A. Revedin, B. Aranguren, V. Palleschi, "Application of reflectance transformation imaging to experimental archaeology studies," Heritage 3, 1279–1286 (2020).

72

J. Miles, Mike Pitts, Hembo Pagi, G. Earl, "Photogrammetry and RTI Survey of Hoa Hakananai’a Easter Island Statue," in Across Space and Time. Papers from the 41st Conference on Computer Applications and Quantitative Methods in Archaeology, Perth, 25-28 March 2013 (2017).

73

A. Pamart, F. Ponchio, V. Abergel, A. Alaoui M’Darhri, M. Corsini, M. Dellepiane, F. Morlet, R. Scopigno, L. De Luca, "A complete framework operating spatially-oriented RTI in a 3D/2D cultural heritage documentation and analysis tool," in The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XLII-2/W9, 2019 8th Intl. Workshop 3D-ARCH “3D Virtual Reconstruction and Visualization of Complex Architectures”, 6–8 February 2019, Bergamo, Italy, Vol. 42, 573–580 (2019).

74

X. Aure, P. J. O’Dowd, J. Padfield, "Generating 3D Models of Paintings through the Combination of 2D, 3D and RTI Data," Proceeding of Electronic Visualisation and the Arts (EVA 2017) (EVA), 1–8 (2017).

75

E. Frank, S. Heath, C. Stein, "Integration of Photogrammetry, Reflectance Transformation Imaging (RTI), and Multiband Imaging (MBI) for Visualization, Documentation, and Analysis of Archaeological and Related Materials," in ISAW Papers 21 (2021).

76

M. M. Morita, D. A. Loaiza Carvajal, G. M. Bilmes, “Resolution enhancement of 3D photogrammetric recordings by using Reflectance Transformation Imaging”. To be published.

77

H. Ayteki̇n, N. Koçak, MÜZELERDE ARTIRILMIŞ GERÇEKLİK UYGULAMALARI: SAKIP SABANCI MÜZESİ ÖRNEĞİ, Dokuz Eylül Üniversitesi İşletme Fakültesi Dergisi, 255–274 (2020).

78

M. Trunfio, M. D. Lucia, S. Campana, A. Magnelli, “Innovating the cultural heritage museum service model through virtual reality and augmented reality: The effects on the overall visitor experience and satisfaction,”. Journal of Heritage Tourism, 17(1), 1–19 (2022).

79

D. Marques, The visitor experience using augmented reality on mobile devices in museum exhibitions. University of Porto, Porto. (2017, July 7).

80

K. P. Martinez, M. Z. G Untalan, D. F. M. Burgos, R. V. Ramos, M. J. Q. Germentil, “Creation of a virtual reality environment of a university museum using 3D photogrammetric models,” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W13, 841–847 (2019).

81

D. A. Loaiza Carvajal, M. M. Morita, G. M. Bilmes, “Virtual museums. Captured reality and 3D modeling,” Journal of Cultural Heritage, Volume 45, September–October 2020, 234-239 (2020).

82

“Virtual Museums” web virtual tour. Available in: https://www.proyectosciop.unlp.edu.ar/mu3d/Colecciones%20Virtuales%20Web/

83

“Krause: Vestigios Disponibles” web virtual tour. Available in: https://www.proyectosciop.unlp.edu.ar/mu3d/Krause%20Web/

84

Amenmose Project (IdIHCS, CONICET-UNLP). Web virtual tour available in: https://lalfi.github.io/Amenmose/

85

D. A. Loaiza Carvajal, M. M. Morita, G. M. Bilmes, “Augmented Reality and Ubiquitous Objects”. To be published.