Conceptual framework for integrating BIM and augmented reality in construction management
Abstract
The need for systematic data collection and processing to generate real-time building site progress information is critical. Building Information Modelling (BIM) provides the benefit of aggregating information about the building site on a single platform. Augmented reality (AR) emerges to enhance BIM concerning visualization of the building site, through processing and automatic absorption of information. This work aims to analyse the potential of AR association to BIM, by adopting an approach based on literature review. Trends in contemporary research are checked by categorizing applied research methods, areas of expertise, and AR technologies. Publications produced between 2008 and 2018 from journals of architecture, engineering, and construction areas in databases Web of Science, SciSearch, SCOPUS, INSPEC, Google Scholar, Academic OneFile, EBSCO, OCLC, VINITI, SCImago, and ProQuest were investigated. As main results, it was found that the case study approach was adopted in 41% of the publications analysed. The building site inspection was the research object in 48% of papers. Fiducial markers, GIS/GPS, laser scanners, and photogrammetry emerged as main options for automatic data capture on the progress of the building site. Integration between AR and BIM has the potential to solve information processing problems and improving construction management.
Keyword : augmented reality, building information modelling, BIM, construction management, production planning and control, construction site control
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Azuma, R. T., Baillot, Y., Behringer, R., Feiner, S. K., Julier, S., & Macintyre, B. (2001). Recent advances in augmented reality. IEEE Computer Graphics and Applications, 21(6), 34-47. https://doi.org/10.1109/38.963459
Bae, H., Golparvar-Fard, M., & White, J. (2013). High-precision vision-based mobile augmented reality system for contextaware architectural, engineering, construction and facility management (AEC/FM) applications. Visualization in Engineering, (1), 3. https://doi.org/10.1186/2213-7459-1-3
Barazzetti, L., Banfi, F., Brumana, R., Oreni, D., Previtali, M., & Roncoroni, F. (2015). HBIM and augmented information: towards a wider user community of image and range-based reconstructions. In The 25th International CIPA Symposium “International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences”, Taipei, Taiwan. https://doi.org/10.5194/isprsarchives-XL-5-W7-35-2015
Behzadan, A. H., & Kamat, V. R. (2007). Georeferenced registration of construction graphics in mobile outdoor augmented reality. Journal of Computing in Civil Engineering, 21(4), 247-258. https://doi.org/10.1061/(ASCE)0887-3801(2007)21:4(247)
Behzadan, A. H., Timm, B. W., & Kamat, V. R. (2008). Generalpurpose modular hardware and software framework for mobile outdoor augmented reality applications in engineering. Advanced Engineering Informatics, 22, 90-105. https://doi.org/10.1016/j.aei.2007.08.005
Behzadan, A. H., Dong, S., & Kamat, V. R. (2015). Augmented reality visualization: A review of civil infrastructure system applications. Advanced Engineering Informatics, 29, 252-267. https://doi.org/10.1016/j.aei.2015.03.005
Behzadan, A. H., & Kamat, V. R. (2009). Automated generation of operations level construction animations in outdoor augmented reality. Journal of Computing in Civil Engineering, 23(6, Special Issue on Graphical 3D Visualization in Architecture, Engineering, and Construction), 405-417. https://doi.org/10.1061/(ASCE)0887-3801(2009)23:6(405)
Caudell, T. P., & Mizell, D. W. (1992). Augmented reality: An application of heads-up display technology to manual manufacturing processes. In Proceedings of Tweenty-Fifth Hawaii International Conference on System Sciences, 2, 659-669. Kauai, HI, USA. https://doi.org/10.1109/HICSS.1992.183317
Chalhoub, J., & Ayer, S. K. (2018). Using mixed reality for electrical construction design communication. Automation in Construction, 86, 1-10. https://doi.org/10.1016/j.autcon.2017.10.028
Chi, H. L., Chen, Y. C., Kang, S. C., & Hsieh, S. H. (2012). Development of user interface for tele-operated cranes. Journal of Advanced Engineering Informatics, 26(3), 641-652. https://doi.org/10.1016/j.aei.2012.05.001
Chi, H. L., Kang, S. C., & Wang, X. (2013). Research trends and opportunities of augmented reality applications in architecture, engineering, and construction. Automation in Construction, 33, 116-122. https://doi.org/10.1016/j.autcon.2012.12.017
Chu, M., Matthews, J., & Love, P. E. D. (2018). Integrating mobile building information modelling and augmented reality systems: An experimental study. Automation in Construction, 85, 305-316. https://doi.org/10.1016/j.autcon.2017.10.032
Clemente, J., & Cachadinha, N. (2012). Building information modelling como ferramenta de visualização de realidade aumentada em obras de reabilitação – um caso de estudo. In Congresso Construção 2012 – 4º Congresso Nacional, Coimbra, Portugal (in Portugese).
Cohen, L., Manion, L., & Morrison, K. (2007). Research methods in education (6th ed.). London and New York: Routledge, Taylor and Francis Group. https://doi.org/10.4324/9780203029053
Dong, S., & Kamat, V. R. (2013). Smart: scalable and modular augmented reality template for rapid development of engineering visualization applications. Visualization in Engineering, (1), 1. https://doi.org/10.1186/2213-7459-1-1
Dunston, P. S., & Wang, X. (2011). An iterative methodology for mapping mixed reality technologies to AEC operations. Journal of Information Technology in Construction, 16, 509-528.
El-Omari, S., & Moselhi, O. (2008). Integrating 3D laser scanning and photogrammetry for progress measurement of construction work. Automation in Construction, 18, 1-9. https://doi.org/10.1016/j.autcon.2010.12.001
Fan, R., & Liu, Y. (2011). Research on augmented reality interactive games. In 2011 Third Pacific-Asia Conference on Circuits, Communications and System (PACCS), Wuhan, China. https://doi.org/10.1109/PACCS.2011.5990152
Fazel, A., & Izadi, A. (2018). An interactive augmented reality tool for constructing free-form modular surfaces. Automation in Construction, 85, 135-145. https://doi.org/10.1016/j.autcon.2017.10.015
Feiner, S., Macintyre, B., Höllerer, T., & Webster, A. (1997). A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. In Proceedings of the 1st International Symposium on Wearable Computers (ISWC 1997) (pp. 74–81), Cambridge, MA, USA. https://doi.org/10.1109/ISWC.1997.629922
Fernandes, G. A. (2012). Augmented reality applied to inspection and maintenance activities in civil engineering (DSc thesis, Civil Engineering Postgraduate Program, COPPE), UFRJ, Brazil (in Portuguese).
Fernandes, G. A., Cunha, G. G., Lopes, C., & Mota, T. (2011). NAV? The advanced visualization station: a mobile computing center for engineering project support. In the 8th International Mediterranean and Latin American Modelling Multiconference (i3M 2011), Rome, Italy.
Friedrich, W., & Wohlgemuth, W. (2002). ARVIKA. Augmented reality for development, production and servicing. In Proceedings of International Symposium on Mixed and Augmented Reality, Darmstadt, Germany. https://doi.org/10.1109/ISMAR.2002.1115059
Golparvar-Fard, M., Peña-Mora, F., Arboleda, C. A., & Lee, S. H. (2009a). Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs. Journal of Computing in Civil Engineering, 23(6), 391-404. https://doi.org/10.1061/(ASCE)0887-3801(2009)23:6(391)
Golparvar-Fard, M., Peña-Mora, F., & Savarese, S. (2009b). D4AR-A 4-dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication. Electronic Journal of Information Technology in Construction, 14, 129-153.
Golparvar-Fard, M., Bohn, J., Teizer, J., Savarese, S., & Peña-Mora, F. (2011a). Evaluation of image-based modelling and laser scanning accuracy for emerging automated performance monitoring techniques. Automation in Construction, 20(8), 1143-1155. https://doi.org/10.1016/j.autcon.2011.04.016
Golparvar-Fard, M., Peña-Mora, F., & Savarese, S. (2011b). Integrated sequential as-built and as-planned representation with tools in support of decision-making tasks in the AEC/FM Industry. Journal of Construction Engineering and Management, 137(12), 1099-1116. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000371
Golparvar-Fard, M., Balali, V., & Garza, J. M. (2015). Segmentation and recognition of highway assets using image-based 3D point clouds and semantic texton forests. Journal of Computing in Civil Engineering, 29(1), 04014023. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000283
Grazina, J. F. L. (2013). Realidade Aumentada aplicada a BIM para a monitorização do progresso e controle de produção na Construção (MSc thesis). Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa (in Portugese). Retrieved from https://run.unl.pt/bitstream/10362/11005/1/Grazina_2013.pdf
Hakkarainen, M., Woodward, C., & Rainio, K. (2009). Software architecture for mobile mixed reality and 4D BIM interaction. In Proceedings of the 25th CIB W78 Conference, Istanbul, Turkey.
Hakkarainen, M., Woodward, C., & Rainio, K. (2010). Mobile augmented reality for building and construction. In Mobile World Conference (pp. 4-6), Barcelona, Spain.
Hamledari, H., Azar, E. R., & Mccabe, B. (2018). IFC-based development of as-built and as-is BIMs using construction and facility inspection data: Site-to BIM data transfer automation. Journal of Computing in Civil Engineering, 32(2), 04017075. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000727
Hammad, A., Wang, H., & Mudur, S. P. (2009). Distributed augmented reality for visualizing collaborative construction tasks. Journal of Computing in Civil Engineering, 23(6), 418-427. https://doi.org/10.1061/(ASCE)0887-3801(2009)23:6(418)
Hou, L., & Wang, X. (2013). A study on the benefits of augmented reality in retaining working memory in assembly tasks: A focus on differences in gender. Automation in Construction, 32, 38-45. https://doi.org/10.1016/j.autcon.2012.12.007
Hou, L., Wang, X., Bernold, L., & Love, P. E. D. (2013). Using animated augmented reality to cognitively guide assembly. Journal of Computing in Civil Engineering, 27(5), 439-451. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000184
Hou, L., Wang, X., & Truijens, M. (2015). Using augmented reality to facilitate piping assembly: An experiment-based evaluation. Journal of Computing in Civil Engineering, 29(1), 05014007. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000344
Irizarry, J., Gheisari, M., Williams, G., & Roper, K. (2014). Ambient intelligence environments for accessing building information. Facilities, 32(3/4), 120-138. https://doi.org/10.1108/F-05-2012-0034
Jiao, Y., Zhang, S., Li, Y., Wang, Y., & Yang, B. (2013). Towards cloud augmented reality for construction application by BIM and SNS integration. Automation in Construction, 33, 37-47. https://doi.org/10.1016/j.autcon.2012.09.018
Juan, M., C., Llop, E., Abad, F., & Lluch, J. (2010). Learning words using augmented reality. In the 10th IEEE International Conference on Advanced Learning Technologies, Sousse, Tunisia. https://doi.org/10.1109/ICALT.2010.123
Kim, H. S., Kim, S. K., Borrmann, A., & Kang, L. S. (2017). Improvement of realism of 4D objects using augmented reality objects and actual images of a construction site. KSCE Journal of Civil Engineering, 22(8), 2735-2746. https://doi.org/10.1007/s12205-017-0734-3
Kirner, C., Zorzal, E. R., & Kirner, T. G. (2006). Case studies on the development of games using augmented reality. In Proceedings of 2006 IEEE International Conference on Systems, Man, and Cybernetics (pp. 14-19), Taipei, Taiwan.
Kiziltas, S., Akinci, B., Ergen, E., & Tang, P. (2008). Technological assessment and process implications of field data capture technologies for construction and facility/infrastructure management. Journal of Information Technology in Construction, 13, 134-154.
Klinker, G., Stricker, D., & Reiners, D. (2001). Augmented reality for exterior construction applications. In W. Barfield (Ed.), Augmented reality and wearable computers (pp. 379-427). Lawrence Eribaum Press.
Kopsida, M., & Brilakis, L. (2016). Markerless BIM registration for mobile augmented reality based Inspection. In Proceedings of Sixteenth International Conference on Computing in Civil and Building Engineering (ICCCBE2016), Osaka, Japan.
Kwon, O., Park, C., & Lim, C. (2014). A defect management system for reinforced concrete work utilizing BIM, imagematching and augmented reality. Automation in Construction, 46, 74-81. https://doi.org/10.1016/j.autcon.2014.05.005
Le, Q. T., Pedro, A., Lim, C. R., Park, H. T., Park, C. S., & Kim, H. K. (2015). A framework for using mobile based virtual reality and augmented reality for experiential construction safety education. International Journal of Engineering Education, 31(3), 713-725.
Lee, S. Y., Kwon, S. W., & Ko, T. K. (2017). AR (Augmented reality) based 3D workspace modelling for quality assessment using as-built on-site condition in remodelling construction project. In Proceedings of the 34th International Symposium on Automation and Robotics in Construction (ISARC 2017), Taipei, Taiwan. https://doi.org/10.22260/ISARC2017/0024
Leite, F., Cho, Y., Behzadan, A. H., Lee, S., Choe, S., Fang, Y., Akhavian, R., & Hwang, S. (2016). Visualization, information modelling, and simulation: Grand challenges in the construction industry. Journal of Computing in Civil Engineering, 30(6), 04016035. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000604
Loomis, J., Golledge, R., & Klatzky, R. (1993). Personal guidance system for the visually impaired using GPS, GIS, and VR technologies. In Proceedings of Conference on Virtual Reality and Persons with Disabilities, Millbrae, CA, USA. https://doi.org/10.1145/191028.191051
Li, X., Yi, W., Chi, H., Wang, X., & Chan, A. P. C. (2018). A critical review of virtual and augmented reality (VR/AR) applications in construction safety. Automation in Construction, 86, 150-162. https://doi.org/10.1016/j.autcon.2017.11.003
Liarokapis, F. (2007). An augmented reality interface for visualizing and interacting with virtual content. Virtual Reality, 11, 23-43. https://doi.org/10.1007/s10055-006-0055-1
Martins, F. M. M. (2014). Novas utilizações das potencialidades BIM – produção de informação as-built e apoio à medição de trabalhos realizados com recurso a Realidade Aumentada (MSc thesis). Faculdade de Ciências e Tecnologia, Universidade Nova de Lisboa, Portugal (in Portugese). Retrieved from http://hdl.handle.net/10362/12468
Meža, S., Turk, Z., & Dolenc, M. (2014). Component based engineering of a mobile BIM-based augmented reality system. Automation in Construction, 42, 1-12. https://doi.org/10.1016/j.autcon.2014.02.011
Nagy, M. V. (2013). Utilizing building information models with mobile augmented reality and location-based services (MSc thesis in Informatics). Department of Computer and Information Science, Norwegian University of Science and Technology, Norway. Retrieved from http://ibim.no/student/2013_NTNU_Martin_Victor_Nagy/2013_NTNU_Martin_Victor_Nagy.pdf
Olbrich, M., Graf, H., Kahn, S., Engelke, T., Keil, J., Riess, P., Webel, S., Bockholt, U., & Picinbono, G. (2013). Augmented reality supporting user-centric building information management. Visual Computer, 29(10), 1093-1105. https://doi.org/10.1007/s00371-013-0840-2
Park, C. S., Lee, D. Y., Kwon, O. S., & Wang, X. (2013). A framework for proactive construction defect management using BIM, augmented reality and ontology-based data collection template. Automation in Construction, 33, 61-71. https://doi.org/10.1016/j.autcon.2012.09.010
Peres, F. F. F., Scheer, S., Faria, E. F., & Vian, D. (2015). Realidade aumentada para o acesso à instrumentação da barragem de Itaipu. In XXX - Seminário Nacional de Grandes Barragens, Comitê Brasileiro de Barragens, Foz do Iguaçu-PR, Brazil (in Portugese).
Rankohi, S., & Waugh, L. (2013). Review and analysis of augmented reality literature for construction industry. Visualization in Engineering, (1), 9. https://doi.org/10.1186/2213-7459-1-9
Schall, G., Mendez, E., Kruijff, E., Veas, E., Junghanns, S., Reitinger, B., & Schmalstieg, D. (2009). Handheld augmented reality for underground infrastructure visualization. Personal and Ubiquitous Computing, 13(4), 281-291. https://doi.org/10.1007/s00779-008-0204-5
Schall, G., Zollmann, S., & Reitmayr, G. (2013). Smart Vidente: Advances in mobile augmented reality for interactive visualization of underground infrastructure. Personal and Ubiquitous Computing, 17(7), 1533-1549. https://doi.org/10.1007/s00779-012-0599-x
Shin, D. H., & Dunston, P. S. (2010). Technology development needs for advancing augmented reality-based inspection. Automation in Construction, 19, 169-182. https://doi.org/10.1016/j.autcon.2009.11.001
Shin, D. H., Park, J., Woo, S., & Jang, W. S. (2013). Representations for imagining the scene of non-existing buildings in an existing environment. Automation in Construction, 33, 86-94. https://doi.org/10.1016/j.autcon.2012.09.013
Shirazi, A., & Behzadan, A. H. (2015). Design and assessment of a mobile augmented reality-based information delivery tool for construction and civil engineering curriculum. Journal of Professional Issues in Engineering Education and Practice, 141(3), 04014012. https://doi.org/10.1061/(ASCE)EI.1943-5541.0000229
Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R., & Pentland, A. (1997). Augmented reality through wearable computing. Presence Teleoperators & Virtual Environments 6(4), 386-398. https://doi.org/10.1162/pres.1997.6.4.386
Sutherland, I. A. (1968). Head-mounted three-dimensional display. In Proceedings of the Fall Joint Computer Conference (pp. 758-763), Washington, DC, USA. https://doi.org/10.1145/1476589.1476686
Vogt, S., Khamene, A., & Frank, S. (2006). Reality augmentation for medical procedures: System architecture, single camera marker tracking, and system evaluation. International Journal of Computer Vision, 70(2), 179-190. https://doi.org/10.1007/s11263-006-7938-1
Wang, X. (2009). Augmented reality in architecture and design: potentials and challenges for application. International Journal of Architectural Computing, 7(2), 309-326. https://doi.org/10.1260/147807709788921985
Wang, X., & Dunston, P. (2007). Design, strategies, and issues towards an augmented reality-based construction training platform. Journal of Information Technology in Construction (ITcon), 12, 363-380.
Wang, X., & Love, P. E. D. (2012). BIM + AR: Onsite information sharing and communication via advanced visualization. In Proceedings of the 2012 IEEE 16th International Conference on Computer Supported Cooperative Work in Design (CSCWD) (pp. 850-855), Wuhan, China. https://doi.org/10.1109/CSCWD.2012.6221920
Wang, X., Kim, M. J., Love, P. E. D., & Kang, S. C. (2013a). Augmented reality in built environment: classification and implications for future research. Automation in Construction, 32, 1-13. https://doi.org/10.1016/j.autcon.2012.11.021
Wang, X., Love, P. E. D, Kim, M. J., Park, C. S., Sing, C. P., & Hou, L. (2013b). A conceptual framework for integrating building information modelling with augmented reality. Automation in Construction, 34, 37-44. https://doi.org/10.1016/j.autcon.2012.10.012
Wang, J., Wang, X., Shou, W., & Xu., B. (2014a). Integrating BIM and augmented reality for interactive architectural visualisation. Construction Innovation, 14(4), 453-476. https://doi.org/10.1108/CI-03-2014-0019
Wang, X., Truijens, M., Hou, L., Wang, Y., & Zhou, Y. (2014b). Integrating augmented reality with building information modeling: Onsite construction process controlling for liquefied natural gas industry. Automation in Construction, 40, 96-105. https://doi.org/10.1016/j.autcon.2013.12.003
Williams, G., Gheisari, M., Chen, P., & Irizarry, J. (2015). Bim2mar: An efficient BIM translation to mobile augmented reality applications. Journal of Management in Engineering, 31(1), A4014009. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000315
Woodward, C., & Hakkarainen, M. (2011). Mobile mixed reality system for architectural and construction site visualization. VTT Technical Research Centre of Finland. https://doi.org/10.5772/26117
Yeh, K., Tsai, M., & Kang, S. (2012). On-site building information retrieval by using projection-based augmented reality. Journal of Computing in Civil Engineering, 26(3), 342-356. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000156
Zhou, F., Duh, H. B. L., & Billinghurst, M. (2008). Trends in augmented reality tracking, interaction and display: a review of ten years of ISMAR. In Proceedings of 7th IEEE International Symposium on Mixed and Augmented Reality (pp. 193-202), Cambridge, UK.
Zhou, Y., Luo, H., & Yang, Y. (2017). Implementation of augmented reality for segment displacement inspection during tunnelling construction. Automation in Construction, 82, 112-121. https://doi.org/10.1016/j.autcon.2017.02.007