Journal is indexed in following databases:
- SCOPUS
- Web of Science Core Collection - Journal Citation Reports
- EBSCOhost
- Directory of Open Access Journals
- TRID Database - Transportation Research Board
- Index Copernicus Journals Master List
- BazTech
- Google Scholar
2023 Journal Impact Factor - 0.7
2023 CiteScore - 1.4
ISSN 2083-6473
ISSN 2083-6481 (electronic version)
Editor-in-Chief
Associate Editor
Prof. Tomasz Neumann
Published by
TransNav, Faculty of Navigation
Gdynia Maritime University
3, John Paul II Avenue
81-345 Gdynia, POLAND
e-mail transnav@umg.edu.pl
A proposed Evidential Reasoning (ER) Methodology for Quantitative Assessment of Non-Technical Skills (NTS) Amongst Merchant Navy Deck Officers in a Ship’s Bridge Simulator Environment
1 Higher Colleges of Technology, Abu Zabi, United Arab Emirates
2 Liverpool John Moores University, Liverpool, United Kingdom
2 Liverpool John Moores University, Liverpool, United Kingdom
ABSTRACT: Ship’s bridge simulators are very popular in the worldwide training and assessment of merchant navy deck officers. The examiners of simulator courses presently do not have a method to quantitatively assess the performance of a group or an individual. Some examiners use checklists and others use their gut feeling to grade competence. In this paper a novel methodology is established that uses the Evidential Reasoning algorithm to quantitatively assess the Non-Technical Skills (NTS) of merchant navy officers. To begin with, interviews were conducted with experienced deck officers to develop the taxonomy and behavioural markers that would be used in the assessment process. A random selection of students studying towards their Chief Officer’s Certificate of Competency were recruited to have their NTS to be observed in a ship’s bridge simulator. The participant’s behaviour was rated against five criteria and the subsequent data was entered into the Evidential Reasoning algorithm to produce a crisp number. The results that were generated demonstrate that this approach provides a reliable method to quantitatively assess the NTS performance of merchant navy officers in a simulated bridge environment.
KEYWORDS: Non-Technical Skills (NTS), Evidential Reasoning (ER), Quantitative Assessment, Methodology for Quantitative Assessment, Merchant Navy Deck Officers, Ship's Bridge Simulator, Evidential Reasoning Algorithm, Simulated Bridge Environment
REFERENCES
Aull-Hyde, R., Erdogan, S. and Duke, J. D. (2006) An experiment on the consistency of aggregated comparison matrices in AHP. European journal of operational research, 171, pp. 290-295. - doi:10.1016/j.ejor.2004.06.037
Balci M. B. C., Tas, T., Hazar, A. I., Aydin, M., Onuk, O., Cakiroglu, B., Fikri, O., Ozkan, A. and Nuhoglu, B. (2014) Applicability and effectiveness of virtual reality simulator training in urology surgery: A double-blind randomised study. Noble medicus 29, 10 (2), pp. 66-71.
Coyle, G. (2004) The Analytic Hierarchy Process (AHP). Practical Strategy. Open Access Material. AHP. Pearson Education Limited.
Fletcher, G., Flin, R and Mcgeorge, P. (2003b) Interview study to identify anaesthetists’ non-technical skills. University of Aberdeen SCPMDE Project: RDNES/991/C.
Flin, R., Martin, L., Geosters, K., Hoermann, J., Amalberti, R., Valot, C., and Nijhuis, H. (2003) Development of the NOTECHS (Non-Technical Skills) system for assessing pilots’ CRM skills. Human Factors and Aerospace Safety, 3 (2), pp. 95-117.
Gatfield D., (2008) Behavioural markers for the assessment of competence in crisis management. PhD thesis, Southampton Solent University.
Helmreich, R. L., Merritt, A. C., and Wilhelm, J. A. (1999) The evolution of Crew Resource Management Training in commercial aviation. The International Journal of Aviation Psychology, 9(1), pp. 19-32. - doi:10.1207/s15327108ijap0901_2
Ishizaka, A. and Labib, A. (2009) Analytic Hierarchy Process and Expert Choice: Benefits and Limitation, OR Insight, 22(4), p201-220. - doi:10.1057/ori.2009.10
Klampfer, B., Flin, R. Helmreich R., Hausler, R., Fletcher, G., Field, P., Staender, S., Lauche, K., Dieckmann, A. and Amacher, A. (2001) Behavioural Markers Workshop. Group interaction in high risk environment (GIHRE) project. GIHRE-Aviation: Swiss Federal Institute of Technology (ETH) Zurich, Swiss training centre, 5-6 July 2001.
Kozuba, J. and Bondaruk, A. (2014) Flight simulator as an essential device supporting the process of shaping pilot’s situational awareness. International conference of scientific paper, AFASES 2014, Brasor, 22-24 May 2014, pp. 695-714.
Micheal, M., Abboudi, H., Ker, J., Khan, M. S., Dasgupta, P. and Ahmed, K. (2014) Performance of technology-driven simulators for medical students – A systemic review. Journal of surgical research, 192, pp. 531-543. - doi:10.1016/j.jss.2014.06.043
Mitchell L., Flin R., Yule S., Mitchell J., Coutts K. and Youngson G. (2013) Development of a behavioural marker system for scrub practitioners’ non-technical skills (SPLINTS system). Journal of evaluation in clinical practice, 19, pp.317-323. - doi:10.1111/j.1365-2753.2012.01825.x
Mohovic, R., Rudan, I. and Mohovic, D. (2012) Problems during simulator training in ship handling education. Scientific Journal of Maritime Research, 26 (1), pp.191-199.
Pelletier, S. (2006) The role of navigation simulator technology in marine pilotage. International Maritime Pilotage Association 18th Congress, Havana, Cuba, 23rd November 2006, pp. 1-5.
Riahi, R., Bonsall, S., Jenkinson, I. and Wang, J. (2012) A Seafarer’s reliability assessment incorporating subjective judgements. Journal of Engineering for the maritime environment, 226 (4), pp. 313-334. - doi:10.1177/1475090212438480
Saaty T. L. (1990) How to make decisions: The Analytic Hierarchy Process. European Journal of operational Research, 48 (1): pp. 9-26. - doi:10.1016/0377-2217(90)90057-I
Sniegocki, H. (2005) Impact of the usage of visual simulator on the students training results. Conference paper, International Conference on modelling and simulation general application and models in engineering science, Gdynia Maritime University.
Wall, A. D. (2015), Subject Head, LJMU, Interview, 27th May, 2015.
Wanger, R., Razek, V., Grafe, F., Berlarge, T., Janousek, J., Daehnert, I., and Weidenbach, M. (2013), Effectiveness of simulator-based echocardiography training of non-cardiologists in congenital heart diseases. Echocardiography, Wiley periodicals, Inc.DOI:10.1111/echo. 12118, pp. 693-698. - doi:10.1111/echo.12118
Winter, J. C. F, Dodou, D. and Mulder, M (2012) Training effectiveness of whole body flight simulator motion: A comprehensive EMta-Analysis. The International Journal of Aviation Psychology, 22(2), pp. 164-183. - doi:10.1080/10508414.2012.663247
Citation note:
Saeed F., Bury A., Bonsall S., Riahi R.: A proposed Evidential Reasoning (ER) Methodology for Quantitative Assessment of Non-Technical Skills (NTS) Amongst Merchant Navy Deck Officers in a Ship’s Bridge Simulator Environment. TransNav, the International Journal on Marine Navigation and Safety of Sea Transportation, Vol. 12, No. 3, doi:10.12716/1001.12.03.20, pp. 597-608, 2018
Other publications of authors:
File downloaded 472 times
