Extended Framework for Usability Testing in e-Navigation Systems

ABSTRACT: The paper presents the framework of usability testing of ECDIS equipment based on the IMO?s Guidelines on Software Quality Assurance and Human-centred Design for e-Navigation. By incorporating the eye tracking techniques into the procedure it was possible to measure the visual attention distribution and the cognitive work-load. The presented method could be used to evaluate usability of every e-navigation system, which is necessary to ensure that the seafarers are able to successfully perform primary operations of systems upgraded with e-navigation functions, regardless of the type and specifications of the system and users? knowledge and experience with the system. The initial results are presented and discussed as the study is still ongoing.

KEYWORDS: e-Navigation, e-Navigation Concept, e-Navigation Strategy, e-Navigation Implementation, Usability Testing, ECDIS (Electronic Chart Display and Information System)

REFERENCES

Ehmke, C., Wilson, S., Identifying web usability problems from eye-tracking data in Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 1 (BCS-HCI '07), Vol. 1. British Computer Society, 2007, Swinton, UK, pp. 119-128.

Endsley, M. R., Situation awareness global assessment technique (SAGAT). Proceedings of the National Aerospace and Electronics Conference (NAECON), pp. 789–795. New York: IEEE, 1988.

Endsley, M. R., Situation Awareness Oriented Design, In Lee, J. D. and Kirlik, A. (eds.), The Oxford Handbook of Cognitive Engineering. New York: Oxford University Press, 2013.

Goldberg, J.H., Kotval, X. P., Computer interface evaluation using eye movements: methods and constructs, International Journal of Industrial Ergonomics, vol. 24, no. 6, pp. 631–645, Oct. 1999.

Goldberg, J.H., Stimson, M.J., Lewenstein, M. Scott, N. & Wichansky, A.M., Eye tracking in web search tasks: design implications. In Proceedings of the Eye Tracking Research & Applications Symposium 2002. 51-58. New York, ACM.

Hart, S. G., NASA – Task Load Index (NASA–TLX) 20 Years Later, NASA-Ames Research Center Moffett Field, CA, 2006.

Holmqvist, K., Nyström, M., Andersson R., Dewhurst R., Jarodzka H., and van de Weijer J., Eye tracking: A comprehensive guide to methods and measures. Oxford University Press, Inc., 2011.

IMO MSC.1/Circ.1512, Guideline on Software Quality Assurance and Human-Centred Design for e-navigation, IMO, London, 2015.

IMO MSC.232(82), Revised ECDIS Performance Standards, IMO, London, 2006.

IMO SOLAS, International Convention for the Safety of Life at Sea, 1974, as amended, Consolidated Edition, IMO, London, 2014.

ISO 9421-110:2006, Ergonomics of human-system interaction – Part 110: Dialogue principles, ISO, 2009.

ISO/TR 16982:2002, Ergonomics of human-system interaction – Usability methods supporting human-centred design, ISO, 2002.

Jacob R. J. K. and Karn K. S., Commentary on Section 4. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises., in The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, Elsevier, 2003, pp. 573–605

Lützhöft, M., Dukic, T., Show me where you look and I'll tell you if you're safe: Eye tracking of maritime watchkeepers. Proceedings of the 39th Nordic Ergonomics Society Conference, 2007, Lysekil, Sweden

Muczyński B., Gucma M., Bilewski M., Zalewski P., Using eye tracking data for evaluation and improvement of training process in ship’s navigational bridge simulator. Scientific Journals Maritime University of Szczecin, 33(105), 2013, 75–78.

NASA, NASA Task Load Index (TLX) v. 1.0 Manual, NASA, NASA-Ames Research Center Moffett Field, 1986.

Papachristos, D., Koutsabasis, P., & Nikitakos, N., Usability evaluation at the ship’s bridge: A multi-method approach. 4th International Symposium on Ship Operations, Management and Economics., 2012, Athens, Greece.

Strandvall T., Eye Tracking in Human-Computer Interaction and Usability Research, in Human-Computer Interaction – INTERACT 2009, vol. 5727, T. Gross, J. Gulliksen, P. Kotzé, L. Oestreicher, P. Palanque, R. Prates, and M. Winckler, Eds. Springer Berlin Heidelberg, 2009, pp. 936–937.

Zalewski P., Tomczak A., Gralak R., Simulation Analysis of ECDIS’ Route Exchange Functionality Impact on Navigation Safety, The European Navigation Conference 2012, Gdańsk, 25-27.04.2012, Annual of Navigation 19/2012/part

Citation note:

Zalewski P., Muczyński B.: Extended Framework for Usability Testing in e-Navigation Systems. TransNav, the International Journal on Marine Navigation and Safety of Sea Transportation, Vol. 10, No. 1, doi:10.12716/1001.10.01.04, pp. 43-48, 2016

BibTeX EndNote

Authors in other databases:

Paweł Zalewski: ORCID iD icon

orcid.org/0000-0001-8157-9728 Scopus icon