
499 
Possible lines of research that we envision for the 
further development of the method are an improved 
selection of search directions and step sizes when 
updating model parameters from gradients. 
As we saw above the algorithm somewhat suffers 
from diminishing gradients along the path especially 
when avoiding a crossing obstacle. Necessary changes 
in the controlling inputs only slowly propagate from 
the end of the trajectory to the early phases. We want 
to investigate how this can be overcome by selecting a 
sufficient initial trajectory. 
Additionally, we want to increase the speed of 
convergence in general. To accomplish this, we will 
have a look at different optimizations algorithm like 
Stochastic Gradient Descent (SGD) [1, 5, 9] and Adam 
(using adaptive moment estimation) [6]. 
For the purpose of evaluating and validating our 
autonomous movement planning algorithm, it should 
be connected to a ship handling simulator, that uses 
its own physical model and includes process and 
measurement noise. While directing the ship towards 
its goal, the planning algorithm would then be run 
iteratively to re-plan future movements and 
controlling inputs from the current state (which 
advances continuously), while using a method to 
repeatedly estimate the vessels state and parameters. 
The overall program, incorporating our 
autonomous movement planning, will have to 
repeatedly estimate position, speed, heading and turn 
rate, while the algorithms parameters to be estimated 
include the vessel's weight (and distribution), 
draught, momentum of inertia as well as external 
influences like water currents. 
Of course, the ship will need updated estimates for 
the position, speed and heading of other vessels to 
take their future trajectories into account. This could 
be improved upon by having multiple ships interact 
with each other cooperatively - for example by using 
planning algorithms that inform each other about 
their planned trajectory and finding optimal 
trajectories for all ships involved.   
When optimising the motion behaviour of a single 
ship, the local environment, the specific dynamic 
motion model und the engine states can be considered 
to find an optimal path or trajectory. The COLREGs 
(Collision avoidance regulations) have to be part of 
the applied algorithms to integrate an automatically 
controlled vehicle into the local traffic situation with a 
mixture from surface vehicles with different 
automation level and degree of manoeuvrability. 
The original manoeuvre trajectory has to be 
changed and optimised according the current 
situation. In consequence, the resulting calculated 
manoeuvre can be more a stopgap than an 
energetically optimal solution with minimal 
consumption and emission. Therefore, cooperative 
approaches should be investigated that optimise the 
cooperative motion behaviour of several ships or a 
fleet to achieve the best result for this group of ships. 
Finally, within the framework of uncertainty 
quantification one could use the distribution in 
uncertain parameters, for example: non-linearities in 
the ship systems response, (future) trajectories of 
other vessels, to get a risk assessment for possible 
movement plans select an appropriate course of 
action. 
REFERENCES 
1.  Bottou, L., Curtis, F.E., Nocedal, J.: Optimization 
Methods for Large-Scale Machine Learning. (2018). 
2.  Hesselbarth, A., Medina, D., Ziebold, R., Sandler, M., 
Hoppe, M., Uhlemann, M.: Enabling Assistance 
Functions for the Safe Navigation of Inland Waterways. 
IEEE Intelligent Transportation Systems Magazine. 12, 3, 
123–
135 (2020). 
https://doi.org/10.1109/MITS.2020.2994103. 
3.  Hu, Y.: DiffTaichi: Differentiable Programming for 
Physical Simulation, https://github.com/yuanming-
hu/difftaichi, last accessed 2021/04/27. 
4.  Hu, Y., Anderson, L., Li, T.-M., Sun, Q., Carr, N., Ragan-
Kelley, J., Durand, F.: Differentiable Programming for 
Physical Simulation. Presented at the International 
Conference on Learning Representations (2020). 
5.  Kiefer, J., Wolfowitz, J.: Stochastic Estimation of the 
Maximum of a Regression Function. The Annals of 
Mathematical Statistics. 23, 3, 462–466 (1952). 
https://doi.org/10.1214/aoms/1177729392. 
6.  Kingma, D.P., Ba, J.: Adam: A Method for Stochastic 
Optimization. Presented at the 3rd International 
Conference for Learning Representations , San Diego 
(2015). 
7.  Lloyd’s Register Groupe: Design Code for Unmanned 
Marine Systems. (2017). 
8.  Medina, D., Vilà-Valls, J., Hesselbarth, A., Ziebold, R., 
García, J.: On the Recursive Joint Position and Attitude 
Determination in Multi-Antenna GNSS Platforms. 
Remote Sensing. 12, 12, (2020). 
https://doi.org/10.3390/rs12121955. 
9.  Robbins, H., Monro, S.: A Stochastic Approximation 
Method. The Annals of Mathematical Statistics. 22, 3, 
400–407 (1951). 
10. Rødseth, Ø., Nordahl, H.: Definition of autonomy levels 
for merchant ships, Report from NFAS, Norwegian 
Forum for Autonomous Ships. (2017). 
https://doi.org/10.13140/RG.2.2.21069.08163. 
11. SAE International: J3016B: Taxonomy and Definitions 
for Terms Related to Driving Automation Systems for 
On-Road Motor Vehicles -  SAE International, 
https://www.sae.org/standards/content/j3016_201806/, 
last accessed 2021/04/27. 
12. Schubert, A.U., Kurowski, M., Damerius, R., Fischer, S., 
Gluch, M., Baldauf, M., Jeinsch, T.: From Manoeuvre 
Assistance to Manoeuvre Automation. In: Journal of 
Physics: Conference Series. , Trondheim, Norway (2019). 
https://doi.org/10.1088/1742-6596/1357/1/012006. 
13. Schubert, A.U., Kurowski, M., Gluch, M., Simanski, O., 
Jeinsch, T.: Manoeuvring Automation towards 
Autonomous Shipping. In: Proceedings of the 
International Ship Control Systems Symposium (iSCSS). 
, Glasgow, UK (2018). https://doi.org/10.24868/issn.2631-
8741.2018.020. 
14. Żelazny, K.: Approximate Method of Calculating Forces 
on Rudder During Ship Sailing on a Shipping Route. 
TransNav, the International Journal on Marine 
Navigation and Safety of Sea Transportation. 8, 3, 459–
464 (2014). https://doi.org/10.12716/1001.08.03.18. 
15. Ziebold, R., Gewies, S.: Long Term Validation of High 
Precision RTK Positioning Onboard a Ferry Vessel Using 
the MGBAS in the Research Port of Rostock. TransNav, 
the International Journal on Marine Navigation and 
Safety of Sea Transportation. 11, 3, 433–440 (2017). 
https://doi.org/10.12716/1001.11.03.06.