Polyline moves on pan / zoom

![](https://user-images.githubusercontent.com/1427241/160275147-23dc56fb-9104-4ccb-be04-b096636d8794.gif)

Detailed explanation: https://github.com/Leaflet/Leaflet/issues/8089

This could be related to #143 but I don't think it's exactly the same.