Thanks you very much for your reply, it's exactly what I am looking for.
It works wonderfully well in a desktop browser, and even in the mobile preview of a desktop browser. However on actual devices (whether iOS or Android), it's quite buggy... there seems to be browser rending bugs, and sudden scrolling to random places...
It happens in both this version, which is essentially the same as you shared, with the scroll bars removed with CSS :
https://codepen.io/maxime-desrosiers/pen/JjvKLPN
And these bugs also happen in this version, which I believe is the other method you suggested. Thank you for the suggestion, that is closer to what I'm actually looking for, I want to keep the "scrub" working.
https://codepen.io/maxime-desrosiers/pen/rNvLpqo?editors=0010
None of them work well on an actual mobile device, but they both work perfectly in the Chrome mobile preview on desktop.
If by any chance you have an idea how the behaviour could be improved on mobiles...
Thank you!