It bugs me a bit when the controls cover a video. So in this example when you hover, the video gets pushed back to make room for the controls. Not sure if that's better.
See the attached video.
keyboard shortcuts: ← previous shot → next shot L or F like Z toggle zoom