Well it all seems to work.

After trying it with reduced precision, I ended up going with the full timer precision and keeping my timestamps as 32 bit values which is not that much more expensive in this case (a couple of extra adc and sbb instructions per frame). This means I need to handle overflow roughly every hour. Now Chuck Jones plays at the same speed regardless of what the frame rate is.