What does this have to do with a rosary?
It does not matter if you are 3 minutes "late" that doesn't make any difference. The next day doesn't start at midnight either, the next day starts at sunrise. You do not need to do the meditation exactly the same time every day, and as long as you do it at least once every day it keeps the momentum.