If you leave say an hour later and this helps and you subtract the extra time your sitting in traffic you may find your almost there at the same time anyway. Like you said the "little" difference in time amounts to way more in your sanity at the end of your drive.
