Well, you're right about having a great job being worth a lot; but the fact that the OP wants to leave something so great to work on starting up really speaks more to the depth of his drive to start up, right?

(Also, I totally agree with you about having an idea to work on before quitting.)