If you're in such situation, the choice might be difficult to see. But people outside the box can think more clearly. Simple words of advice and insight was uttered, "it won't be a failure, if you choose family over anything else" and for as long as someone in the family is capable enough to still provide for their needs then things wont be as bad as it would seem.
I remembered an office mate shared to me something he read from a book, it goes: we work so hard for our family, for our children, that we oftentimes couldn't see that we almost don't or can't spend even a quality hour with them anymore. By the time you retired from work and already paid off all bills and obligations (assuming you worked in a well-off company with a very generous retirement package) and ready to spend your remaining moments with them, you realize, they are already used to not having you around anymore.
We have just a lifetime to live in this world. Whether we like it or not, we can't finish all endeavors and all the things we wanted to do in life. We might differ on how we look at success, but for me, if I created wonderful memories with the people I treasure most... that I can just provide enough for my family... that my wife and children can proudly say how wonderful a husband and father I am to them... that I can say someday that I lived a full and meaningful life... that would be success for me. Yahweh bless.