Is there a penalty for owning too much in STATE taxes?

Yes states charge penalties for underwithholding. Each state has its own limits, typically less than the federal $1000.