Got the panel off and sure enough, the plastic tab that the button pushes on to push the microswitch on the control board is broken. It's right about the "e" in AppliancePartsPros.com watermark in the second picture.
I don't suppose there is a way to just get the plastic panel without the circuit boards? It's over $200 with the circuit boards - I can't imagine the plastic piece only would be over $50 without the boards. I have the star screw driver that can get the tiny screws out, but in talking with the nice folks at appliance parts pros it seems to be only sold as one entire unit. What a waste