I think the unit is defective. Interesting, because other things work: display, program w/ UI Flow, etc.
I tried several M5Stick, M5StickPlus, M5StickPlus 1.1. They all work. Only the initial M5StickPlus 1.1 has this issue. And BTW, it behaves similarly when connected to a servo HAT.