I don't know if you got this sorted, but we're not really supposed to user core 0, as this can cause panics. That's advice from Espressif. Also, adding in a delay @felmue said should really help in allowing the thread to free-up some cycles.