The behavior I described only works on Wi-Fi, where the entire script is cached before playback. Handy’s Bluetooth protocol is very basic and plays action as they are received without doing any post-processing. I imagine things go wrong when the speed goes beyond its hardware capability.
Try Wi-Fi if you can. It’s entirely different compared to BLE. If it’s taking long for to download the script try hosting it locally.