TL;DR You can have Grok control your handy live. Works for any AI that has a “View Image” tool which can fetch an image from the web.
Hi folks, after coming back to lewd development I realized that there had to be a way to integrate more AI chat bots like Grok, etc. As it turns out it is possible to leverage the AI’s “View Image” tool as a communication mechanism. I’ve tested this myself with the Grok on the web chat and it works well given the limitations. Now I’ve updated my service to allow for anyone to have their device connected to Grok or any other AI with image fetching capabilities.
Setup
- Hop onto handy.smol.link and select “Controllee”, then connect your device.
- Tell your AI to read this page: handy.smol.link/api/grok/info
- Give your AI the last part of the share URL from the Controllee page. For example, after connecting your device it will give you a URL like
https://handy.smol.link/controller/blah1234. From that URL you would tell your AI “My key for handy.smol.link is blah1234”.
That’s it, you’re all done! Your AI is now set up to control your device. Have fun!