Hi folks,
I’ve been working on developing F8studio for the past few months, and the core framework of the system is practically finished! I’ve been caught in a loop of constantly polishing the software and adding new things, which has admittedly pushed the official release back further and further.
I’ve been testing it across several applications, and I can officially confirm it supports a ton of features right out of the box:
Motion Capture & Generation
- VMC Support: Reads skeleton streams from VMC (MMD, etc.) and converts them to 6-axis motion.
- Video → Skeleton: Predicts full-body skeletons directly from dancing videos and converts them to 6-axis motion.
- AI Tracking: Automatically selects regions of motion using YOLO (NudeNet) and tracks the motion to 1-axis. (Can be extended by adding random or correlated singals).
- Audio Reactivity: Converts sound RMS and audio features into any axis motion.
- Live Coding: Programmable and hand-drawn patterns that work with a live-coding feel.
Game Engine Integration
- Unity: Compatible with all LoveMachine-supported games for 6-axis motion. A huge thanks to Sauceke’s prototyper—it inspired me to make a similar universal skeleton streamer, making it incredibly easy to adapt to new Unity games.
- Unreal Engine: Since there weren’t many references out there, I had to figure this out from scratch. I’m proud to announce that it is fully working on Deborah’s Room! I’ve also tested Fallen Doll, and official support for that is coming soon.
- Lovense Built-in Games: For games with built-in Lovense support (like Karryn’s Prison), I implemented a mock server that captures the game’s messages (mostly strength data). After processing it through Python and several built-in operators, it converts it into a stroke wave that you can even map to 6-axis.
Media & Hardware Support
- Video Sources: Works with local files, online videos (mpv-player supports streaming sites, including CB), and screen capture—perfect for 2D games with video films or GIF animations.
- Hardware: Supports SR6 via serial port and Intiface. The Handy API is implemented (but untested). The Lovense API is currently a bit problematic; it can receive messages but cannot drive the device just yet.
I plan to roll these features out gradually as I need a bit more time to wrap things up. Meanwhile, if you are a geek and want to poke around, feel free to pull the latest updates from the dev branch here: https://github.com/feel8-fun/f8studio/tree/dev
Building the code shouldn’t be too hard; I’ve been developing and testing it on both Linux and Win11.
I really hope this tool helps the Modding community create even more fancy, immersive game mods. Here is a tech preview video of Deborah’s Room modding running on F8Studio. Let me know what you think!
Any suggestion? Join the discord: Feel8.Fun