[IDEA] Realtime Funscripts based on Beatmeter on screen

General
1

Heyo dear community :slightly_smiling_face:
I had a shower thought and am unsure if what I’m imagining is possible, or even already exists, hear me out:
I’m often using Intiface, MultiFunPlayer and RandomVideoPlayer together to play videos with funscripts on lovense vibration toys or a stroker. Now this means all videos in my library need a funscript that someone lovely handcrafted.
Now, I also enjoy Cockheroes, if you are unfamiliar, they use a beat meter concept at the bottom of the screen to let you know how fast and in which pattern you should stroke.
My idea: use some kind of on-screen pixel analysing tool and place it in the middle of the beat bar. detect each beat and convert this into a “realtime- funscript”/instructions for intiface.

I currently don’t have enough free time to start coding this myself, as i’m also not an expert in any of the skills required. Maybe someone else finds this interesting enough to invest some time their self.

I once posted this in a discord server and a user made a small diagramm on how he would realise this idea:

┌─────────────────┐
│  Video Player   │
│  (with beat     │
│   meter bar)    │
└────────┬────────┘
         │
         ▼
┌─────────────────┐
│  Python Tool    │
│  ┌───────────┐  │
│  │   mss     │  │ Screenshot capture using python mss library
│  └─────┬─────┘  │
│        │        │
│  ┌─────▼─────┐  │
│  │  Pillow   │  │ Pixel analysis using python pillow library
│  └─────┬─────┘  │
│        │        │
│  ┌─────▼─────┐  │
│  │   Beat    │  │ Beat detection
│  │ Detection │  │
│  └─────┬─────┘  │
│        │        │
│  ┌─────▼─────┐  │
│  │websockets │  │ WebSocket client message
│  └─────┬─────┘  │
└────────┼────────┘
         │
         ▼
┌─────────────────┐
│   Intiface      │
│  (WebSocket     │
│   Server)       │
└────────┬────────┘
         │
         ▼
┌─────────────────┐
│  Lovense/Other  │
│     Device      │
└─────────────────┘

so you have a python process that runs mss, and sends websocket messages to intiface after processing the screenshot. it should all be fast enough to feel real time.

I imagine using some kind of base funscript file and change the amplitude of them for each beat (up - down stroke = 0% - 100%) But I also have no clue on how I would do that.

Any help appreciated :heart: