F.A.P.S (Funscript - Audio Processing System) by CaptainHarlock

Software
, , , , , ,
326

I have VLC installed, but the VLC entry in the command prompt shows “NOT FOUND”. Is there any connection?

3
3984×521 55.1 KB

327

This is a known issue; check this out: F.A.P.S (Funscript - Audio Processing System) by CaptainHarlock - #210 by galesp

This issue has already been fixed in the new version, v0.9, which will be released very soon, between today and tomorrow. I’m just finishing up a few things related to Hypno/Edging/JOIs…

328

Version 0.9 is now available!

Enjoy! :sign_of_the_horns:

Here is the final changelog (v0.9):

  • New mood: “Beat Rider,” which takes a radically different approach from the rest; it doesn’t analyze audio but rather visual data, and is designed to quickly generate funscripts for videos that use a beat indicator (such as Cockheros and similar)

  • “Edge & Cum”: Added “Generate & Preview” inside “Edge & Cum”: Allows fine-tuning of Edge & Cum patterns, and the edits can be saved to apply them to any generated Funscript (baked points); these edits are also saved when the project is saved

  • “Edge & Cum”: New method in “Analyze & Suggest” for automatically adding blocks, based on visual analysis (note: the video must contain relevant text such as “cum,” “stop,” etc. This is configurable)

  • “Point Editor”: Added option to move forward/backward by song

  • “Point Editor”: Increased the maximum zoom in

  • “Point Editor”: Added volume control for the preview

  • “Point Editor”: When jumping between problem points (error detection in “Advanced”), the sliders and video time are now updated in real time

  • “Preview Card”: Added an option to generate animated GIFs, with various quality profiles, including one designed to create GIFs compatible with the EroScripts preview

  • “Fap Mixer”: Added a dropdown menu for selecting stems per block directly in the main UI (previously this had to be done in Configure AI)

  • “Fap Mixer”: Added a new, improved method for assigning stems to blocks

  • “Fap Mixer”: Added a “Simplif” slider to prevent the excessive creation of useless points (RDP filter)

  • “Normal”: Added “By Section” checkbox that automatically adjusts the “Spacing” value based on section type (starting from the current value in Spacing)

  • “Simple”: Added “Beats by Section” checkbox that automatically adjusts the “Beats” value based on section type (starting from the current value in Beats)

  • “Simple”: Added “RMS Windows by Section” checkbox that automatically adjusts the “RMS Windows by Section” value based on section type (starting from the current value in RMS Window)

  • ‘Slow’: Fixed an issue in the formula that caused flat or very slow-moving parts of the funscript

  • “Slow”: Added “By Section” checkbox that automatically adjusts the intensity of the movement based on the section type

  • ‘Slow’: Added “Min RMS Energy” slider to set a minimum movement

  • “Slow”: Fixed an issue with the Ease-In that generated many consecutive useless points

  • “Relaxed”: Added a dropdown menu to add extra movement to slower sections (4 patterns to choose from; can be applied only on ups, only on downs, or both, with a threshold control for applying it)

  • “Crazy”: No longer generates movement in parts of songs that the user has disabled (intro, between songs, ending)

  • “Crazy”: Added an RDP filter to prevent the creation of unnecessary redundant points

  • “Crazy”: Added a filter to prevent the generation of “flat zones” that caused short stutters

  • “Crazy+Voice”: Added an RDP filter to prevent the creation of unnecessary redundant points

  • “Crazy+Voice”: Added a filter to prevent the generation of “flat zones” that caused short stutters

  • “Hypno”: Critical, the controls for “keywords” weren’t actually working; they’ve been reviewed and improved

  • “Hypno”: Priority system for “keywords”, higher positions have higher priority

  • “Hypno”: Now, if “Detect Voice” is disabled, the generated cache (without voice detection) is saved, and when the same video is loaded again, the funscript can be generated directly without having to rerun “AI Analysis” without voice detection

  • “Hypno”: Added a new “Threshold” slider that controls the sensitivity for zone changes (low/medium/high)

  • “Hypno”: Added additional filters such as RDP, “flat zones”, and others to reduce the number of points while maintaining the movement.

  • “Hypno”: Fixed an issue with the installer that installs an incorrect version of Whisper (this could also affect “Edging” or the JOIs)

  • “Heatmap”: Resolution enhanced

  • Fixed MANY minor issues

  • Added more missing translations

  • Added VLC libraries: Avoids known compatibility issues with the user’s VLC versions

  • Added CPU fallback for All-in-One: Avoids a known issue with Nvidia 10xx Series GPUs (and likely other models not compatible with All-in-One via GPU)

  • Installation: There are now two installation files. “Install_Nvidia.bat,” which is the official installer currently in use. And “Install_AMD.bat,” which is experimental and based on the port created by user @Alexcreeds

4 Likes
329

currently working on fixing the issues with my port

2 Likes
330

Have you tried the new v0.9? In this version, I added an installer for AMD, and some .py files based on your port were also included. The only thing is, I can’t test whether it works or not :sweat_smile:

331

there are a LOT of issues that rose after i gave you my first version sadly, i am porting all my fix and i’ll send you my new version. the port sadly cannot be only installer level

2 Likes
332

It’s not just the installer; several fallbacks (natten) have also been added, and installations that aren’t compatible with AMD are prevented (flash attention). It was based on your port, but it wasn’t just a simple copy/paste of the code. However, as I said, I haven’t been able to test it; perhaps you can test it before integrating your port, if necessary.
In any case, thanks!!

333

i did test it and lots of things are fully broken, BPM detection, section detection and most moods are defaulting to no AI analysis. I am adding all the fix i had to do atm

1 Like
334

This indicates an allin1fix issue, which is strange because I specifically added a CPU fallback, one that’s not only meant to work with AMD GPUs but also makes the app compatible with Nvidia 10xx series GPUs.

335

I had already fixed that issue but i required a lot of reworking of everything. I’ll work on it for a day or two and it should be good to go

2 Likes
336

Here is a demo video showing how to use the app.
Just over 1 hour (real time) showing the AI video analysis process, song adjustment, use of musical moods (Pulse, SixthSense, Normal, Relaxed, Slow, Simple, Crazy, Crazy+Voice, Fap Mixer, AUTO), using “Edge & Cum” to add patterns, using “Point Editor” to preview the generated funscript and make adjustments, and using “Preview Card” to generate Cards or animated GIFs.

337

i’ve had a small breakthrough in the ROCM version

BPM is fixed, DrumSep now runs on GPU not on CPU (100x faster)

i am now trying to speed up the other GPU process before i release the 0.9 ROCM update to you

2 Likes
338

Well done, thanks!!!

339

currently packaging the app. will upload it to my drive and give it to you to reupload

1 Like
340

I downloaded this some time ago(only did really simple testing/playing around with it), I think im on v0.7(there would be random non-english language text showing up, idk if its fixed by now). Will probably update it once I get back to it.

But yeah this program was more or less what I was looking for to just automatically place points for audio thats just beats.

Quick thing, I have a JOI audio thats currently just beats. Not sure if there’s a way to place points in between the beats. Like Im still experimenting on whether I want it as the default where a beat would be the top of the stroke then the next beat was the bottom. Or if it should have every beat be the top, meaning there needs to be a point in b/t each beat.

But yeah great program. Funny that there’s a different program thats similarly named(vFAPS).

1 Like
341

Thanks!
Yep, in v0.8 and v0.9, many remaining translations have been added; I can’t rule out the possibility that there might be some that I haven’t noticed, but that would be almost negligible.
I recommend you watch the video I uploaded recently so you can see how I use the app with different moods, as well as other interesting features it has (Edge & Cum, Point Editor, Preview Card).
By default, the goal is to avoid simply following the beats to prevent it from being too monotonous and repetitive, but I think both “Pulse” and “SixthSense,” if configured properly, could simply follow the beat. As for speed, both have parameters to make them faster or slower, but to get an up/down per beat, I think your only option would be to use “SixthSense” with Stroke set to 2x or 3x. The thing is, it’s configured to adapt its speed based on the song section (intro, verse, chorus, etc.), so in some cases it will give you up/down per beat, but in other sections it won’t.
If you want to try “SixthSense” for what you’re looking for, I recommend:
Strokes = 3x (or 2x)
Disable “DrumSep AI” and “Sub-beats”
Set “Guitar,” “Piano,” and ‘Other’ to 0 in MELODIC
Disable GUITAR/VIBRATO

This should result in simple up/down for each beat in fast sections, and up per beat and down per beat in slower sections; then, if you want, you can edit it using the “Point Editor”.

1 Like
342

Like at the moment am looking at a Voiced Joi but managed to get a version that was just the beat so I could script to it because scripting to just audio is diff than scripting to a visual component.

So until I found this I was more or less just listening to the beat and trying to time it, or looking at wave forms.

But Yeah mostly am looking at options/styles cause again am new to audio based scripts but it was sort of my understanding that for JOI specifically, I thought the intention was to follow the beat(with each bump being a down stroke) because it determines the speed of each section. But that pacing might be unrealistic for a machines just due to physical limitations on a device.

But yeah for my first run through with the v0.7 program it pretty much got the beat timing correct and I just through it into OFS since Im more used to editing in that one.

I’ll try the settings but in the long run it might be better to just work with having the down stroke on every other beat just because of device limitations.

343

Anyway to run this on Linux?

345

Hi, quick question:

Are there any plans to add Japanese (ja) language support to Hypno mode?

A lot of ASMR content is in Japanese, so it would really help with voice detection and overall quality.

Thanks!

346

does anybody have a fix to the app crashing after beginning an AI analysis?