The processing progress bar does not seem to be accurate ever for me. For example, it would say like {number} / 800 and then the number goes waaaay over 800. It has never successfully stopped at the correct number and Iv tried a decent amount of times at this point.
Just to double check, after I click the X in the upload files section, I literally just drag and drop all the chunk files (in this case it was like 116 small chunk files adding up to 8.5 mb) into the upload file section and then click submit again right?
Just went through the process once, and while its not hard, its very tiresome Good job though! i will probably use it a bit more on javs i really want to have translated ~
ChatGPT seems to combine lines together if the two lines are logically connected. Makes it pretty annoying sometimes. Does anyone else have this problem? I’ve tried to use different prompts but it just keeps happening.
Did something go wrong when in step 4 I pull in the subtitles and they all seem to be a dot? I at first thought it was because the video I chose had too much background noise, but I tried another video and got the same thing.
If it’s wrong, any idea how to fix the issue? / what to try redoing
No, you didn’t do anything wrong. It’s normal to have dot / “.” at step 4.
The first 4 steps only define where there is “voice” in the audio, without trying to know what is said.
It’s in steps 5 to 11 that we “replace” the dots with a transcription of the audio (using AI), in the original language (ex. Japanese).
In steps 12 to 21, we translate the original language texts to English.
Oh, okay. I was getting paranoid I had done something wrong. Thanks! Rereading the tutorial I just realized after step 2 it says entries for each voice detected (with no text). I missed that.
Curious if anyone has any new best practices for translating Japanese to English for JAV subtitles?
I’ve been using whisper-faster w/ the large-v2 model and they’re okay for some scenes but for others its just the same odd sentence over and over and over. I’m guessing it’s picking up some background static or something.
I found nothing that works perfectly yet. There are some models/tools (stable-ts, whisper-faster, whisperX, etc) that do a better job than ‘vanilla whisper’ for the timing of subtitles but they still have trouble with the Voice-Detection and repetition, as you said. The nice part is that whisper-faster can now be used directly in SubtitleEdit (i.e. Purfview’s Faster-Whisper seems to be based on whisper-faster).
I tested large-v3 a little bit. For Japanese, it didn’t seem better than large-v2.
As for the translation, I’m trying to use local LLM (since it’s harder to bypass chatGTP censoring now). The one that I prefer so far is TheBloke/Orca-2-13B-SFT_v5-GPTQ · Hugging Face, with a prompt like this:
I need you to translate the subtitles of a porn movie from Japanese to English.
I have the following requirements.
Requirements:
{
1- The target audience are adults so it can contains explicitly sexual concept.
2- Try to spot any sentences containing double meanings or wordplay.
3- All the provided lines are said by a girl to a guy.
4- Only translate the meaning of the original text. Don't expand. Don't give explication.
}
Please translate each line one by one:
{
[00000] 阿修羅?
[00001] わりとくいるよな
[00002] なぁごめんやけどさ、あと10分だけ泳がしてくれへん?
[00003] 最近さああ
[00004] 仕事が忙しくて
[00005] 全然暗号できてへんね〜んか
[00006] なぁ、ごめんやからお願い
[00007] この通り
[00008] っていうの、自分だけ
}
But it’s not working very well. For the same input, it’s clear that ChatGPT is a lot better. Hopefully, Llama 3 will be even better than version 2.
Humm, one of the 218 .srt file is invalid somehow but I didn’t write the offending file name in my exception handling.
Could you zip all .srt files in the folder “kavr-074.temp.perfect-vad_wav_chunks_9FA13526” and link it here?
You might have to rename the file to .zip.funscript or something like this.
i was legit thinking of learning japenese just to more enjoy jav scenes lol funny that ive been playing the yakuza games for years and havnt learned a single bit yet lol
Has your workflow improved or changed since then if you don’t mind me asking? I’m currently diving into the subtitle rabbit hole and find myself using some combination of Chatgpt + DeepL + Gemini (with the occasional unable to translate due to explicit content warning). And using Subtitle Edit with Large v2. For some reason, the Audio->Text ‘Auto Adjust timings’ setting messes with some of the timings off, so I have that turned off. Not sure if you experienced the same or experimented with that.
I was also experiencing inaccurate timings with what I am guessing is called hallucinations? simply due to the model? basically issues in the timings due to breaks/brief pauses in the audio or the audio not being entirely loud enough for it to pick up the words…(i belive there is something called the VAD filter to help with this? but I’m a total noob when it comes to using the cmd line and various parameters).
I know stable-ts is also included in the software (Subtitle Edit) as well - to help remedy these issues, but the efficiency of whisper-faster is really a game changer.
Using local AI API (Mixtral 8x7b hosted by LMStudio) to do the AI translation automatically.
For me, unfortunaly, as long as the translation is not helped by a ‘computer vision AI’ that can understand what’s going on in the scene, manual works will always be needed for some part of the process.
Good job though! i will probably use it a bit more on javs i really want to have translated ~