try finetuning encoder-decoder model like t5gemmaHEADmaster

Unfortunately once it finishes the finetuning process, it doesn't
actually output anything. With decoder-only models like small gemma3, it
also doesn't output anything meaningful. I'm tempted to just classify
each token as an ad or not, finetune an encoder like some long-context
BERT, and then a post-processing script to convert back to tokens and
their timestamps. May end up being more performant and efficient too...

0 files changed, 0 insertions, 0 deletions