summaryrefslogtreecommitdiff
path: root/inference.py
AgeCommit message (Collapse)AuthorFilesLines
2025-08-24try finetuning encoder-decoder model like t5gemmaHEADmastervin1-0/+53
Unfortunately once it finishes the finetuning process, it doesn't actually output anything. With decoder-only models like small gemma3, it also doesn't output anything meaningful. I'm tempted to just classify each token as an ad or not, finetune an encoder like some long-context BERT, and then a post-processing script to convert back to tokens and their timestamps. May end up being more performant and efficient too...