Ello Ello.

Can you recommend a program with which I can generate commit messages locally? I DO NOT want an LLM local or cloud API. What I want is a tiny or small language model. If I could easily swap or customize the model for each project, it would be better, too. So I could have smaller models for specific projects. I can do the training meself.

Thanks in advance!

  • CameronDev@programming.dev
    0·
    18 hours ago

    Its small in the sense it’ll run on basically any GPU from the last decade, rather than high end or specialised GPUs. And there is a 1GB gemma4 model, which is meant for CPU/phones.

      • CameronDev@programming.dev
        0·
        17 hours ago

        You’re not wrong though, even 1GB is quite lot for writing commit messages, I gave it a quick go, and it takes around 15-30s to analyse a very small diff. Kinda silly for git messages.

        • Farooq@realbitcoin.cashOP
          0·
          16 hours ago

          Thanks for letting us know. Yeah sure. It’s not worth it. I personally take about 10s to write the commit message. So such a thing will just make it worse.