Translate-AI

A major new version of Today Planned is coming out soon, and one of the steps to get it ready is translating the app into 9 languages. I have not productized this, but I have this internal tool I call Translate-AI that runs entirely locally.

My MacBook just kicks off the script, then a server on my gaming laptop with an RTX 5090 does the heavy lifting. I bought it for gaming first of course, but fast local inference was a pretty good second excuse 😉

Running your own LLMs is nice for this kind of stuff. Virtually free run cost, no token anxiety, data never leaves the premises, and you get a lot of control. Obviously it is not as good as frontier models, but you just have to know when to use what.