So in the spirit of this community and not just to focus on the Reddit… issues… I thought it might be nice to get a topical conversation going in here.
Basically, what open source projects are you currently working on or are you heavily involved with?
I think it would be nice to see what projects people have on the go, get some publicity out there and otherwise talk about stuff that we should be discussing here.
When I was sick with Covid in April I built Turbopilot, a weekend hack to get code autocomplete models (like GitHub Autopilot) to run locally on low spec machines using the library behind llama.cpp. The models I used were codegen from salesforce and the idea is that if you’re running these models locally it’s free and you’re not sending your source code back to the microsoft/github mothership.
Since then I’ve not really had time to work on it very much as my day job has been pretty busy but I really want to carry on development. I’ve got experimental nvidia acceleration building and I’m working on shipping a windows version at the moment.
BTW If anyone is interested, I’m looking for some help and I’m willing to offer some technical mentoring (I have a background in AI/ML and a dozen years exp doing software engineering professionally)