Local AI infrastructure
in progress
A local AI service layer for personal applications and assistants. I want one useful, private inference setup instead of a different pile of scripts for every idea.
On the bench
- Making local inference reusable across small personal tools
- Learning where latency and model choice change the experience
- Keeping the service boundaries loose enough to experiment