Infrastructure/AI – Decentralized
Have started a project building decentralized cloud and AI infrastructure.
I’ve been working on several projects for the last several years, mostly on job sites, and feel my work/family life is at a good balance as to where I can start producing off hours tech again. I’ve always just been a builder, very simply, and my trials at business have shown me you end up as a manager as opposed to making things. This is OK, since making that honest dollar is a good thing.
There are several infrastructures I’ve been able to get hands-on Azure, node DB/AI, and now AWS. A lot of my interest is to write as little code as possible — not very easy — and patch as much open source as possible together to create this.
The idea started around 2010 when one of my projects was to create decentralized version of what is now Substack — but alas, a lot of the writers I knew didn’t see it (basically was to be a federated WordPress farm). I was also trying to host it on my own machines for security and control over the data.
The issue of data security. I created a Zapier/OpenAI Jira ticket router and ran into this — no way were we going to put our company data into another company’s promise of security. Hosting an LLM, DBs, etc also controls the data.
Now, with my interests, and how things have blossomed, and with the skills I’ve acquired — is a good time to continue on with this work. Prices on some hardware — for instance NVidia’s small boards – have really come down after the chip shortage. There is a need too as different companies are trying to monopolize algorithm space. Not everyone wants that.
Some companies have already done this and building this kind of stack, optimizing it, making it usable should be within reach if I follow some of their paths.