Building my own Jarvis

Product · 2026-05-21

Wow what a big statement Jack. Very original.

No but seriously, I’m trying to build my own personal AI assistant that can handle everything from research, emails, voice, to-do’s, make code changes and random ideas that pop in to my head.

Productivity coming?

The why

Should always have a why, right? That’s what they say (who’s they btw?) - so the why is I want to be more productive. I want to write more. I want to build more. I want to communicate more. And I’m struggling to balance everything I need and want to do.

Having a little boy, a job, trying to build out apps, having downtime, chores. It all adds up and I know there’s times when I definitely could work on everything but my to do list is - what’s the word I’m looking for, exponentially growing. So, how do I become more productive? Gary. Working title, but cracking underutilised name.

Great theory Jack, so are you actually building it, or is it just a pipe dream?

It’s in progress! What I have now

• Speech to text - for to do lists, research and waffling. I use DeepGram to transcribe, then a Claude bot picks it up, makes sense of the ramblings and normalises in to tasks. Tasks get smart added to threads organised by individual topic / codebase / project. Nice, to do list is growing.
• Codebase management - access to my active codebases, I can make changes, get feedback from the army of bots, experiment, and even push to production.
• Research - web pages, companies, topics - I throw one command and my bots go away and do the business and report back. Like a more focused Google I guess.
• Watchdog - gotta keep on top of everything and make sure the army of bots is up and running.
• Co-ordinator - like it says on the tin, keeps the other bots in line, making sure they’re actually doing things.
• Bus - EVERYONE LOVES BUSES. Except me today, 26 is having a mare past (or passed, idk) mare street. Real street. Unnecessary waffle. Cambridge Heath station is not fun this morning. Anyway, the bus is what keeps everything moving (not like mine this morning), passing the messages back and forth between the bots with logs so we can keep on top of misbehaving gremlins.

The foundational work is all there. It’s got to be smarter though, building a brain. Needs to be conversational like a co worker. Lots to be done, so little time. But productivity is coming, right?