Tailscale <3
Local LLMs and AI agents are awesome, but what keeps blowing my mind is Tailscale
The fact that I can get a multi-device setup in less than 15 minutes is amazing (phone, laptop, and 2 desktops in my case).
Last time I set up something similar using OpenVPN a few years back, it took a weekend.
BUT NOT ONLY are they connected.
I get MagicDNS, NAT traversal, and can intelligently determine if they should use a direct local network path vs DERP relay, all out of the box, without poking holes in my firewall.
You still have to implement last-mile security if you really want a fully locked-down setup for your apps when they talk to each other.
I'm legit just amazed by the experience. And if you haven't worked on networking infra, this might not be mind-blowing lol
But if you are building a local AI / LLM setup, you should check it out.
MY PREDICTION for the consumer market as Local AI gains momentum:
- The prosumer segment will flock to Tailscale / NetBird / own Wireguard implementation.
- Apple will capture the rest, building on Wireguard and their UX to make local AI / LLMs seamlessly integrated across your devices.
And no, I'm not sponsored or paid to say this. Just a fan of products with a seamless experience.