It’s really pointless to most people, it has its use case. But it was just a hype train everyone got on like a few years ago many did with blockchain, another nice technology but only for certain use cases. I don’t want nor need an always on AI to search through my phone and spy on me. I have already had overbearing exes try that. It’s actually a big reason I am considering switching to a Pixel 10 as my next phone and just installing Graphene OS and calling it a day as my daily driver.

I’m using Ollama to run my LLM’s. Going to see about using it for my twitch chat bot too

https://github.com/ollama/ollama

My understanding is that DeepSeek still used Nvidia just older models and way more efficiently, which was remarkable. I hope to tinker with the opensource stuff at least with a little Twitch chat bot for my streams I was already planning to do with OpenAI. Will be even more remarkable if I can run this locally.

However this is embarassing to the western companies working on AI and especially with the $500B announcement of Stargate as it proves we don’t need as high end of an infrastructure to achieve the same results.