this is not an “AI” data center
I was a bit more high-level in the supply chain planning side (more on the long-term supply planning than rack planning), but AWS definitely has different rack types including AI rack types with dense GPU hardware setups. Are they slicing the buildings by rack type or is it heterogeneous with some AI racks + compute racks?
Partially. I started with hosting my own llama3.2 + granite4 models using Ollama for my Home Assistant smart home and for general chat with OpenWebUI. I also run whisper for speech-to-text locally on my 1080 Ti GPU. I like the privacy and ownership of my self-hosted models, but I started to run into limitations with the small weights. So I built some tools that allow me to selectively route traffic to larger models hosted on DeepInfra depending on my need. For example, to GLM/Kimi models for code reviews or for my custom harnesses or harder problems.
It’s a question of security risk profiles.
Security ultimately often times comes with a tradeoff for user experience or privacy.
How does device integrity checks materially affect the security posture for theft when considering this system? Presumably the security checks for remotely unlocking a car is based around credentials and authN/authZ for the unlock service call?
Enforcing client side security has entered the picture recently, but a lot of it comes from security checklists from people saying did you add this check? Sure adding a device integrity check may stop at least one malicious actor, but is it worth the cost? To most companies, they’re going to say they don’t understand or care about the impact.
They could just go back to key fobs since those can’t run arbitrary code.
You can buy a Home Assistant hub which is a raspberry that comes with Home Assistant on it. It’s designed to be mostly plug and play, but isn’t near the simplicity of SmartThings yet.
Once it’s setup, a lot of devices can be just added and go. I’ve got my LG TV added and can turn it on, off, change inputs, etc. I have way more powerful automations and more devices on HA than I ever could on SmartThings.
Depends on your comfort level and interest level