device

Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware

Mike ConnellyArtificial Intelligence, Technology

Large language models can now run entirely on consumer laptops, with no cloud connection required. We explore how hobbyists and open-source developers are deploying instruction-tuned, locally optimized LLMs on standard hardware and what that means for privacy, cost, and accessibility. The practical tradeoffs between model size and response quality are what make this shift more consequential than it first appears.
Continue reading Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware

How To: Advanced Sonos Wireless Network Configuration Using Sonos Beams

Mike ConnellyConnected Home, Music

Here, I describe an advanced network topology that uses Ethernet-connected Sonos Beam soundbars for better Sonos wireless coverage in your home. This approach: (1) provides significantly greater wired line backhaul to your SonosNet network, and (2) shifts the majority of your Sonos speakers to 5Ghz, freeing spectrum in 2.4Ghz for your remaining Sonos speakers. It is also possible to use either the Sonos PLAYBAR or PLAYBASE instead of the Beam, for example in your home theater. However, the Sonos Beam is a much more cost-effective solution, particularly for secondary rooms in a whole home deployment. Continue reading How To: Advanced Sonos Wireless Network Configuration Using Sonos Beams