Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware Updated

Generative artificial intelligence and conversational chatbots like ChatGPT have made headlines in recent months. These virtual assistants sound nearly human because they are based on extremely large datasets that contain real human conversations or other sources of data that contain the desired output for a given input.  Hobbyists and open source enthusiasts are experimenting with ways to run size optimized versions of large language models that have been tuned for instruction based interaction with humans and run locally on consumer-grade hardware. Continue reading Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware Updated

How To: Advanced Sonos Wireless Network Configuration Using Sonos Beams

Here, I describe an advanced network topology that uses Ethernet-connected Sonos Beam soundbars for better Sonos wireless coverage in your home. This approach: (1) provides significantly greater wired line backhaul to your SonosNet network, and (2) shifts the majority of your Sonos speakers to 5Ghz, freeing spectrum in 2.4Ghz for your remaining Sonos speakers. It is also possible to use either the Sonos PLAYBAR or PLAYBASE instead of the Beam, for example in your home theater. However, the Sonos Beam is a much more cost-effective solution, particularly for secondary rooms in a whole home deployment. Continue reading How To: Advanced Sonos Wireless Network Configuration Using Sonos Beams