ai

Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware

Mike ConnellyArtificial Intelligence, Technology

Large language models can now run entirely on consumer laptops, with no cloud connection required. We explore how hobbyists and open-source developers are deploying instruction-tuned, locally optimized LLMs on standard hardware and what that means for privacy, cost, and accessibility. The practical tradeoffs between model size and response quality are what make this shift more consequential than it first appears.
Continue reading Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware

A Primer on Conversational Artificial Intelligence Agents & Large Language Models

Mike ConnellyArtificial Intelligence, Technology

Conversational agents and the large language models (LLMs) have become increasingly proficient at mimicking human language and behavior so that they can respond to a wide variety of instructions. At their mathematical core, they are statistical distributions of token adjacency probabilities. This article covers how LLMs work, how they evolved from first-generation transformers to instruction-tuned systems, and what the temperature parameter actually controls.
Continue reading A Primer on Conversational Artificial Intelligence Agents & Large Language Models

How To: Home Network 4.0 with Ubiquiti Unifi Dream Machine Pro, Switch Pro, Flex Mini, Smart Power Plug & UPS Review & Calibration

Mike ConnellyConnected Home

We are now on our fourth-generation home network build-out, including Ubiquiti’s UniFi Dream Machine Pro, a 48-port PoE switch, managed Flex Mini switches, and Protect camera system. Ubiquiti’s UDM Pro consolidates a network firewall, IDS/IPS, controller, and security camera NVR into a single rack-mounted appliance. Also covered are two smaller additions: the Flex Mini and Smart Power Plug, which handle edge cases like last-drop switching and WAN recovery. Continue reading How To: Home Network 4.0 with Ubiquiti Unifi Dream Machine Pro, Switch Pro, Flex Mini, Smart Power Plug & UPS Review & Calibration

Sonos One & Sonos Beam (Part 2): Review of Voice Services Including Amazon Alexa, Google Assistant & Apple Airplay 2

Mike ConnellyConnected Home, Music

Sonos speakers support Amazon Alexa, Google Assistant, and Apple Siri simultaneously, letting users mix and match voice assistants independent of their music source or smart home platform. Here, we explain how that flexibility works in practice and what it means for households split across competing ecosystems. A Sonos owner can run an iTunes library, a YouTube Music subscription, and Apple HomeKit controls from a single speaker while still asking Google a question. Continue reading Sonos One & Sonos Beam (Part 2): Review of Voice Services Including Amazon Alexa, Google Assistant & Apple Airplay 2

Sonos One & Sonos Beam (Part 1): The State of Smart Speakers

Mike ConnellyConnected Home, Music

Amazon Echo and Google Home are designed primarily to deepen their makers’ advertising and data businesses, while Apple’s HomePod functions as a local iPhone extension. This article examines what each major smart speaker is actually optimized for, and why that distinction matters when choosing one. The Sonos One costs nearly twice as much as an Echo but delivers meaningfully better sound for listeners who prioritize audio quality. Continue reading Sonos One & Sonos Beam (Part 1): The State of Smart Speakers