Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware Updated

Generative artificial intelligence and conversational chatbots like ChatGPT have made headlines in recent months. These virtual assistants sound nearly human because they are based on extremely large datasets that contain real human conversations or other sources of data that contain the desired output for a given input.  Hobbyists and open source enthusiasts are experimenting with ways to run size optimized versions of large language models that have been tuned for instruction based interaction with humans and run locally on consumer-grade hardware. Continue reading Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware Updated

A Primer on Conversational Artificial Intelligence Agents & Large Language Models Updated

Conversational agents and the large language models (LLM) at their core have become increasingly proficient at mimicking human language and behavior, so that they can respond to a wide variety of instructions. They have been shown to be effective in many different tasks such as question and answering, dialogue generation, text summarization, machine translation, and even programming. But the questions remain: do LLMS actually know anything? And, how do they actually work? Continue reading A Primer on Conversational Artificial Intelligence Agents & Large Language Models Updated

How To: Home Network 4.0 with Ubiquiti Unifi Dream Machine Pro, Switch Pro, Flex Mini, Smart Power Plug & UPS Review & Calibration Updated

My friends laugh (and my wife sighs) at how often I upgrade our home networking gear. Our biggest equipment swap occurred two years ago, when we consolidated our entire home network on Ubiquiti Unifi gear. Last year, I upgraded our firewall, network controller, and WiFi access points. I also added a PoE-powered switch to our data closet. Separately, we replaced one of our home security camera systems with the Ubiquiti Unifi Protect system. Now it’s time for more upgrades… Continue reading How To: Home Network 4.0 with Ubiquiti Unifi Dream Machine Pro, Switch Pro, Flex Mini, Smart Power Plug & UPS Review & Calibration Updated

Sonos One & Sonos Beam (Part 2): Review of Voice Services Including Amazon Alexa, Google Assistant & Apple Airplay 2 Updated

Sonos speakers will be able to bridge the gaps between Amazon, Apple, and Google’s smart home ecosystems. Sonos owners will be in the unique position of choosing their preferred voice assistant for a task, independent from the music source, method of streaming, or smart home control. For example, a Sonos owner could maintain their music library in iTunes, their music subscription service on YouTube or Amazon, their home control on Apple HomeKit, and ask general knowledge questions to Google Assistant or Alexa. Similarly, Sonos consumers could control Nest and HomeKit devices from a single smart speaker. Continue reading Sonos One & Sonos Beam (Part 2): Review of Voice Services Including Amazon Alexa, Google Assistant & Apple Airplay 2 Updated

Sonos One & Sonos Beam (Part 1): The State of Smart Speakers Updated

Amazon Echo’s primary function appears to be extending Amazon’s ecosystem including e-commerce and advertising. Like Amazon, Google Home’s primary goal appears to be lowering the price of its devices so that users will install multiple devices in their homes, generating more user data for Google’s advertising business. Apple’s product design treats smart speakers as a relatively dumb and local extension of the iPhone. The Sonos One hits the price-performance sweet spot: although it costs nearly twice what an Echo or Home does, it provides significantly better sound. Continue reading Sonos One & Sonos Beam (Part 1): The State of Smart Speakers Updated

Google Home: Configuring and Using It with a Logitech Harmony Hub Updated

In early December, Google announced ‘Conversation Actions’ and ‘Direct Actions’ for Google Home. Today, Google announced interoperability between Google Home and Logitech Harmony, similar to Harmony’s integration with the Amazon Echo. Google Home also added support for the Anova sous vide cooker, August locks, Electrolux Frigidaire Gallery Cool Connect, First Alert thermostat, Geeni LED lights, Insignia Wi-Fi smart plug, Lifx Plus Wi-Fi smart bulb, Rachio smart sprinkler controller, TP-Link Wi-Fi LED, Vivint security platform, and Wink Hub. Continue reading Google Home: Configuring and Using It with a Logitech Harmony Hub Updated

Nvidia Shield Android TV: 2017 Hardware & Shield Experience 5.1 Review Updated

The Shield TV continues to be an anomaly: it is by far the most powerful media streamer and a capable gaming platform though not as advanced as the Xbox One or Playstation 4, while costing nearly as much. While Google focuses on stripped down Chromecast devices and Chromecast-enabled TVs, Nvidia singularly showcases the advanced functionality of Android TV including DVR, media serving, gaming, and now smart home capabilities. Though Nvidia is touting the Shield TV and AI home, Google is the AI element and Nvidia is the hardware manufacturer.
Continue reading Nvidia Shield Android TV: 2017 Hardware & Shield Experience 5.1 Review Updated

Logitech Harmony Hub and Voice Control Updated

Thus far, Logitech has partnered with Amazon. By connecting the Harmony Hub with Alexa, you can start or stop Harmony activities such as “Watch TV”, “Play a Game” or “Listen to some Music”. You can also power on or off your TV, change your stereo settings, or trigger connected home activities that are controlled by the Harmony Hub. For any Harmony Hub activity, you can create a friendly name that’s easier to say. You can also tune specific channels on your cable/satellite with voice commands such as “Alexa, turn on sports”. Continue reading Logitech Harmony Hub and Voice Control Updated

Nvidia Shield Android TV Review Updated

Since its first release in May 2015, the Nvidia Shield Android TV has been billed as the world’s best Android TV settop box. That continues to be the case as of December 2016. The Shield Android TV is also more powerful, technology-wise, than the Apple TV Gen 4, Amazon FireTV 2, or latest Roku. That said, the Apple TV is undeniably a better solution for Apple ecosystem users like my parents. Amazon’s ecosystem is a cost-effective solution, especially for Amazon Prime members; and the FireTV is also bolstered by Amazon’s investment in exclusive content. Meanwhile, the Android gaming ecosystem isn’t advanced enough to sway hard-core gamers from their Xbox One or PS4 game consoles. Continue reading Nvidia Shield Android TV Review Updated