Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware

Generative artificial intelligence and conversational chatbots like ChatGPT have made headlines in recent months. These virtual assistants sound nearly human because they are based on extremely large datasets that contain real human conversations or other sources of data that contain the desired output for a given input. Hobbyists and open source enthusiasts are experimenting with ways to run size optimized versions of large language models that have been tuned for instruction based interaction with humans and run locally on consumer-grade hardware. Continue reading Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware

A Primer on Conversational Artificial Intelligence Agents & Large Language Models

Conversational agents and the large language models (LLM) at their core have become increasingly proficient at mimicking human language and behavior, so that they can respond to a wide variety of instructions. They have been shown to be effective in many different tasks such as question and answering, dialogue generation, text summarization, machine translation, and even programming. But the questions remain: do LLMS actually know anything? And, how do they actually work? Continue reading A Primer on Conversational Artificial Intelligence Agents & Large Language Models

Proposal: Potential JellyFin Native tvOS App Including User Experience Ideas

In this post, I share some of my thoughts for a potential JellyFin native tvOS App’s user experience. My hope is that the JellyFin developer community will find these concepts useful and incorporate them in a future native tvOS app. These are my preliminary thoughts; I welcome readers’ feedback. Product development requires judgement calls; and I recognize that other users prioritize features they care about differently than me or have a preferred UX either because it better suits their needs or they are just more familiar with that UX. Continue reading Proposal: Potential JellyFin Native tvOS App Including User Experience Ideas

Review: Apple TV 4K (2d gen, 2021)

In May 2021, Apple released the second generation Apple TV 4K, and we upgraded all seven of our Apple TVs to the new model. After living with it, my verdict is this: the biggest upgrade is the redesigned Siri remote — larger, aluminum, and finally usable in the dark — but the new box disappoints in several areas, including an aging A12 processor and an HDMI port that’s 2.1 in name only. Continue reading Review: Apple TV 4K (2d gen, 2021)

How To: Synology DS1821+ Network Attached Storage (NAS) & DSM 7.0

We recently upgraded our Synology NAS units from the DS1819+ to the new DS1821+, and the improvements are substantial. The DS1821+ features a significantly faster CPU, built-in dual M.2 SSD expansion slots, and optional 10GbE network expansion card. Read on for our full breakdown of the hardware specs, SSD caching considerations, and key features in DSM 7.0. Continue reading How To: Synology DS1821+ Network Attached Storage (NAS) & DSM 7.0

How To: Home Network 5.0 with Ubiquiti WiFi 6 Long Range & Protect G4 Review & Calibration

In the latest installment of this smart home series, get a comprehensive overview of everything covered so far — from basic wireless networking and managed Unifi networks, to Lutron Caseta lighting, Synology NAS storage, Unifi Protect security cameras, NextGen TV tuners, and a full multi-room media setup with LG OLEDs, Sonos, and Apple TV 4K. Continue reading How To: Home Network 5.0 with Ubiquiti WiFi 6 Long Range & Protect G4 Review & Calibration

How To: ATSC 3.0 & the HDHomeRun QUATRO 4K

We’re diving into ATSC 3.0 (NextGen TV) — the next generation of over-the-air broadcast television. I cover everything from new video and audio capabilities to the challenges of the broadcaster transition and the hardware you’ll need to get started. I also share my hands-on experience with Silicon Dust’s HDHomeRun QUATRO 4K tuner, and look ahead at potential capabilities on the horizon, including Single Frequency Networks, targeted advertising, and ATSC 3.0 as a content delivery network. Continue reading How To: ATSC 3.0 & the HDHomeRun QUATRO 4K

How To: Home Network 4.0 with Ubiquiti Unifi Dream Machine Pro, Switch Pro, Flex Mini, Smart Power Plug & UPS Review & Calibration

My friends laugh (and my wife sighs) at how often I upgrade our home networking gear. Our biggest equipment swap occurred two years ago, when we consolidated our entire home network on Ubiquiti Unifi gear. Last year, I upgraded our firewall, network controller, and WiFi access points. I also added a PoE-powered switch to our data closet. Separately, we replaced one of our home security camera systems with the Ubiquiti Unifi Protect system. Now it’s time for more upgrades… Continue reading How To: Home Network 4.0 with Ubiquiti Unifi Dream Machine Pro, Switch Pro, Flex Mini, Smart Power Plug & UPS Review & Calibration

My Wish List for the Next Apple TV & tvOS

It has been about two years since the Apple TV 4K was released, the average time between Apple TV refreshes. So, it is timely to consider what comes next. This is my wish list for the successor to the Apple TV 4K, as well as improvements to tvOS. It’s what I would build were I the product owner of Apple TV. As a videophile, I overindex on features like video and audio quality. However, my suggestions also are based on our family’s initial experiences with Apple’s new gaming service, Apple Arcade. Continue reading My Wish List for the Next Apple TV & tvOS

How To: Sonos Amp Review & Configuration

Having found an ideal whole home audio solution in Sonos, the missing link in our home was how to power our passive in-wall and ceiling speakers as well as our patio speakers. While it was possible to use the Sonos Connect:Amp for this, the Connect:Amp design was almost a decade-old (a rebranded ZP120), relatively low-powered, and not suited for a centralized, rack-mounted installation. Sonos now brands itself as “the easy-to-use wireless home sound system.” But, clearly there is still a need to connect passive, wired speakers to that whole home system. Continue reading How To: Sonos Amp Review & Configuration

How To: Android Auto 5.5 for Navigation & Entertainment on a BMW S1000XR

If you read my two previous articles about using your smartphone to run Android Auto on your motorcycle, you know that I consider the Garmin BMW Navigator VI a poor alternative to a smartphone. I recently upgraded the smartphone that I use with my S1000XR to a Motorola G6. Continue reading How To: Android Auto 5.5 for Navigation & Entertainment on a BMW S1000XR

How To: Lutron Caséta Lighting Control System Review

Although we were first introduced to Lutron when we purchased their traditional switches and outlets, Lutron is reknown for their residential and enterprise lighting control systems. Lutron’s residential lighting control systems include Caséta, RA2 Select, RadioRA2, and HomeWorks QS. Caséta and RA2 Select are intended for the DIY user segment while the RadioRA2 and HomeWorks QS product lines are intended for the system installer/integrator segment. Continue reading How To: Lutron Caséta Lighting Control System Review

How To: Ubiquiti UniFi Security Gateway Pro 4 & Intrusion Prevention (IPS)

The focus of this article is the upgrade of our security gateway from the entry-level model, USG, to the mid-level model, the USG Pro 4. Because our primary reason for upgrading was to enable Unifi’s new intrusion prevention system, that will be covered in detail, below. This is the fourth of my articles covering our family’s experiences with Ubiquiti’s Unifi product line including the security gateway, controller, switches, and WiFi access points in a home environment Continue reading How To: Ubiquiti UniFi Security Gateway Pro 4 & Intrusion Prevention (IPS)