Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware Updated

Generative artificial intelligence and conversational chatbots like ChatGPT have made headlines in recent months. These virtual assistants sound nearly human because they are based on extremely large datasets that contain real human conversations or other sources of data that contain the desired output for a given input.  Hobbyists and open source enthusiasts are experimenting with ways to run size optimized versions of large language models that have been tuned for instruction based interaction with humans and run locally on consumer-grade hardware. Continue reading Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware Updated

A Primer on Conversational Artificial Intelligence Agents & Large Language Models Updated

Conversational agents and the large language models (LLM) at their core have become increasingly proficient at mimicking human language and behavior, so that they can respond to a wide variety of instructions. They have been shown to be effective in many different tasks such as question and answering, dialogue generation, text summarization, machine translation, and even programming. But the questions remain: do LLMS actually know anything? And, how do they actually work? Continue reading A Primer on Conversational Artificial Intelligence Agents & Large Language Models Updated

Review: Apple TV 4K (3d gen, 2022) Updated

In early 2019, I published an article about the hardware and software functionality that I hoped the next version of the Apple TV would include. In May of 2022, Apple finally released the third generation Apple TV 4K. We upgraded our seven Apple TVs, to this latest model. And, here is my review of the 2022 Apple TV 4K’s capabilities. Continue reading Review: Apple TV 4K (3d gen, 2022) Updated

Proposal: Potential JellyFin Native tvOS App Including User Experience Ideas

In this post, I share some of my thoughts for a potential JellyFin native tvOS App’s user experience. My hope is that the JellyFin developer community will find these concepts useful and incorporate them in a future native tvOS app. These are my preliminary thoughts; I welcome readers’ feedback. Product development requires judgement calls; and I recognize that other users prioritize features they care about differently than me or have a preferred UX either because it better suits their needs or they are just more familiar with that UX. Continue reading Proposal: Potential JellyFin Native tvOS App Including User Experience Ideas

Review: Apple TV 4K (2d gen, 2021) Updated

In early 2019, I published an article about the hardware and software functionality that I hoped the next version of the Apple TV would include. In May of 2021, Apple finally released the second generation Apple TV 4K. We upgraded our seven Apple TVs, to this latest model. And, here is my review of the new Apple TV 4K’s capabilities. Continue reading Review: Apple TV 4K (2d gen, 2021) Updated

How To: Synology DS1821+ Network Attached Storage (NAS) & DSM 7.0

We just upgraded our Synology NAS units from Synology’s prior model, DS1817+ to their latest model, DS1819+. In my previous article, I reviewed not just the DS1817+ chassis but also the M2D17 M.2 SATA SSD expansion card. I also covered software features including downloadable Synology and third-party applications, the file system, file sharing, synchronization & backup, and security. Continue reading How To: Synology DS1821+ Network Attached Storage (NAS) & DSM 7.0

How To: Home Network 5.0 with Ubiquiti WiFi 6 Long Range & Protect G4 Review & Calibration

Previously in my smart home series, I covered: the basic principles of wireless networking including using a consumer grade wireless router upgrading to a prosumer/SMB grade managed network with a firewall appliance and multiple discrete WiFi access points recommendations for configuring a Unifi Network, including WiFi spectrum allocation, access point settings, VLANs for IOT devices, and integration of Sonos devices maintaining a separate SonosNet wireless … Continue reading How To: Home Network 5.0 with Ubiquiti WiFi 6 Long Range & Protect G4 Review & Calibration

How To: ATSC 3.0 & the HDHomeRun QUATRO 4K Updated

Overview The next generation of over-the-air broadcast television is based on the ATSC 3.0 standard, branded NextGen TV. The ATSC 3.0 standard includes support for ultra high resolution (i.e. 4K) video with high dynamic range (HDR) as well as support for 7.2+4 channel audio. Additionally, the ATSC 3.0 standard includes new datacasting capabilities. To receive ATSC 3.0 broadcasts, you will need either a new TV … Continue reading How To: ATSC 3.0 & the HDHomeRun QUATRO 4K Updated

How To: Home Network 4.0 with Ubiquiti Unifi Dream Machine Pro, Switch Pro, Flex Mini, Smart Power Plug & UPS Review & Calibration Updated

My friends laugh (and my wife sighs) at how often I upgrade our home networking gear. Our biggest equipment swap occurred two years ago, when we consolidated our entire home network on Ubiquiti Unifi gear. Last year, I upgraded our firewall, network controller, and WiFi access points. I also added a PoE-powered switch to our data closet. Separately, we replaced one of our home security camera systems with the Ubiquiti Unifi Protect system. Now it’s time for more upgrades… Continue reading How To: Home Network 4.0 with Ubiquiti Unifi Dream Machine Pro, Switch Pro, Flex Mini, Smart Power Plug & UPS Review & Calibration Updated

My Wish List for the Next Apple TV & tvOS Updated

It has been about two years since the Apple TV 4K was released, the average time between Apple TV refreshes. So, it is timely to consider what comes next. This is my wish list for the successor to the Apple TV 4K, as well as improvements to tvOS. It’s what I would build were I the product owner of Apple TV. As a videophile, I overindex on features like video and audio quality. However, my suggestions also are based on our family’s initial experiences with Apple’s new gaming service, Apple Arcade. Continue reading My Wish List for the Next Apple TV & tvOS Updated

How To: Sonos Amp Review & Configuration

Having found an ideal whole home audio solution in Sonos, the missing link in our home was how to power our passive in-wall and ceiling speakers as well as our patio speakers. While it was possible to use the Sonos Connect:Amp for this, the Connect:Amp design was almost a decade-old (a rebranded ZP120), relatively low-powered, and not suited for a centralized, rack-mounted installation. Sonos now brands itself as “the easy-to-use wireless home sound system.” But, clearly there is still a need to connect passive, wired speakers to that whole home system. Continue reading How To: Sonos Amp Review & Configuration

How To: Android Auto 5.5 for Navigation & Entertainment on a BMW S1000XR Updated

If you read my two previous articles about using your smartphone to run Android Auto on your motorcycle, you know that I consider the Garmin BMW Navigator VI a poor alternative to a smartphone. I recently upgraded the smartphone that I use with my S1000XR to a Motorola G6. Continue reading How To: Android Auto 5.5 for Navigation & Entertainment on a BMW S1000XR Updated

How To: Lutron Caséta Lighting Control System Review Updated

Although we were first introduced to Lutron when we purchased their traditional switches and outlets, Lutron is reknown for their residential and enterprise lighting control systems. Lutron’s residential lighting control systems include Caséta, RA2 Select, RadioRA2, and HomeWorks QS. Caséta and RA2 Select are intended for the DIY user segment while the RadioRA2 and HomeWorks QS product lines are intended for the system installer/integrator segment. Continue reading How To: Lutron Caséta Lighting Control System Review Updated

How To: Ubiquiti UniFi Security Gateway Pro 4 & Intrusion Prevention (IPS) Updated

The focus of this article is the upgrade of our security gateway from the entry-level model, USG, to the mid-level model, the USG Pro 4. Because our primary reason for upgrading was to enable Unifi’s new intrusion prevention system, that will be covered in detail, below. This is the fourth of my articles covering our family’s experiences with Ubiquiti’s Unifi product line including the security gateway, controller, switches, and WiFi access points in a home environment Continue reading How To: Ubiquiti UniFi Security Gateway Pro 4 & Intrusion Prevention (IPS) Updated