microsoft

Artificial Intelligence, Technology

Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware Updated

Generative artificial intelligence and conversational chatbots like ChatGPT have made headlines in recent months. These virtual assistants sound nearly human because they are based on extremely large datasets that contain real human conversations or other sources of data that contain the desired output for a given input.  Hobbyists and open source enthusiasts are experimenting with ways to run size optimized versions of large language models that have been tuned for instruction based interaction with humans and run locally on consumer-grade hardware. Continue reading Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware Updated

Mike Connelly
Connected Home

My Wish List for the Next Apple TV & tvOS Updated

It has been about two years since the Apple TV 4K was released, the average time between Apple TV refreshes. So, it is timely to consider what comes next. This is my wish list for the successor to the Apple TV 4K, as well as improvements to tvOS. It’s what I would build were I the product owner of Apple TV. As a videophile, I overindex on features like video and audio quality. However, my suggestions also are based on our family’s initial experiences with Apple’s new gaming service, Apple Arcade. Continue reading My Wish List for the Next Apple TV & tvOS Updated

Mike Connelly
Connected Home, Music

Sonos One & Sonos Beam (Part 2): Review of Voice Services Including Amazon Alexa, Google Assistant & Apple Airplay 2 Updated

Sonos speakers will be able to bridge the gaps between Amazon, Apple, and Google’s smart home ecosystems. Sonos owners will be in the unique position of choosing their preferred voice assistant for a task, independent from the music source, method of streaming, or smart home control. For example, a Sonos owner could maintain their music library in iTunes, their music subscription service on YouTube or Amazon, their home control on Apple HomeKit, and ask general knowledge questions to Google Assistant or Alexa. Similarly, Sonos consumers could control Nest and HomeKit devices from a single smart speaker. Continue reading Sonos One & Sonos Beam (Part 2): Review of Voice Services Including Amazon Alexa, Google Assistant & Apple Airplay 2 Updated

Mike Connelly
Connected Home, Music

Sonos One & Sonos Beam (Part 1): The State of Smart Speakers Updated

Amazon Echo’s primary function appears to be extending Amazon’s ecosystem including e-commerce and advertising. Like Amazon, Google Home’s primary goal appears to be lowering the price of its devices so that users will install multiple devices in their homes, generating more user data for Google’s advertising business. Apple’s product design treats smart speakers as a relatively dumb and local extension of the iPhone. The Sonos One hits the price-performance sweet spot: although it costs nearly twice what an Echo or Home does, it provides significantly better sound. Continue reading Sonos One & Sonos Beam (Part 1): The State of Smart Speakers Updated

Mike Connelly
Connected Home

Nvidia Shield Android TV: 2017 Hardware & Shield Experience 5.1 Review Updated

The Shield TV continues to be an anomaly: it is by far the most powerful media streamer and a capable gaming platform though not as advanced as the Xbox One or Playstation 4, while costing nearly as much. While Google focuses on stripped down Chromecast devices and Chromecast-enabled TVs, Nvidia singularly showcases the advanced functionality of Android TV including DVR, media serving, gaming, and now smart home capabilities. Though Nvidia is touting the Shield TV and AI home, Google is the AI element and Nvidia is the hardware manufacturer.
Continue reading Nvidia Shield Android TV: 2017 Hardware & Shield Experience 5.1 Review Updated

Mike Connelly