Artificial Intelligence, Technology

Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware Updated

Generative artificial intelligence and conversational chatbots like ChatGPT have made headlines in recent months. These virtual assistants sound nearly human because they are based on extremely large datasets that contain real human conversations or other sources of data that contain the desired output for a given input.  Hobbyists and open source enthusiasts are experimenting with ways to run size optimized versions of large language models that have been tuned for instruction based interaction with humans and run locally on consumer-grade hardware. Continue reading Inference at the Edge: Running a Large Language Model Chatbot on Consumer Hardware Updated

Mike Connelly
Artificial Intelligence, Technology

A Primer on Conversational Artificial Intelligence Agents & Large Language Models Updated

Conversational agents and the large language models (LLM) at their core have become increasingly proficient at mimicking human language and behavior, so that they can respond to a wide variety of instructions. They have been shown to be effective in many different tasks such as question and answering, dialogue generation, text summarization, machine translation, and even programming. But the questions remain: do LLMS actually know anything? And, how do they actually work? Continue reading A Primer on Conversational Artificial Intelligence Agents & Large Language Models Updated

Mike Connelly