Newsrooms can only get so far with pasting prompts into ChatGPT. Once you want to get more serious with generative AI, a media business should think seriously about running, fine-tuning, and perhaps even building their own large language model (LLM).
There are a number of approaches to this, and it's easy enough to download a commercial or open-source model to run on your private cloud, or even your MacBook. But what are the factors to consider when rolling your own AI operation, and how expensive can it get?
In this week's conversation, John Biggs talks with Viktor Shpak, lead developer for VisibleMagic, about what it takes to run your own LLM in the privacy of your own office. He also explores the future of AI-generated content and code, pointing out that the rising AI tide will — theoretically — lift all boats. We're grateful we had the chance to probe the mind of an extremely plugged-in developer.
In Conversation: Viktor Shpak on Running Your Own LLM