Hi Reader, āLast week, I encouraged you to experiment with different LLMs, since thereās no one model that is superior across all use cases. Specifically, I suggested you try using Chatbot Arena, which allows you to chat with multiple models at once. Itās completely free, but has two significant disadvantages:
Today, I want to offer you a better method for experimenting with LLMs, and itās the method I personally use. But first, we need to talk about LLM pricing⦠š· Whatās the cheapest way to access LLMs?If youāre familiar with ChatGPT, you probably know that it offers a limited Free plan and a $20/month Plus plan. But did you know that thereās a more flexible, affordable way to access the paid features of ChatGPT? If you access LLMs via API, you actually pay per ātokenā, which is roughly equivalent to a word. The LLM I use the most, GPT-4o mini, costs only $0.15 per million āinput tokensā (what you send to it) and $0.60 per million āoutput tokensā (what it sends back). That means most of my conversations cost fractions of a cent! And when I want to use a more powerful model (like Claude 3.5 Sonnet), I pay perhaps $0.10 for a conversation. In summary, accessing LLMs via API means that you can use whichever models you need, and only pay for the tokens you use. Win-win! š How to access LLMs via APIIf you like the idea of accessing LLMs in a flexible, affordable way, thereās only two things you need to get started:
An āAPI keyā is just a unique identifier that allows you to access a web service. For example, my API key from OpenAI allows me to use their models, and they bill me for the usage. Once you have an API key, you need an interface for chatting with the LLM. My preferred interface is TypingMind: All you have to do is give TypingMind your API key, and it will communicate with the LLM on your behalf! I love TypingMind because itās so easy to switch between different LLMs while still tracking your conversation history in one place. Itās also got a ton of power user features: AI agents, plugins, voice mode, document upload, cloud sync, etc. ā© Action itemsThis week, I want you to try using an LLM via API. Here are the steps:
Next time, I'll give you tips for how to get the best results from LLMs!
Tuesday Tips is on pause during the holiday break, so I'll see you in 2025! - Kevin P.S. Your workouts are a work of art (27-second video, turn on audio!) Also: behind the scenes. ā Did someone AWESOME forward you this email? Sign up here to receive weekly Artificial Intelligence tips! |
Join 25,000+ intelligent readers and receive AI tips every Tuesday!
Hi Reader, Hope youāve had a nice summer! āļø As for me, Iāve been finishing my first ever book! I canāt wait to tell you about it and invite you to be part of the launch⦠stay tuned š Today's email focuses on a single important topic: AIās impact on your mental health š§ Read more below! š Sponsored by: Morning Brew The 5-Minute Newsletter That Makes Business Make Sense Business news doesn't have to be dry. Morning Brew gives you the biggest stories in business, tech, and finance with quick...
Hi Reader, Most of us access Large Language Models (LLMs) through a web interface, like ChatGPT or Claude. Itās highly convenient, though there are two potential drawbacks: Cost: Some amount of usage is free, but heavy usage (or access to premium models) costs money. Privacy: Depending on the service, your chats may be used to train future models. (Or at the very least, your chats may be accessed if ordered by a court.) One solution is to run an LLM locally, which has gotten much easier with...
Hi Reader, Here are your top AI stories for the week: AI-driven education in 2 hours per day Add yourself to an AI-generated TV show AI models send "subliminal messages" to one another Read more below! š Sponsored by: Superhuman AI Find out why 1M+ professionals read Superhuman AI daily. AI won't take over the world. People who know how to use AI will. Here's how to stay ahead with AI: Sign up for Superhuman AI. The AI newsletter read by 1M+ pros. Master AI tools, tutorials, and news in just...