Tuesday Tip #26: Get your ML project started quickly 📈


Hi Reader,

In case you haven’t checked out the Data School blog in a while, I’ve published a few new posts:

These are expanded versions of past Tuesday Tips!


🔗 Link of the week

SQL Tutorial for Data Scientists & Data Analysts (free)

Although Python dominated the “Top Programming Languages of 2023”, SQL took first place when ranked by job postings 🥇 (source).

If you’re looking to learn SQL, the tutorial above includes 30+ lessons and 40+ practice problems you can try directly in the browser, some of which were sourced from real Data Science interviews!


👉 Tip #26: Start with a logistic regression model

When faced with a new classification problem, Machine Learning practitioners have a dizzying array of algorithms from which to choose: Naive Bayes, decision trees, Random Forests, XGBoost, neural networks, and many others.

Where should you start? For many practitioners (including myself), the first algorithm to reach for is one of the oldest in the field: Logistic regression.

Here are a few attributes of logistic regression that make it incredibly popular:

  • Runs fast
  • Highly interpretable
  • Doesn’t necessarily require input features to be scaled
  • Can generate a meaningful baseline without any tuning
  • Easy to regularize
  • Outputs well-calibrated predicted probabilities

In other words, it helps you to get going quickly with your Machine Learning project! You can focus your energy on building your initial ML pipeline (from data ingestion to prediction) without spending much computational time or code on model training and tuning.


Understanding logistic regression

Although you can use a ML algorithm without truly understanding it, learning how it works will ultimately help you to develop an intuition for when to use it and how to tune it.

To gain that deeper understanding, I recommend reading this lesson from my Data Science course:

🔗 Logistic regression lesson (Jupyter notebook)

During this lesson, you’ll learn:

  • Why is it called “logistic regression” if it’s used for classification?
  • Why is it considered a linear model?
  • How do you interpret the model coefficients?
  • How does it generate class predictions?
  • What are its advantages and disadvantages?

If you get stuck on any of the concepts in the lesson, the resources listed in my logistic regression guide will help you to get un-stuck!


Tuning logistic regression

If you’ve decided to use logistic regression, you’ll need to tune it in order to maximize its performance. I’ve got a short video that will teach you how to tune logistic regression in scikit-learn:

🔗 Important tuning parameters for LogisticRegression (video)

For more details, check out the scikit-learn documentation.


If you enjoyed this week’s tip, please forward it to a friend! Takes only a few seconds, and it really helps me grow the newsletter! 🚀

See you next Tuesday!

- Kevin

P.S. I thought you said this was a linear system

Did someone awesome forward you this email? Sign up here to receive Data Science tips every week!

Learn Artificial Intelligence from Data School 🤖

Join 25,000+ intelligent readers and receive AI tips every Tuesday!

Read more from Learn Artificial Intelligence from Data School 🤖

Hi Reader, Today I'm trying something brand new! I wrote short summaries of the 5 most important AI stories this week, and also turned it into a video: Watch the video I'd love to know what you think! 💬 AI-generated TV ad airs during NBA finals Prediction market Kalshi just aired this AI-generated ad on network TV during the NBA finals. It was created in just two days by one person using Google's new Veo 3 video model, plus scripting help from Google's Gemini chatbot. Expect to see many more...

Hi Reader, Thanks for sticking with me through last week’s course launch! 🙏 As you may have noticed, Tuesday Tips has been on pause for a few months. I was focused on launching the course, plus I’ve been working on a book 🤫 I can’t promise a new tip every Tuesday, but I’ll do my best to provide you with valuable content as time permits. As for today’s tip, I’m trying out something new… 👇 Sponsored by: Superhuman AI Find out why 1M+ professionals read Superhuman AI daily. AI won't take over...

Hi Reader, This week, I've got a short tip about AI agents, followed by some Data School news... 👉 Tip #56: What are AI agents? Google is calling 2025 "the agentic era," DeepLearning.AI says "the agentic era is upon us," and NVIDIA's founder says "one of the most important things happening in the world of enterprise is agentic AI." Clearly AI agents are a big deal, but what exactly are they? Simply put, an AI agent is an application that uses a Large Language Model (LLM) to control its...