profile

Learn Data Science from Data School ๐Ÿ“Š

Tuesday Tip #26: Get your ML project started quickly ๐Ÿ“ˆ

Published 7 months agoย โ€ขย 2 min read

Hi Reader,

In case you havenโ€™t checked out the Data School blog in a while, Iโ€™ve published a few new posts:

These are expanded versions of past Tuesday Tips!


๐Ÿ”— Link of the week

โ€‹SQL Tutorial for Data Scientists & Data Analysts (free)

Although Python dominated the โ€œTop Programming Languages of 2023โ€, SQL took first place when ranked by job postings ๐Ÿฅ‡ (source).

If youโ€™re looking to learn SQL, the tutorial above includes 30+ lessons and 40+ practice problems you can try directly in the browser, some of which were sourced from real Data Science interviews!


๐Ÿ‘‰ Tip #26: Start with a logistic regression model

When faced with a new classification problem, Machine Learning practitioners have a dizzying array of algorithms from which to choose: Naive Bayes, decision trees, Random Forests, XGBoost, neural networks, and many others.

Where should you start? For many practitioners (including myself), the first algorithm to reach for is one of the oldest in the field: Logistic regression.

Here are a few attributes of logistic regression that make it incredibly popular:

  • Runs fast
  • Highly interpretable
  • Doesnโ€™t necessarily require input features to be scaled
  • Can generate a meaningful baseline without any tuning
  • Easy to regularize
  • Outputs well-calibrated predicted probabilities

In other words, it helps you to get going quickly with your Machine Learning project! You can focus your energy on building your initial ML pipeline (from data ingestion to prediction) without spending much computational time or code on model training and tuning.


Understanding logistic regression

Although you can use a ML algorithm without truly understanding it, learning how it works will ultimately help you to develop an intuition for when to use it and how to tune it.

To gain that deeper understanding, I recommend reading this lesson from my Data Science course:

๐Ÿ”— Logistic regression lesson (Jupyter notebook)

During this lesson, youโ€™ll learn:

  • Why is it called โ€œlogistic regressionโ€ if itโ€™s used for classification?
  • Why is it considered a linear model?
  • How do you interpret the model coefficients?
  • How does it generate class predictions?
  • What are its advantages and disadvantages?

If you get stuck on any of the concepts in the lesson, the resources listed in my logistic regression guide will help you to get un-stuck!


Tuning logistic regression

If youโ€™ve decided to use logistic regression, youโ€™ll need to tune it in order to maximize its performance. Iโ€™ve got a short video that will teach you how to tune logistic regression in scikit-learn:

๐Ÿ”— Important tuning parameters for LogisticRegression (video)

For more details, check out the scikit-learn documentation.


If you enjoyed this weekโ€™s tip, please forward it to a friend! Takes only a few seconds, and it really helps me grow the newsletter! ๐Ÿš€

See you next Tuesday!

- Kevin

P.S. I thought you said this was a linear systemโ€‹

Did someone awesome forward you this email? Sign up here to receive Data Science tips every week!

Learn Data Science from Data School ๐Ÿ“Š

Kevin Markham

Join 25,000+ aspiring Data Scientists and receive Python & Data Science tips every Tuesday!

Read more from Learn Data Science from Data School ๐Ÿ“Š

Hi Reader, happy Tuesday! My recent tips have been rather lengthy, so I'm going to mix it up with some shorter tips (like today's). Let me know what you think! ๐Ÿ’ฌ ๐Ÿ”— Link of the week A stealth attack came close to compromising the world's computers (The Economist) If you haven't heard about the recent "xz Utils backdoor", it's an absolutely fascinating/terrifying story! In short, a hacker (or team of hackers) spent years gaining the trust of an open-source project by making helpful...

13 days agoย โ€ขย 1 min read

Hi Reader, Today's tip is drawn directly from my upcoming course, Master Machine Learning with scikit-learn. You can read the tip below or watch it as a video! If you're interested in receiving more free lessons from the course (which won't be included in Tuesday Tips), you can join the waitlist by clicking here: Yes, I want more free lessons! ๐Ÿ‘‰ Tip #43: Should you discretize continuous features for Machine Learning? Let's say that you're working on a supervised Machine Learning problem, and...

20 days agoย โ€ขย 2 min read

Hi Reader, I'm so excited to share this week's tip with you! It has been in my head for months, but I finally put it in writing โœ๏ธ It's longer than usual, so if you prefer, you can read it as a blog post instead: Jupyter & IPython terminology explained ๐Ÿ”— Link of the week Python Problem-Solving Bootcamp (April 1-21) Want to improve your Python skills quickly? There's no better way than solving problems, reviewing alternative solutions, and exchanging ideas with others. That's the idea behind...

about 1 month agoย โ€ขย 3 min read
Share this post