this post was submitted on 08 Jul 2024
528 points (97.1% liked)

Science Memes

11021 readers
3990 users here now

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.



Rules

  1. Don't throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.

This is a science community. We use the Dawkins definition of meme.



Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 0 points 4 months ago (1 children)

"If parameters aren’t neatly interpretable then it’s bad statistics."

Haha, keep going guys. You obviously know a lot about statistics.

[–] [email protected] 0 points 4 months ago (1 children)

https://www.nature.com/articles/nmeth.4642

This article use different wording than me, but in essence: Statistics is mostly about using a known model to explain the data. Machine Learning is mostly about finding any model that predicts the data well. Different purposes with some overlap. Some statistical methods are used in Machine Learning, but that doesn’t necessarily mean all of Machine Learning is statistics.

The boundary between statistical inference and ML is subject to debate—some methods fall squarely into one or the other domain, but many are used in both. […] Statistics requires us to choose a model that incorporates our knowledge of the system, and ML requires us to choose a predictive algorithm by relying on its empirical capabilities.

Another (potentially lower quality) article that is not from Nature, but discusses the meme in particular:

https://www.datarobot.com/blog/statistics-and-machine-learning-whats-the-difference/

Because of the large number of variables in machine learning datasets, the models developed from them can be simultaneously extremely accurate and almost impossible to understand. Statistical models, on the other hand are typically easier to understand because they are based on fewer variables, and the accuracy of relationships is supported by tests of statistical significance.

[–] [email protected] 1 points 4 months ago* (last edited 4 months ago)

Seeing your comment I wondered how someone publishing in Nature could have possibly left out the use of statistics for prediction. That would be a wild oversight that only someone with little knowledge of the topic would make, and surely not something that the editors of Nature would miss. Upon clicking the link I see that they mentioned it in the very first sentence and apparently ignore it if someone happens to call the prediction model a machine learning model. Using statistical models for prediction has been used since the start of the field, and renaming things that have been used for decades as "machine learning" doesn't suddenly make them not statistics.

Artificial neural networks are statistical models, with numerous statistical approaches associated with their use, development and interpretation.