
Founder of @LeadershipData. Global Speaker. Leading Social & B2B Influencer of Data Science, AI, ML. PhD Astrophysics @Caltech. AAS Legacy Fellow (@AAS_Office)
Maryland, USA
Joined March 2012
- Tweets2K
- Following3.4K
- Followers497K
- Likes281K
Pinned Tweet
Join my X subscriber community for exclusive perks!
teapawt.net/KirkDBorne/creator-sub…
A story about Survivorship Bias and how a young statistician identified this cognitive bias and saved lives:
During World War II, the U.S. wanted to add reinforcement armor to specific areas of its planes.
Analysts examined returning bombers, plotted the bullet holes and damage on them (as in the image below), and came to the conclusion that adding armor to the tail, body, and wings would improve their odds of survival.
But a young statistician named Abraham Wald noted that this would be a tragic mistake.
By only plotting data on the planes that returned, they were systematically omitting the data on a critical, informative subset:
The planes that were damaged and unable to return.
• The "seen" planes had sustained damage that was survivable.
• The "unseen" planes had sustained damage that was not.
Wald concluded that armor should be added to the *unharmed* regions of the returning planes (the areas without bullet holes on the image below).
His profound logic: Where the survivors were unharmed was actually where the planes were most vulnerable.
Based on his insight, the military reinforced the engine and other vulnerable parts, significantly improving the safety of the crews during combat and saving thousands of lives.
Abraham Wald had identified a cognitive bias called "Survivorship Bias":
The error resulting from systematically focusing on survivors (successes) and ignoring casualties (failures) that causes us to miss the true base rates of survival (the actual probability of success) and arrive at flawed conclusions.
Survivorship Bias is all around us — its cost to business can be huge.
What is unseen often has more value than what is seen.
Awesome updated 309-page PDF eBook >> "Patterns, Predictions, and Actions: Foundations of Machine Learning" at arxiv.org/abs/2102.05242
…sharpen your Probability, Calculus, and Linear Algebra knowledge with this!
—————
#ML #DataScience #DataScientist
2
860
A First Course in Causal Inference: arxiv.org/abs/2305.18793
[490-page PDF download]
+ Also see the book "Causal Inference in Statistics: A Primer" at amzn.to/3Mrm2wO by @yudapearl
#Probability #Mathematics #DataScience #ML #MachineLearning #DataScientist
3
756
[Read free 704-page PDF online] Introduction to Probability for Data Science: probability4datascience.com
—————
#Mathematics #DataScience #DataScientist #Statistics
6
781
Follow the thread below to find the PDF of the short textbook "An Elementary Introduction to Information Geometry" by @FrnkNlsn.
@burkov summary: “The book provides a foundational entry into the differential geometric study of probability, statistics, and machine learning.”
A short textbook "An elementary introduction to information geometry" by Frank Nielsen (2020) is now in the @ChapterPal's collection.
The book provides a foundational entry into the differential geometric study of probability, statistics, and machine learning.
Designed for graduate students, researchers, and practitioners in information sciences, the book assumes a basic working knowledge of linear algebra, multivariable calculus, and classical probability and statistics.
While the text introduces the necessary differential geometry from first principles—covering tangent spaces, metric tensor fields, and affine connections—prior familiarity with basic differential notation helps reader comprehension.
The scope focuses primarily on finite-dimensional parametric families of probability distributions, presenting geometric frameworks to analyze decision-making, estimation, and optimization.
All books on ChapterPal are free to read with a free account,
Read the book with an AI tutor: chapterpal.com/ebook/adec358…
The table of contens:
1. Introduction
- 1.1. Overview of information geometry
- 1.2. Outline of the survey
- References
2. Prerequisite: Basics of differential geometry
- 2.1. Overview of differential geometry: Manifold $(M, g, \nabla)$
- 2.2. Metric tensor fields $g$
- 2.3. Affine connections $\nabla$
* 2.3.1 Covariant derivatives $\nabla_X Y$ of vector fields
* 2.3.2 Parallel transport $\prod^\nabla_c$ along a smooth curve $c$
* 2.3.3 $\nabla$-geodesics $\gamma_\nabla$: Autoparallel curves
* 2.3.4 Curvature and torsion of a manifold
- 2.4. The fundamental theorem of Riemannian geometry: The Levi-Civita metric connection
- 2.5. Preview: Information geometry versus Riemannian geometry
- References
3. Information manifolds
- 3.1. Overview
- 3.2. Conjugate connection manifolds: $(M, g, \nabla, \nabla^*)$
- 3.3. Statistical manifolds: $(M, g, C)$
- 3.4. A family $\{(M, g, \nabla^{-\alpha}, \nabla^{\alpha}=(\nabla^{-\alpha})^*)\}_{\alpha\in \mathbb{R}}$ of conjugate connection manifolds
- 3.5. The fundamental theorem of information geometry: $\nabla$ $\kappa$-curved $\Leftrightarrow$ $\nabla^*$ $\kappa$-curved
- 3.6. Conjugate connections from divergences: $(M, D)\equiv (M, {^{D}}g, {^{D}}\nabla, {^{D}}\nabla^*={^{D^*}}\nabla)$
- 3.7. Dually flat manifolds (Bregman geometry): $(M, F)\equiv (M, {^{B_F}}g, {^{B_F}}\nabla, {^{B_F}}\nabla^*={^{B_{F^*}}}\nabla)$
- 3.8. Hessian $\alpha$-geometry: $(M, F, \alpha)\equiv (M, {^{F}}g, {^{F}}\nabla^{-\alpha}, {^{F}}\nabla^\alpha$
- 3.9. Expected $\alpha$-manifolds of a family of parametric probability distributions: $(\mathcal{P}, {_{\mathcal{P}}}g, {_{\mathcal{P}}}\nabla^{-\alpha}, {_{\mathcal{P}}}\nabla^{\alpha})$
- 3.10. Criteria for statistical invariance
- 3.11. Fisher-Rao expected Riemannian manifolds: $(\mathcal{P}, {_{\mathcal{P}}}g)$
- 3.12. The monotone $\alpha$-embeddings and the metric gauge freedom
- 3.13. Dually flat spaces and canonical Bregman divergences
- References
4. Some applications of information geometry
- 4.1. Natural gradient in Riemannian space
* 4.1.1 The vanilla gradient descent method
* 4.1.2 Natural gradient and its connection with the Riemannian gradient
* 4.1.3 Natural gradient in dually flat spaces: Connections to Bregman mirror descent and ordinary gradient
* 4.1.4 An application of the natural gradient: Natural Evolution Strategies (NESs)
- 4.2. Some illustrating applications of dually flat manifolds
- 4.3. Hypothesis testing in the dually flat exponential family manifold $(\mathcal{E}, \mathrm{KL}^*)$
- 4.4. Clustering mixtures in the dually flat mixture family manifold $(\mathcal{M}, \mathrm{KL})$
- References
5. Conclusion: Summary, historical background, and perspectives
- 5.1. Summary
- 5.2. A brief historical review of information geometry
- 5.3. Perspectives
- References
A. Monte Carlo estimations of $F$-divergences
- References
B. The multivariate Gaussian family: An exponential family
- References
Notations
Networks — Probability and Statistics (Cambridge Series in Statistical and Probabilistic Mathematics)
Get it at link.amazon/B0dmyOsFo
4
796
Probability and Statistics Essentials for Data Science and Machine Learning, with 200+ examples and illustrations: amzn.to/4xS1yjH
729
Introduction To Probability [2nd Edition. 528 pages]: link.amazon/B0cxNN5Ad
...covers probability theory (probabilistic models, discrete and continuous random variables, multiple random variables, and limit theorems), stochastic processes, and probabilistic models used in science, engineering, economics, and related fields. The main new feature of the 2nd edition is thorough introduction to Bayesian and classical statistics.
Learn Probability Through Problems (exercises, hints, and solutions provided): amzn.to/3vZed8W
—————
#Statistics #DataScience #Mathematics #DataScientist
1
760
What are the Chances of That? How to Think About Uncertainty: amzn.to/4q7atJi by @itabn_andrew
#Probability #Statistics #Mathematics
1
719
Probability Theory for Quantitative Scientists: link.amazon/B0ir9Awye
+
Infographic from @matharium
Introduction to the Probability Theory: link.amazon/B0aXUXQ8e
+
Winning Ways for Your Mathematical Plays: link.amazon/B06hjpnkB
793
One light-day visualized — look here: wbaltv.com/article/light-day… — that’s how far NASA’s Voyager 1 space probe is from Earth, as of the morning of November 18, the result of approximately 49 years of travel into space since it was launched.
From @NASA …
Let's talk about Voyager 1 and 2!
Join us Nov. 19 for a status update on the twin probes and a discussion of their unique mission. Plus, we'll have a Q&A session and a sneak peek at the upcoming NASA+ Voyager documentary. go.nasa.gov/4k942pz

ALT An artist's concept of the Voyager spacecraft, with its long antenna pointing down and to the right in the direction of Earth. Earth isn't visible in the image, but Voyager is among the stars. In the background, there is also a long, deep blue ribbon of gas and dust stretching from the bottom of the image to the top.
147
Probability and Statistics — The Science of Uncertainty (Second Edition): utstat.utoronto.ca/mikevans/…
🌟Download 774-page downloadable PDF + 369-page Solutions Manual PDF🌟
[PDF] Self-Improving and Adapting LLM Architectures
Source: linkedin.com/posts/karan-cha…
7
1,359
Single class classifiers (machine learning one-class classification OCC algorithms) are often overlooked when dealing with multi-class datasets.
Why would OCC be considered useful? Well, if you try to maximize performance across a multidimensional objective function, you tend to allow larger errors in some classes in order to reduce error in other (perhaps difficult-to-classify) classes. Sacrificing performance in perhaps one of the most critical classes simply to make the overall model look good can be a poor decision. RMSE is an example of a metric that minimizes error over a large range of data, which could be dangerous when the accuracy of one smaller segment of the data really requires higher performance than the rest of the data.
Example: looking for fraud (a specific category of behavior) in a complex financial data ecosystem (representing many different “normal” behaviors) should receive specific targeted attention. Who cares if you classify with high accuracy all the non-fraud categories during your first machine learning classification run over the dataset. First separate fraud from non-fraud cases with the highest possible accuracy. Then deal urgently with these fraud cases, as highest priority. Then, the non-fraud group of numerous diverse behavior categories can be partitioned with your favorite multi-class classifier(s) according to the organization’s needs and requirements. Years ago, I did some consulting for a large federal agency where we did exactly this!
Similar examples can be given in other domains: acute medical diagnoses, network intrusions, industrial machine predictive maintenance monitoring, environmental monitoring, etc.
See the attached screenshot of Google’s AI response to my query about OCC.
So, the OCC can give you a gold standard classifier to serve your highest priority need first. Then you can resume normal machine learning. 😎
3 OCC resources:
OCC on Wikipedia: en.wikipedia.org/wiki/One-cl…
+
ML Mastery tutorial: machinelearningmastery.com/o…
+
Review of techniques [35-page PDF]: arxiv.org/pdf/1312.0049v1
This GitHub repo provides access to the huge multi-volume “Machine Learning & AI Systems” freely downloadable PDF textbook series, and more: github.com/harvard-edge/cs24…
[461-page PDF eBook] Physics-based Deep Learning: arxiv.org/abs/2109.05237
+
Learn more at: physicsbaseddeeplearning.org…
——————
#AI #MachineLearning #ML #DataScience #NeuralNetworks #Algorithms #Mathematics #DataScientist
Complete collection of classic AI & ML textbooks now directly available for download as free PDF files — below ⤵️
剑桥这回直接扔王炸了!!
AI & ML经典教材全集直接免费开放,PDF随便下。
想学机器学习又不想被割韭菜买高价课的,这十本刷完,底子基本就硬了。
顺序从易到难排好了:
1️⃣ 《机器学习理解》——理论算法一把抓,零基础入门首选
🔗 cs.huji.ac.il/~shais/Underst…
2️⃣ 《机器学习数学基础》——数学底子弱的先把这本补上
🔗 mml-book.github.io/book/mml-…
3️⃣ 《机器学习算法的数学分析》——深入数学原理
🔗 tongzhang-ml.org/lt-book/lt-…
4️⃣ 《深度学习理论原理》——搞懂DL背后的理论根基
🔗 arxiv.org/pdf/2106.10165
5️⃣ 《神经网络与机器学习》——神经网络的系统讲解
🔗 arxiv.org/pdf/1901.05639
6️⃣ 《图深度学习》——图神经网络入门必读
🔗 yaoma24.github.io/dlg_book/d…
7️⃣ 《机器学习的算法视角》——从算法角度重新理解ML
🔗 people.csail.mit.edu/moitra/…
8️⃣ 《概率论:理论与实例》——概率基础打牢
🔗 sites.math.duke.edu/~rtd/PTE…
9️⃣ 《应用概率基础》——概率论实战应用
🔗 sites.math.duke.edu/~rtd/EP4…
🔟 《高级数据分析》——数据科学进阶必备
🔗 stat.cmu.edu/~cshalizi/ADAfa…
说句实话,这些书没一本是轻松的,别指望躺着翻完。
但只要你能硬啃下来两三本,比听群里吹一年AI牛逼都管用。
2
1,334























