Part 3: Some Basic Math/Stat Concepts for the wanna be Data Scientists

Conditional Probability and PDF

"The conditional probability of an event B is the probability that the event will occur given the knowledge that an event A has already occurred.

This probability is written P(B|A), notation for the probability of B given A. "

"In the case where events A and B are independent (where event A has no effect on the probability of event B), the conditional probability of event B given event A is simply the probability of event B, that is P(B).

If events A and B are not independent, then the probability of the intersection of A and B (the probability that both events occur) is defined by

P(A and B) = P(A)P(B|A)." Multiplication rule

Ref: http://www.stat.yale.edu/Courses/1997-98/101/condprob.htm

Truncated Distribution
"In statistics, a truncated distribution is a conditional distribution that results from restricting the domain of some other probability distribution. Truncated distributions arise in practical statistics in cases where the ability to record, or even to know about, occurrences is limited to values which lie above or below a given threshold or within a specified range.

For example, if the dates of birth of children in a school are examined, these would typically be subject to truncation relative to those of all children in the area given that the school accepts only children in a given age range on a specific date. There would be no information about how many children in the locality had dates of birth before or after the school's cutoff dates if only a direct approach to the school were used to obtain information."

"

Probability density function for the truncated normal distribution for different sets of parameters. In all cases, a = −10 and b = 10. For the black: μ = −8, σ = 2; blue: μ = 0, σ = 2; red: μ = 9, σ = 10; orange: μ = 0, σ = 10.
Support x \in (a,b]
PDF \frac{g(x)}{F(b)-F(a)}
CDF {\displaystyle {\frac {\int _{a}^{x}g(t)dt}{F(b)-F(a)}}={\frac {F(x)-F(a)}{F(b)-F(a)}}}
Mean \frac{\int_a^b x g(x) dx}{F(b)-F(a)}
Median {\displaystyle F^{-1}\left({\frac {F(a)+F(b)}{2}}\right)}

"

https://en.wikipedia.org/wiki/Truncated_distribution

Law of Total Probability

Bayes’s theorem

In probability theory and statistics, Bayes’s theorem describes the probability of an event, based on prior knowledge of conditions that might be related to the event. Wikipedia

Formula
P(A\mid B)=\frac {P(B\mid A) \cdot P(A)}{P(B)}

A, B = events
P(A|B) = probability of A given B is true
P(B|A) = probability of B given A is true
P(A), P(B) = the independent probabilities of A and B

Ref: https://en.wikipedia.org/wiki/Bayes'_theorem

Bayes Formula for Random Variables:

http://pwp.gatech.edu/ece-jrom/wp-content/uploads/sites/436/2017/08/16_BayesRVs-su14.pdf

Using the above equation for the bayes rule for discrete random variable

Bayes formula for Continuous Random Variable

Using:

Conditional Expectation : Discrete Case

Conditional Expectation : Continuous Case

Ref: https://www.math.arizona.edu/~tgk/464_07/cond_exp.pdf

Gaussian Random Variables:

The PDF:

Ref: https://www.sciencedirect.com/topics/engineering/gaussian-random-variable

Gaussian Random Vector:

Ref: http://statweb.stanford.edu/~kjross/Lec11_1015.pdf

The text and images are from the Internet. References are provided.

 

Sayed Ahmed
BSc. Eng. in Comp. Sc. & Eng. (BUET)
MSc. in Comp. Sc. (U of Manitoba, Canada)
MSc. in Data Science and Analytics (Ryerson University, Canada)
Bloghttp://Bangla.SaLearningSchool.comhttp://SitesTree.com
Online and Offline Training: http://Training.SitesTree.com 
Our free or paid events on IT/Data Science/Cloud/Programming/Similar: https://www.facebook.com/justetcsocial
 
Get access to courses on Big Data, Data Science,  AI, Cloud, Linux, System Admin, Web Development and Misc. related. Also, create your own course to sell to others. http://sitestree.com/training/
 
If you want to contribute to the operation of this site (Bangla.SaLearn) including occasional free and/or low cost online/offline training: http://Training.SitesTree.com (or charitable/non-profit work in the education/health/social service sector), you can financially contribute to: safoundation at salearningschool.com using Paypal or Credit Card (on http://sitestree.com/training/enrol/index.php?id=114 ).