p-value
P values are used to measure the significance of the observed data. We also use p values to measure the correlation of two variables with each other. For example, in a linear correlation model, we can use p values to determine the relevance of the features included in the model to the target variable or the relevance of independent variables to each other.
In inferential statistics, the null hypothesis is a general proposition that accepts that there is nothing out of the ordinary. For example,
- there is no relationship between groups or variables, or
- there is no difference between the two measured phenomena.
Suppose we are conducting an experiment on a new drug that is claimed to increase IQ. We randomly sample a collection of volunteers and randomly assign them to two groups, Group A & B.
Group A is the control group and takes the placebo (no active ingredients) and B takes the actual pill.
In this case, the null hypothesis would be — “There is no difference between groups. That is, the drug has not potential benefit.”
We measure the IQs of all the volunteers and start giving the pills. After a certain period of time, we re-measure the participants’ IQs.
