Hypothesis testing

 

Hypothesis testing

Hypothesis testing is a form of statistical inference that uses data from a sample to draw conclusions about a population parameter or a population probability distribution. First, a tentative assumption is made about the parameter or distribution. This assumption is called the null hypothesis and is denoted by H0. An alternative hypothesis (denoted Ha), which is the opposite of what is stated in the null hypothesis, is then defined. The hypothesis-testing procedure involves using sample data to determine whether or not H0 can be rejected. If H0 is rejected, the statistical conclusion is that the alternative hypothesis Ha is true.

For example, assume that a radio station selects the music it plays based on the assumption that the average age of its listening audience is 30 years. To determine whether this assumption is valid, a hypothesis test could be conducted with the null hypothesis given as H0: μ = 30 and the alternative hypothesis given as Ha: μ ≠ 30. Based on a sample of individuals from the listening audience, the sample mean age, x̄, can be computed and used to determine whether there is sufficient statistical evidence to reject H0. Conceptually, a value of the sample mean that is “close” to 30 is consistent with the null hypothesis, while a value of the sample mean that is “not close” to 30 provides support for the alternative hypothesis. What is considered “close” and “not close” is determined by using the sampling distribution of x̄.

Ideally, the hypothesis-testing procedure leads to the acceptance of H0 when H0 is true and the rejection of H0 when H0 is false. Unfortunately, since hypothesis tests are based on sample information, the possibility of errors must be considered. A type I error corresponds to rejecting H0 when H0 is actually true, and a type II error corresponds to accepting H0 when H0 is false. The probability of making a type I error is denoted by α, and the probability of making a type II error is denoted by β.

In using the hypothesis-testing procedure to determine if the null hypothesis should be rejected, the person conducting the hypothesis test specifies the maximum allowable probability of making a type I error, called the level of significance for the test. Common choices for the level of significance are α = 0.05 and α = 0.01. Although most applications of hypothesis testing control the probability of making a type I error, they do not always control the probability of making a type II error. A graph known as an operating-characteristic curve can be constructed to show how changes in the sample size affect the probability of making a type II error.

A concept known as the p-value provides a convenient basis for drawing conclusions in hypothesis-testing applications. The p-value is a measure of how likely the sample results are, assuming the null hypothesis is true; the smaller the p-value, the less likely the sample results. If the p-value is less than α, the null hypothesis can be rejected; otherwise, the null hypothesis cannot be rejected. The p-value is often called the observed level of significance for the test.

A hypothesis test can be performed on parameters of one or more populations as well as in a variety of other situations. In each instance, the process begins with the formulation of null and alternative hypotheses about the population. In addition to the population mean, hypothesis-testing procedures are available for population parameters such as proportions, variances, standard deviations, and medians.

Hypothesis tests are also conducted in regression and correlation analysis to determine if the regression relationship and the correlation coefficient are statistically significant (see below Regression and correlation analysis). A goodness-of-fit test refers to a hypothesis test in which the null hypothesis is that the population has a specific probability distribution, such as a normal probability distribution. Nonparametric statistical methods also involve a variety of hypothesis-testing procedures.

Comments

Post a Comment

Popular posts from this blog

Regression and correlation analysis

Image
  Regression and  correlation  analysis Regression analysis involves identifying the relationship between a  dependent variable and one or more  independent variables . A model of the relationship is hypothesized, and estimates of the  parameter  values are used to develop an  estimated regression equation . Various tests are then employed to determine if the model is satisfactory. If the model is deemed satisfactory, the estimated regression equation can be used to predict the value of the dependent variable given values for the independent variables. Regression model In  simple linear regression , the model used to describe the relationship between a single dependent variable  y  and a single independent variable  x  is  y  = β 0  + β 1 x  + ε. β 0  and β 1  are referred to as the  model parameters, and ε is a  probabilistic error term that accounts for the variability in  y  that cannot be explained by the linear relationship with  x . If the  error  term were not present, the model
Read more

Topological data analysis

Image
  Topological data analysis 5 languages Article Talk Read Edit View history From Wikipedia, the free encyclopedia In  applied mathematics ,  topological based data analysis  ( TDA ) is an approach to the analysis of datasets using techniques from  topology . Extraction of information from datasets that are high-dimensional, incomplete and noisy is generally challenging. TDA provides a general framework to analyze such data in a manner that is insensitive to the particular  metric  chosen and provides  dimensionality reduction  and robustness to noise. Beyond this, it inherits  functoriality , a fundamental concept of modern mathematics, from its topological nature, which allows it to adapt to new mathematical tools. [ citation needed ] The initial motivation is to study the shape of data. TDA has combined  algebraic topology  and other tools from pure mathematics to allow mathematically rigorous study of "shape". The main tool is  persistent homology , an adaptation of  homol
Read more

Structure theorem

Image
  Structure theorem [ edit ] The structure theorem is of central importance to TDA; as commented by G. Carlsson, "what makes homology useful as a discriminator between topological spaces is the fact that there is a classification theorem for finitely generated abelian groups." [3]  (see the  fundamental theorem of finitely generated abelian groups ). The main argument used in the proof of the original structure theorem is the standard  structure theorem for finitely generated modules over a principal ideal domain . [9]  However, this argument fails if the indexing set is  ( � , ≤ ) . [3] In general, not every persistence module can be decomposed into intervals. [70]  Many attempts have been made at relaxing the restrictions of the original structure theorem. [ clarification needed ]  The case for pointwise finite-dimensional persistence modules indexed by a locally finite subset of  �  is solved based on the work of Webb. [71]  The most notable result is done by Crawley-Boeve
Read more