6 Descriptive Statistics
Learn how to summarize data with frequency distributions and measures of center and spread, and how to choose and interpret those summaries in context.
What show
summarize observed data so that its typical value, variability, and pattern are easier to understand. They describe the data that were observed; by themselves, they do not establish causes or prove that the same pattern holds in a larger population. Numerical summaries are most useful when interpreted alongside the data’s context and, when appropriate, a graph.
distributions
A table organizes counts of how often values or categories appear. For categorical data, it can count labels such as product types or survey responses. When numerical data have many distinct values, they may instead be grouped into intervals: this can make patterns easier to see, but it hides the exact values within each interval.
is the fraction or percentage of all observations in a category:
adds counts up to and including a value. Cumulative adds the corresponding proportions. For ordered numerical values, these summaries answer questions such as how many observations are at or below a specified value, or what percentage are at or below it. Relative frequencies sum to , or , apart from possible rounding.
For the eight observations , the and cumulative summaries are:
Value : , , .
Value : , , .
Value : , , .
Value : , , .
Value : , , .
Value : , , .
Total: , .
Measures of center
The , , and describe a typical or central value, but they do so in different ways.
: Add all values and divide by their count. For a table, multiply each value by its , add those products, and divide by the total .
: Sort the values. With an odd number of observations, the is the middle value; with an even number, it is the average of the two middle values.
: Identify the most frequently occurring value or category. A data set may have one , several modes, or no if no value occurs more often than the others.
For , the is , and the is . Both and occur twice, so the data are bimodal. The value raises the , while the remains ; this illustrates why the can better represent the center when data are skewed or include an extreme value.
and
A measure of center alone does not show whether observations cluster closely or vary widely. Measures of describe variability; common measures include the , interquartile , , and .
The is the largest value minus the smallest value. For the example data, . It is simple to calculate, but depends only on the two extremes.
divide ordered data into four parts. The lower quartile, , is the twenty-fifth percentile; the upper quartile, , is the seventy-fifth percentile. The is calculated as:
It describes the of the middle half of the data and is less affected by extreme values than the or . Using the -of-halves convention for the example, and , so . Quartile values can differ slightly among software packages because more than one calculation convention is used; state the convention when exact agreement matters.
and
summarizes squared distances from the , so larger deviations contribute more. is the square root of and expresses in the same units as the original measurements.
For observations with , the population and sample formulas are:
is the square root of the corresponding . Use the population formula when the data include the entire population of interest. Use the sample formula when the observations are a sample and the goal is to estimate variability beyond that sample.
For the example data, the squared deviations from the sum to . The population is , with about . The sample is , with about . is in squared units, whereas is in the original units. Like the , can be strongly affected by extreme observations.
Choosing and interpreting summaries
Choose statistics that fit the data type and shape, and interpret center and together.
For roughly symmetric numerical data without strong outliers, the and are often informative together.
For skewed data or data with extreme values, the and IQR often provide a more resistant description of center and .
For categorical data, report counts and relative frequencies; a numerical may have no meaningful interpretation.
Include units and context. A of is difficult to interpret unless the reader knows what was measured and on what scale.
A useful workflow is to check the data and measurement units, count observations and inspect missing or unusual values, build summaries, calculate suitable measures of center and , and compare the numerical results with a graph. Histograms can reveal distribution shape, center, and ; box plots emphasize the , , and potential extremes. Check that the numerical summaries agree with the observed distribution.