No history yet

Sampling and Data

The Science of Data

Statistics is the science of collecting, analyzing, and interpreting data. It's a powerful tool for understanding the world and making informed decisions. At its heart, statistics deals with uncertainty. That's where probability comes in—it's the mathematical language we use to measure and describe that uncertainty.

Statistics

noun

The science concerned with developing and studying methods for collecting, analyzing, interpreting, and presenting empirical data.

Imagine you want to know the average height of every adult in a country. Measuring everyone is impossible. Instead, you could measure a smaller group and use that information to estimate the average for the whole country. This introduces some key terms.

A population is the entire group you want to draw conclusions about. A sample is the specific group you will collect data from. The sample is always a subset of the population.

The numbers we get from these groups also have special names. A parameter is a number that describes a whole population (like the true average height of all adults). A statistic is a number that describes a sample (like the average height of the people you measured).

The goal is often to use a statistic to make an educated guess about a parameter.

The Language of Data

Data is the raw material of statistics. It comes in different forms, and knowing the type of data you have is crucial for choosing the right analysis. The first major split is between qualitative and quantitative data.

TypeDescriptionExamples
QualitativeDescribes qualities or characteristics. It's often collected from interviews or observations and recorded as text.Eye color, car brands, types of trees, 'yes' or 'no' answers.
QuantitativeRepresents amounts or counts. It's always a number.Height, temperature, number of pets, test scores.

We can get even more specific with levels of measurement. These levels tell us about the nature of the values and what mathematical operations are appropriate.

LevelDescriptionExample
NominalData that can only be categorized, with no natural order.Types of fruit (apple, banana, orange). You can't say an apple is 'higher' or 'lower' than a banana.
OrdinalData that can be categorized and ordered, but the distances between categories are not meaningful.Satisfaction ratings (Unhappy, Neutral, Happy). We know Happy > Neutral, but we don't know by how much.
IntervalOrdered data with meaningful, equal intervals between values, but no true zero.Temperature in Celsius or Fahrenheit. The difference between 10° and 20° is the same as between 20° and 30°, but 0° doesn't mean 'no temperature'.
RatioOrdered data with meaningful intervals and a true zero.Height or weight. A height of 0 cm means 'no height', and 180 cm is twice as tall as 90 cm.

How We Gather Data

Since we usually can't study an entire population, we rely on sampling. The goal of sampling is to select a sample that is representative of the larger population. A biased sample can lead to incorrect conclusions, no matter how sophisticated your analysis is. There are several methods for drawing a good sample.

Designing a Good Study

Once you know how to sample, you need to think about how you'll collect the data. If you're running an experiment—where you apply a treatment to a group to observe the effect—good design is critical.

A key principle is having a control group. This group does not receive the experimental treatment. By comparing the treatment group to the control group, you can be more confident that any differences you see are due to the treatment and not some other factor.

Randomization is also essential. Assigning subjects to treatment and control groups randomly helps ensure the groups are similar at the start, reducing bias. Imagine you're testing a new fertilizer. If you give it to all the plants in the sunny part of the garden and leave the shady plants as a control, you won't know if better growth is due to the fertilizer or the sunlight.

Another technique is blinding, where subjects (single-blind) or both subjects and researchers (double-blind) don't know who is in the treatment versus control group. This prevents expectations from influencing the results, like in clinical trials with a placebo.

Finally, all data collection must be guided by strong ethical principles. This means obtaining informed consent from participants, ensuring they understand the study and its risks. It also means protecting their privacy and keeping their data confidential. Researchers have a responsibility to conduct their work honestly and report their findings accurately, without manipulating data to fit a desired outcome.

With these foundations in place—understanding what statistics is, the types of data we work with, and how to collect it properly—you're ready to start exploring the data itself.