Introduction to Statistics and Probability
Introduction to Statistics
What Is Statistics?
Statistics is the science of learning from data. It gives us the tools to collect information, analyze it, and make sense of what it tells us. From predicting election outcomes to determining the effectiveness of a new medicine, statistics helps us understand the world through numbers.
Statistics is the study of how to collect, analyze, and draw conclusions from data.
Essentially, it’s a way to navigate the uncertainty and variability all around us. Instead of relying on gut feelings, we can use statistics to make informed decisions based on evidence.
The Core Ingredients
To get started, we need to understand a few key terms. These are the building blocks for everything else in statistics.
Data
noun
Facts and figures collected together for reference or analysis. Data are the raw materials of statistics.
Next, we have two related ideas: population and sample.
Population
noun
The entire group that you want to draw conclusions about.
Sample
noun
A specific, smaller group of individuals that you will collect data from, selected from the population.
Think about it like tasting a spoonful of soup to check the seasoning. The entire pot of soup is the population, and the spoonful is the sample. The goal is for the sample to be representative of the whole population.
Finally, when we study a population or a sample, we're interested in its characteristics. These are called variables.
Variable
noun
Any characteristic, number, or quantity that can be measured or counted.
Two Flavors of Statistics
Statistics is generally broken down into two main types: descriptive and inferential.
Descriptive statistics summarizes or describes the characteristics of a data set. It's about organizing and presenting the data in a meaningful way so you can spot patterns. Think charts, graphs, and simple calculations like the average.
For example, if you surveyed 100 people about their favorite color, descriptive statistics would involve showing the percentage of people who chose blue, red, green, and so on. You're just describing what you found in your sample.
Inferential statistics uses data from a sample to make inferences or predictions about a larger population. This is where you go beyond the immediate data to draw conclusions.
Using the soup analogy again, tasting the spoonful (the sample) and deciding the whole pot (the population) needs more salt is an act of inference. You're using information from a small part to make a judgment about the whole.
| Feature | Descriptive Statistics | Inferential Statistics |
|---|---|---|
| Goal | To summarize and describe data | To make predictions about a population |
| Scope | Just the data you collected (the sample) | Beyond the data collected (the whole population) |
| Example | The average height of students in a class | The estimated average height of all students in a country |
| Forms | Charts, graphs, averages, percentages | Hypothesis tests, confidence intervals |
Types of Data
The variables we measure can produce different types of data. The most basic distinction is between qualitative and quantitative data.
Qualitative Data (or Categorical Data) describes qualities or characteristics. It is collected through observations and interviews, and is often represented by names or labels. Examples: Eye color (blue, green, brown), type of car (sedan, SUV, truck), yes/no answers.
Quantitative Data involves numbers and things you can measure. It deals with quantities and can be used in calculations. Examples: Height, weight, temperature, number of siblings.
Knowing the type of data you have is crucial because it determines which statistical methods you can use to analyze it.
How Data Is Collected
Where does all this data come from? The method of data collection is critical. A flawed collection method can lead to misleading conclusions, no matter how sophisticated your analysis is. Common methods include:
| Method | Description |
|---|---|
| Surveys | Asking a series of questions to a group of people, either in person, online, or on paper. |
| Experiments | Conducting a controlled test to determine cause and effect. A researcher manipulates one variable to see its effect on another. |
| Observational Studies | Watching and recording actions or outcomes without interfering. Common in social sciences and wildlife biology. |
| Using Existing Data | Analyzing data that has already been collected by others, such as government census data or company records. |
Each method has its strengths and is chosen based on the research question at hand. Understanding these basics sets the stage for any statistical analysis you'll encounter.
Now, let's test your understanding of these foundational concepts.
A political analyst studies the results of an exit poll of 2,000 voters to predict the winner of a national election. What is the 'population' in this context?
A data report summarizes the average age and gender distribution of employees in a company. This is an example of descriptive statistics.
With these core ideas in place, you're ready to explore how we can put them into practice.