library(tidyverse)
library(tidymodels)
Equality
In this application exercise, we’ll do inference on two population proportions.
Packages
We’ll use the tidyverse and tidymodels packages.
Data
A September 16-19, 2023, asked North Carolina voters, among other issues, about issues of equality and women’s progress. Specifically, one of the questions asked:
Which of these two statements come closest to your own views—even if neither is exactly right?
The country has made most of the changes needed to give women equal rights with men.
The country needs to continue to make changes to give women equal rights to men.
The results of this survey are summarized in this report and the data can be found in your data
folder: equality.csv
.
Hypotheses
Exercise 1
The two populations of interest in this survey are 18-24 year olds and 25+ year olds. State the hypotheses for evaluating whether there is a discernible difference between the proportions of those who think “The country needs to continue to make changes to give women equal rights to men.” (need more changes
) in the two age groups.
Let \(p\) = the true proportion of those who think “The country needs to continue to make changes to give women equal rights to men” among 18-24 year old NC voters and 25+ year old NC voters.
\(H_0: p_{18-24} = p_{25+}\)
\(H_A: p_{18-24} \ne p_{25+}\)
Sample statistics
Exercise 2
Load the data.
<- read_csv("data/equality.csv") equality
Exercise 3
Create a 2x2 table of the responses across the two age groups.
<- equality |>
equality_table count(age, response) |>
pivot_wider(names_from = "response", values_from = "n") |>
rename(Age = age)
equality_table
# A tibble: 2 × 3
Age `Most changes done` `Need more changes`
<chr> <int> <int>
1 18-24 32 35
2 25+ 211 450
Exercise 4
What proportion of 18-24 year olds think “The country needs to continue to make changes to give women equal rights to men”? What proportion of 25+ year olds? Calculate and visualize these proportions.
|>
equality_table mutate(phat = round(`Need more changes` / (`Most changes done` + `Need more changes`), 3))
# A tibble: 2 × 4
Age `Most changes done` `Need more changes` phat
<chr> <int> <int> <dbl>
1 18-24 32 35 0.522
2 25+ 211 450 0.681
ggplot(equality, aes(y = age, fill = response)) +
geom_bar(position = "fill")
Exercise 5
Calculate the observed sample statistic, i.e., the difference between the proportions of respondents who think “The country needs to continue to make changes to give women equal rights to men” between the two age groups.
<- equality |>
obs_stat specify(response = response, explanatory = age, success = "Need more changes") |>
calculate(stat = "diff in props", order = c("18-24", "25+"))
obs_stat
Response: response (factor)
Explanatory: age (factor)
# A tibble: 1 × 1
stat
<dbl>
1 -0.158
Testing
Exercise 6
What is the parameter of interest?
Difference between the proportions of those who think “The country needs to continue to make changes to give women equal rights to men” between 18-24 and 25+ year old NC voters.
Exercise 7
Explain how you can set up a simulation for this hypothesis test.
Add response here.
Exercise 8
Conduct the hypothesis test using randomization and visualize and report the p-value.
set.seed(1234)
<- equality |>
null_dist specify(response = response, explanatory = age, success = "Need more changes") |>
hypothesize(null = "independence") |>
generate(reps = 1000, type = "permute") |>
calculate(stat = "diff in props", order = c("18-24", "25+"))
|>
null_dist get_p_value(obs_stat = obs_stat, direction = "two sided")
# A tibble: 1 × 1
p_value
<dbl>
1 0.012
|>
null_dist visualize() +
shade_p_value(obs_stat = obs_stat, direction = "two sided")
Exercise 9
What is the conclusion of the hypothesis test?
With a p-value of 0.018, which is smaller than the discernability level of 0.05, we reject the null hypothesis. The data provide convincing evidence that there is a difference between the proportions of those who think “The country needs to continue to make changes to give women equal rights to men”.
Exercise 10
Interpret the p-value in the context of the data and the hypotheses.
The probability of observing a difference in sample proportions of those who think “The country needs to continue to make changes to give women equal rights to men” between a sample of 67 18-24 year olds and 661 25+ year olds of 0.158 or more (in either direction) is 0.018 if in fact the two population proportions are equal.
Estimation
Exercise 11
Estimate the difference in population proportions of 18-24 year old NC voters and 25+ year old NC voters using a 95% bootstrap interval.
set.seed(1234)
<- equality |>
boot_dist specify(response = response, explanatory = age, success = "Need more changes") |>
generate(reps = 1000, type = "bootstrap") |>
calculate(stat = "diff in props", order = c("18-24", "25+"))
<- boot_dist |>
ci get_ci()
ci
# A tibble: 1 × 2
lower_ci upper_ci
<dbl> <dbl>
1 -0.288 -0.0279
visualize(boot_dist) +
shade_ci(ci)
Exercise 12
Interpret the confidence interval in context of the data.
We are 95% confident that the proportion of 18-24 year old NC voters who think “The country needs to continue to make changes to give women equal rights to men” is 28.4% to 3.4% lower than 25+ year old NC voters who share this opinion.
Exercise 13
Describe how the simulation scheme for bootstrapping is different than that for the hypothesis test.
Add response here…
Conceptual
Exercise 14
What is \(p\) vs. \(\hat{p}\) vs. p-value. Explain generically as well as in the context of these data and research question.
Add response here.
Exercise 15
What is sampling distribution vs. bootstrap distribution vs. null distribution? Explain generically as well as in the context of these data and research question.
Add response here.