Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pipeline: Refactor cdc_wisqars to ingest new data #3953

Merged
merged 13 commits into from
Feb 7, 2025
Merged

Pipeline: Refactor cdc_wisqars to ingest new data #3953

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
f63bdc3
new
benhammondmusic Feb 4, 2025
1ad2d25
check in files; update comment
benhammondmusic Feb 6, 2025
376cb05
rf
benhammondmusic Feb 6, 2025
2da074b
updated code to process real data into SEX tables; updates golden
benhammondmusic Feb 7, 2025
bfb4e0f
sex and age; dont make overall gun deaths yet
benhammondmusic Feb 7, 2025
ce40f88
handle by race
benhammondmusic Feb 7, 2025
a7ff843
back to homicides and suicides working
benhammondmusic Feb 7, 2025
856177f
lint
benhammondmusic Feb 7, 2025
5bbbb89
flake lint
benhammondmusic Feb 7, 2025
67e640e
Merge branch 'main' of https://github.com/SatcherInstitute/health-equ…
benhammondmusic Feb 7, 2025
c8ae458
remove unused test input files
benhammondmusic Feb 7, 2025
1feb2aa
cleanup
benhammondmusic Feb 7, 2025
283a962
types
benhammondmusic Feb 7, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
47 changes: 47 additions & 0 deletions data/cdc_wisqars/gun_deaths-national-race_and_ethnicity.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,47 @@
"Year","Race","Deaths","Population","Crude Rate","Age-Adjusted Rate","Years of Potential Life Lost"
"2022","White","26,323","196,225,966","13.42","12.18","446,327"
"2022","Black","14,203","42,070,471","33.76","33.10","474,159"
"2022","American Indian / Alaska Native","530","2,420,972","21.89","22.12","15,967"
"2022","Asian","583","20,276,025","2.88","2.74","15,533"
"2022","HI Native / Pacific Islander","65","635,928","10.22","9.81","2,115"
"2022","More than One Race","563","7,993,849","7.04","8.01","18,475"
"2021","White","26,054","196,894,384","13.23","12.24","469,266"
"2021","Black","15,290","41,859,278","36.53","35.63","516,700"
"2021","American Indian / Alaska Native","466","2,412,991","19.31","19.31","13,805"
"2021","Asian","576","19,811,597","2.91","2.80","16,502"
"2021","HI Native / Pacific Islander","68","624,677","10.89","10.26","2,212"
"2021","More than One Race","556","7,803,455","7.13","7.83","19,144"
"2020","White","24,664","197,704,168","12.48","11.55","446,357"
"2020","Black","13,974","41,737,491","33.48","32.47","474,532"
"2020","American Indian / Alaska Native","449","2,405,789","18.66","18.24","13,941"
"2020","Asian","516","19,579,116","2.64","2.52","13,892"
"2020","HI Native / Pacific Islander","58","616,967","9.40","8.86","1,916"
"2020","More than One Race","477","7,629,431","6.25","7.00","16,127"
"2019","White","23,964","197,255,617","12.15","11.09","410,801"
"2019","Black","10,288","41,192,127","24.98","24.27","344,718"
"2019","American Indian / Alaska Native","336","2,422,370","13.87","13.90","10,182"
"2019","Asian","513","19,075,130","2.69","2.55","13,586"
"2019","HI Native / Pacific Islander","54","604,124","8.94","8.60","1,847"
"2019","More than One Race","416","7,376,098","5.64","6.59","13,688"
"2018","White","24,643","197,545,931","12.48","11.41","429,084"
"2018","Black","9,713","40,898,768","23.75","22.98","323,940"
"2018","American Indian / Alaska Native","361","2,410,262","14.98","15.07","10,735"
"2018","Asian","492","18,728,396","2.63","2.50","12,785"
"2018","HI Native / Pacific Islander","54","593,606","9.10","8.47","1,772"
"2018","More than One Race","372","7,192,403","5.17","6.08","11,937"
"Total","","196,621","1,343,997,387","14.63","14.30","4,562,045"
"","","","","","",""
"Injury Outcome: Fatal","","","","","",""
"Injury Type: All Injury","","","","","",""
"Data Years: 2018 to 2022","","","","","",""
"Geography: United States","","","","","",""
"Intent: All Intents","","","","","",""
"Mechanism: Firearm","","","","","",""
"Age: All Ages","","","","","",""
"Sex: All Sexes","","","","","",""
"Race: All Races","","","","","",""
"Ethnicity: Non-Hispanic","","","","","",""
"Metro / Non-Metro Indicator: None Selected","","","","","",""
"YPLL Age: 65","","","","","",""
"Year and Race Options: 2018 - 2021 by Single Race","","","","","",""
"Produced by: National Center for Injury Prevention and Control, CDC.","","","","","",""
1,547 changes: 1,547 additions & 0 deletions data/cdc_wisqars/gun_deaths-state-race_and_ethnicity.csv
View file
Open in desktop

Large diffs are not rendered by default.

163 changes: 163 additions & 0 deletions data/cdc_wisqars/gun_homicides_suicides-national-race_and_ethnicity.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,163 @@
"Year","Intent","Race","Deaths","Population","Crude Rate","Age-Adjusted Rate","Years of Potential Life Lost"
"2022","Unintentional","White","253","196,225,966","0.13","0.13","6,674"
"2022","Unintentional","Black","125","42,070,471","0.30","0.30","5,248"
"2022","Unintentional","American Indian / Alaska Native","13**","2,420,972","0.54**","0.54**","483"
"2022","Unintentional","Asian","--","20,276,025","--","--","--"
"2022","Unintentional","HI Native / Pacific Islander","--","635,928","--","--","--"
"2022","Unintentional","More than One Race","--","7,993,849","--","--","--"
"2022","Homicide","White","3,830","196,225,966","1.95","2.07","96,167"
"2022","Homicide","Black","11,575","42,070,471","27.51","26.98","394,437"
"2022","Homicide","American Indian / Alaska Native","224","2,420,972","9.25","9.58","7,025"
"2022","Homicide","Asian","196","20,276,025","0.97","0.93","5,111"
"2022","Homicide","HI Native / Pacific Islander","37","635,928","5.82","5.50","1,171"
"2022","Homicide","More than One Race","262","7,993,849","3.28","3.43","9,545"
"2022","Legal Intervention","White","294","196,225,966","0.15","0.16","6,664"
"2022","Legal Intervention","Black","142","42,070,471","0.34","0.33","4,457"
"2022","Legal Intervention","American Indian / Alaska Native","28","2,420,972","1.16","1.15","781"
"2022","Legal Intervention","Asian","10**","20,276,025","0.05**","0.05**","249"
"2022","Legal Intervention","HI Native / Pacific Islander","--","635,928","--","--","--"
"2022","Legal Intervention","More than One Race","--","7,993,849","--","--","--"
"2022","Suicide","White","21,732","196,225,966","11.08","9.71","332,065"
"2022","Suicide","Black","2,237","42,070,471","5.32","5.20","65,529"
"2022","Suicide","American Indian / Alaska Native","256","2,420,972","10.57","10.50","7,343"
"2022","Suicide","Asian","372","20,276,025","1.84","1.74","9,965"
"2022","Suicide","HI Native / Pacific Islander","24","635,928","3.77","3.70","769"
"2022","Suicide","More than One Race","281","7,993,849","3.52","4.30","8,239"
"2022","Undetermined","White","214","196,225,966","0.11","0.11","4,757"
"2022","Undetermined","Black","124","42,070,471","0.30","0.30","4,488"
"2022","Undetermined","American Indian / Alaska Native","--","2,420,972","--","--","--"
"2022","Undetermined","Asian","--","20,276,025","--","--","--"
"2022","Undetermined","More than One Race","--","7,993,849","--","--","--"
"2021","Unintentional","White","310","196,894,384","0.16","0.16","8,435"
"2021","Unintentional","Black","150","41,859,278","0.36","0.36","6,138"
"2021","Unintentional","American Indian / Alaska Native","--","2,412,991","--","--","--"
"2021","Unintentional","Asian","--","19,811,597","--","--","--"
"2021","Unintentional","HI Native / Pacific Islander","--","624,677","--","--","--"
"2021","Unintentional","More than One Race","--","7,803,455","--","--","--"
"2021","Homicide","White","4,064","196,894,384","2.06","2.19","104,198"
"2021","Homicide","Black","12,721","41,859,278","30.39","29.62","436,907"
"2021","Homicide","American Indian / Alaska Native","185","2,412,991","7.67","7.92","5,803"
"2021","Homicide","Asian","204","19,811,597","1.03","0.99","5,677"
"2021","Homicide","HI Native / Pacific Islander","37","624,677","5.92","5.64","1,295"
"2021","Homicide","More than One Race","261","7,803,455","3.35","3.33","9,819"
"2021","Legal Intervention","White","252","196,894,384","0.13","0.14","6,365"
"2021","Legal Intervention","Black","120","41,859,278","0.29","0.28","3,727"
"2021","Legal Intervention","American Indian / Alaska Native","13**","2,412,991","0.54**","0.54**","343"
"2021","Legal Intervention","Asian","--","19,811,597","--","--","--"
"2021","Legal Intervention","HI Native / Pacific Islander","--","624,677","--","--","--"
"2021","Legal Intervention","More than One Race","15**","7,803,455","0.19**","0.21**","530"
"2021","Suicide","White","21,197","196,894,384","10.77","9.62","344,493"
"2021","Suicide","Black","2,165","41,859,278","5.17","5.06","64,773"
"2021","Suicide","American Indian / Alaska Native","241","2,412,991","9.99","9.74","6,734"
"2021","Suicide","Asian","352","19,811,597","1.78","1.72","10,115"
"2021","Suicide","HI Native / Pacific Islander","27","624,677","4.32","4.07","817"
"2021","Suicide","More than One Race","264","7,803,455","3.38","4.09","8,180"
"2021","Undetermined","White","231","196,894,384","0.12","0.12","5,775"
"2021","Undetermined","Black","134","41,859,278","0.32","0.31","5,155"
"2021","Undetermined","American Indian / Alaska Native","20**","2,412,991","0.83**","0.80**","689"
"2021","Undetermined","Asian","--","19,811,597","--","--","--"
"2021","Undetermined","HI Native / Pacific Islander","--","624,677","--","--","--"
"2021","Undetermined","More than One Race","--","7,803,455","--","--","--"
"2020","Unintentional","White","317","197,704,168","0.16","0.17","8,654"
"2020","Unintentional","Black","134","41,737,491","0.32","0.32","5,365"
"2020","Unintentional","American Indian / Alaska Native","12**","2,405,789","0.50**","0.47**","486"
"2020","Unintentional","Asian","--","19,579,116","--","--","--"
"2020","Unintentional","HI Native / Pacific Islander","--","616,967","--","--","--"
"2020","Unintentional","More than One Race","--","7,629,431","--","--","--"
"2020","Homicide","White","3,969","197,704,168","2.01","2.14","105,225"
"2020","Homicide","Black","11,832","41,737,491","28.35","27.47","409,200"
"2020","Homicide","American Indian / Alaska Native","191","2,405,789","7.94","7.93","6,107"
"2020","Homicide","Asian","173","19,579,116","0.88","0.83","4,854"
"2020","Homicide","HI Native / Pacific Islander","35","616,967","5.67","5.29","1,079"
"2020","Homicide","More than One Race","204","7,629,431","2.67","2.71","7,642"
"2020","Legal Intervention","White","315","197,704,168","0.16","0.17","7,413"
"2020","Legal Intervention","Black","125","41,737,491","0.30","0.30","3,914"
"2020","Legal Intervention","American Indian / Alaska Native","16**","2,405,789","0.67**","0.69**","482"
"2020","Legal Intervention","Asian","--","19,579,116","--","--","--"
"2020","Legal Intervention","HI Native / Pacific Islander","--","616,967","--","--","--"
"2020","Legal Intervention","More than One Race","13**","7,629,431","0.17**","0.20**","429"
"2020","Suicide","White","19,851","197,704,168","10.04","8.96","319,579"
"2020","Suicide","Black","1,784","41,737,491","4.27","4.16","52,337"
"2020","Suicide","American Indian / Alaska Native","225","2,405,789","9.35","8.97","6,693"
"2020","Suicide","Asian","323","19,579,116","1.65","1.59","8,368"
"2020","Suicide","HI Native / Pacific Islander","20**","616,967","3.24**","3.15**","747"
"2020","Suicide","More than One Race","252","7,629,431","3.30","4.00","7,766"
"2020","Undetermined","White","212","197,704,168","0.11","0.11","5,486"
"2020","Undetermined","Black","99","41,737,491","0.24","0.23","3,716"
"2020","Undetermined","American Indian / Alaska Native","--","2,405,789","--","--","--"
"2020","Undetermined","Asian","--","19,579,116","--","--","--"
"2020","Undetermined","More than One Race","--","7,629,431","--","--","--"
"2019","Unintentional","White","291","197,255,617","0.15","0.15","7,060"
"2019","Unintentional","Black","115","41,192,127","0.28","0.28","4,421"
"2019","Unintentional","American Indian / Alaska Native","--","2,422,370","--","--","--"
"2019","Unintentional","Asian","--","19,075,130","--","--","--"
"2019","Unintentional","HI Native / Pacific Islander","--","604,124","--","--","--"
"2019","Unintentional","More than One Race","--","7,376,098","--","--","--"
"2019","Homicide","White","3,129","197,255,617","1.59","1.68","79,732"
"2019","Homicide","Black","8,438","41,192,127","20.48","19.84","291,536"
"2019","Homicide","American Indian / Alaska Native","154","2,422,370","6.36","6.43","4,808"
"2019","Homicide","Asian","173","19,075,130","0.91","0.86","4,519"
"2019","Homicide","HI Native / Pacific Islander","29","604,124","4.80","4.65","1,066"
"2019","Homicide","More than One Race","169","7,376,098","2.29","2.46","6,102"
"2019","Legal Intervention","White","239","197,255,617","0.12","0.13","5,614"
"2019","Legal Intervention","Black","112","41,192,127","0.27","0.27","3,417"
"2019","Legal Intervention","American Indian / Alaska Native","19**","2,422,370","0.78**","0.78**","566"
"2019","Legal Intervention","Asian","16**","19,075,130","0.08**","0.07**","463"
"2019","Legal Intervention","HI Native / Pacific Islander","--","604,124","--","--","--"
"2019","Legal Intervention","More than One Race","12**","7,376,098","0.16**","0.21**","393"
"2019","Suicide","White","20,090","197,255,617","10.19","9.02","313,180"
"2019","Suicide","Black","1,546","41,192,127","3.75","3.69","42,405"
"2019","Suicide","American Indian / Alaska Native","154","2,422,370","6.36","6.31","4,482"
"2019","Suicide","Asian","316","19,075,130","1.66","1.57","8,359"
"2019","Suicide","HI Native / Pacific Islander","21","604,124","3.48","3.30","618"
"2019","Suicide","More than One Race","227","7,376,098","3.08","3.77","6,950"
"2019","Undetermined","White","215","197,255,617","0.11","0.11","5,215"
"2019","Undetermined","Black","77","41,192,127","0.19","0.19","2,939"
"2019","Undetermined","American Indian / Alaska Native","--","2,422,370","--","--","--"
"2019","Undetermined","HI Native / Pacific Islander","--","604,124","--","--","--"
"2019","Undetermined","More than One Race","--","7,376,098","--","--","--"
"2018","Unintentional","White","284","197,545,931","0.14","0.14","7,248"
"2018","Unintentional","Black","101","40,898,768","0.25","0.24","4,145"
"2018","Unintentional","American Indian / Alaska Native","--","2,410,262","--","--","--"
"2018","Unintentional","Asian","--","18,728,396","--","--","--"
"2018","Unintentional","More than One Race","--","7,192,403","--","--","--"
"2018","Homicide","White","3,303","197,545,931","1.67","1.76","84,336"
"2018","Homicide","Black","7,937","40,898,768","19.41","18.71","271,743"
"2018","Homicide","American Indian / Alaska Native","153","2,410,262","6.35","6.42","4,741"
"2018","Homicide","Asian","162","18,728,396","0.87","0.82","4,354"
"2018","Homicide","HI Native / Pacific Islander","32","593,606","5.39","4.97","1,115"
"2018","Homicide","More than One Race","149","7,192,403","2.07","2.21","5,283"
"2018","Legal Intervention","White","269","197,545,931","0.14","0.15","6,734"
"2018","Legal Intervention","Black","111","40,898,768","0.27","0.27","3,348"
"2018","Legal Intervention","American Indian / Alaska Native","14**","2,410,262","0.58**","0.60**","348"
"2018","Legal Intervention","Asian","10**","18,728,396","0.05**","0.05**","276"
"2018","Legal Intervention","HI Native / Pacific Islander","--","593,606","--","--","--"
"2018","Legal Intervention","More than One Race","10**","7,192,403","0.14**","0.18**","315"
"2018","Suicide","White","20,585","197,545,931","10.42","9.26","325,572"
"2018","Suicide","Black","1,492","40,898,768","3.65","3.58","42,054"
"2018","Suicide","American Indian / Alaska Native","174","2,410,262","7.22","7.23","4,995"
"2018","Suicide","Asian","310","18,728,396","1.66","1.57","7,866"
"2018","Suicide","HI Native / Pacific Islander","16**","593,606","2.70**","2.57**","506"
"2018","Suicide","More than One Race","201","7,192,403","2.80","3.54","5,884"
"2018","Undetermined","White","202","197,545,931","0.10","0.10","5,194"
"2018","Undetermined","Black","72","40,898,768","0.18","0.17","2,650"
"2018","Undetermined","American Indian / Alaska Native","11**","2,410,262","0.46**","0.46**","314"
"2018","Undetermined","Asian","--","18,728,396","--","--","--"
"2018","Undetermined","HI Native / Pacific Islander","--","593,606","--","--","--"
"2018","Undetermined","More than One Race","--","7,192,403","--","--","--"
"Total","","","196,621","1,343,997,387","14.63","14.30","4,562,045"
"","","","","","","",""
"Injury Outcome: Fatal","","","","","","",""
"Injury Type: All Injury","","","","","","",""
"Data Years: 2018 to 2022","","","","","","",""
"Geography: United States","","","","","","",""
"Intent: All Intents","","","","","","",""
"Mechanism: Firearm","","","","","","",""
"Age: All Ages","","","","","","",""
"Sex: All Sexes","","","","","","",""
"Race: All Races","","","","","","",""
"Ethnicity: Non-Hispanic","","","","","","",""
"Metro / Non-Metro Indicator: None Selected","","","","","","",""
"YPLL Age: 65","","","","","","",""
"Year and Race Options: 2018 - 2021 by Single Race","","","","","","",""
"Produced by: National Center for Injury Prevention and Control, CDC.","","","","","","",""
Loading