Difference between revisions of "SOCR Data"
(→Biomedical Data) |
(→US Census Data) |
||
| (20 intermediate revisions by the same user not shown) | |||
| Line 58: | Line 58: | ||
* [[SOCR_Data_Oct2009_ID_NI | Normal and Schizophrenia Children Neuroimaging study]] | * [[SOCR_Data_Oct2009_ID_NI | Normal and Schizophrenia Children Neuroimaging study]] | ||
* [[SOCR_Data_April2011_NI_IBS_Pain | A large Neuroimaging study of pain including visceral pain, irritable bowel syndrome, ulcerative colitis, and Crohn's disease]] | * [[SOCR_Data_April2011_NI_IBS_Pain | A large Neuroimaging study of pain including visceral pain, irritable bowel syndrome, ulcerative colitis, and Crohn's disease]] | ||
| + | * [[SOCR_Data_N46_TBI_ROI_Volumes | A Neuroimaging study of Traumatic Brain Injury (TBI) including global and local volumetric measures of brain integrity at acute and chronic states]] | ||
=== Biomedical Data=== | === Biomedical Data=== | ||
| + | * [https://www.healthdatagym.org/datasets Health Data Gymnasium] | ||
| + | * [[SOCR_Data_PD_BiomedBigMetadata|Human Health: Predictive Big Data Analytics, Modeling and Visualization of Clinical, Genetic and Imaging Data for Parkinson’s Disease]] | ||
* [[SOCR_Data_AMI_NY_1993_HeartAttacks| 1993 New York State Heart Attack Patients: Acute Myocardial Infarction (AMI), N=12,844]] | * [[SOCR_Data_AMI_NY_1993_HeartAttacks| 1993 New York State Heart Attack Patients: Acute Myocardial Infarction (AMI), N=12,844]] | ||
* [[SOCR_Data_AD_BiomedBigMetadata|Human Health: Modeling and Analysis of Clinical, Genetic and Imaging Data of Alzheimer’s Disease]] | * [[SOCR_Data_AD_BiomedBigMetadata|Human Health: Modeling and Analysis of Clinical, Genetic and Imaging Data of Alzheimer’s Disease]] | ||
| Line 67: | Line 70: | ||
* [[SOCR_Data_KneePainData_041409 | Knee Pain Centroid Locations Data]] | * [[SOCR_Data_KneePainData_041409 | Knee Pain Centroid Locations Data]] | ||
* [[SOCR_Data_NIPS_InfantVitK_ShotData | Neonate Infant Pain Score (NIPS) Data (Vitamin K shots)]] | * [[SOCR_Data_NIPS_InfantVitK_ShotData | Neonate Infant Pain Score (NIPS) Data (Vitamin K shots)]] | ||
| − | * [[SOCR_Simulated_HELP_Data | Simulated Health Evaluation and Linkage to Primary (HELP) Care) | + | * [[SOCR_Simulated_HELP_Data | Simulated Health Evaluation and Linkage to Primary (HELP) Care Dataset]] |
| + | * [[SMHS_MissingData#Example| Demographic, clinical and cognitive variables in a cohort of traumatic brain injury (TBI) patients]] | ||
| + | |||
| + | ===Healthcare and Health Science Data=== | ||
| + | * [https://umich.instructure.com/courses/38100/files/ A number of case-studies including Big and Heterogeneous clinical, nursing, and healthcare datasets]. | ||
| + | * [https://dataverse.harvard.edu/dataverse/harvard Harvard Dataverse (1,000's of case-studies)]. | ||
=== [[SOCR_US_CensusData | US Census Data]]=== | === [[SOCR_US_CensusData | US Census Data]]=== | ||
* [[SOCR_Data_LA_Neighborhoods_Data | Los Angeles County Neighborhoods Data (from US Census)]] | * [[SOCR_Data_LA_Neighborhoods_Data | Los Angeles County Neighborhoods Data (from US Census)]] | ||
* [[SOCR_Data_2011_US_JobsRanking | 2011 US Jobs Ranking (200 Best to Worst Jobs in the USA for 2011)]] | * [[SOCR_Data_2011_US_JobsRanking | 2011 US Jobs Ranking (200 Best to Worst Jobs in the USA for 2011)]] | ||
| + | * [[SOCR_Data_2019_US_JobsRanking | 2019 US Jobs Ranking (200 Best to Worst Jobs in the USA for 2019)]] | ||
=== [http://www.presidency.ucsb.edu/ US Elections Data]=== | === [http://www.presidency.ucsb.edu/ US Elections Data]=== | ||
| Line 90: | Line 99: | ||
* [[SOCR_061708_NC_Data_Aquifer | Texas Wolfcamp aquifer data]] | * [[SOCR_061708_NC_Data_Aquifer | Texas Wolfcamp aquifer data]] | ||
* [[SOCR_012708_ID_Data_HotDogs | Hot Dog Calorie and Sodium Dataset]] | * [[SOCR_012708_ID_Data_HotDogs | Hot Dog Calorie and Sodium Dataset]] | ||
| + | |||
| + | ===SOCR Course Data and Case-Studies=== | ||
| + | * [https://umich.instructure.com/courses/38100 UMich HS 853, Fall 2015] | ||
| + | ** [https://umich.instructure.com/courses/38100/files General Resources] | ||
| + | ** [https://umich.instructure.com/courses/38100/files/folder/data Small Datasets] | ||
| + | ** [https://umich.instructure.com/courses/38100/files/folder/Case_Studies Biomedical and Health Science Case-Studies] | ||
| + | * [https://umich.instructure.com/courses/90136 UMich HS 853, Fall 2016] | ||
| + | ** [https://umich.instructure.com/courses/90136/files General Resources including data, case-studies, lecture notes and code] | ||
| + | * [https://umich.instructure.com/courses/143011/ UMich Data Science and Predictive Analytics (HS 650)] | ||
| + | ** [https://umich.instructure.com/courses/143011/files General Resources including data, case-studies, lecture notes and code] | ||
===External Data Archives=== | ===External Data Archives=== | ||
| + | * [https://ihpi.umich.edu/member-resources/data-and-methods/available-datasets University of Michigan Institute for Healthcare Policy and Innovation (IHPI)] | ||
| + | * [https://www.ai.gov/ai-researchers-portal/data-resources/ AI.gov Data Resources] | ||
| + | * [http://www.nature.com/sdata/archive Nature Scientific Data] | ||
| + | * [https://toolbox.google.com/datasetsearch Google Data Search] | ||
* [https://www.cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/Medicare-Provider-Charge-Data/Physician-and-Other-Supplier.html Centers for Medicare & Medicaid Services (CMS)] | * [https://www.cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/Medicare-Provider-Charge-Data/Physician-and-Other-Supplier.html Centers for Medicare & Medicaid Services (CMS)] | ||
| − | * [http://www.census.gov/developers/ US Census] | + | * [http://www.census.gov/developers/ US Census] and [https://usa.ipums.org/usa/ US Census Graphical API Interface] |
* [http://www.ncbi.nlm.nih.gov/gap database of Genotypes and Phenotypes (dbGaP)] | * [http://www.ncbi.nlm.nih.gov/gap database of Genotypes and Phenotypes (dbGaP)] | ||
| + | |||
| + | ==Machine Interfaces to Downloading [[SOCR Data]]== | ||
| + | In addition to human interactions with the [[SOCR Data]], we provide several machine interfaces to consume and process these data. | ||
| + | |||
| + | * [[SOCR Data]] can be copy pasted directly from the Wiki HTML pages into any of the [http://socr.umich.edu/html/ana/ SOCR Java applets]. | ||
| + | * [http://socr.umich.edu/HTML5/SOCRAT/ SOCR Analytical Toolbox (SOCRAT)] provides a scalable web platform for in-browser applications for interactive data analysis and visualization. | ||
| + | * SOCR Data can also be loaded into an R computational environment automatically using the protocol below illustrated with the case of a [[SOCR_Data_PD_BiomedBigMetadata|Parkinson's Disease dataset]]: | ||
| + | |||
| + | library(rvest) | ||
| + | # Loading required package: xml2 | ||
| + | |||
| + | wiki_url <- read_html("http://wiki.socr.umich.edu/index.php/SOCR_Data_PD_BiomedBigMetadata") | ||
| + | html_nodes(wiki_url, "#content") | ||
| + | |||
| + | pd_data <- html_table(html_nodes(wiki_url,"table")\([[1]]\)) | ||
| + | head(pd_data); summary(pd_data) | ||
<hr> | <hr> | ||
| − | * SOCR Home page: | + | * SOCR Home page: https://www.socr.umich.edu |
| − | {{translate|pageName= | + | {{translate|pageName=https://wiki.socr.umich.edu/index.php?title=SOCR_Data}} |
Latest revision as of 13:43, 21 October 2023
Contents
- 1 SOCR Educational Materials - SOCR Data
- 2 Simulated data
- 3 Observed data
- 4 Machine Interfaces to Downloading SOCR Data
SOCR Educational Materials - SOCR Data
The links below contain a number of datasets that may be used for demonstration purposes in probability and statistics education. There are two types of data - simulated (computer-generated using random sampling) and observed (research, observationally or experimentally acquired).
Simulated data
The SOCR resources provide a number of mechanisms to simulate data using computer random-number generators. Here are some of the most commonly used SOCR generators of simulated data:
- SOCR Experiments - each experiment reports random outcomes, sample and population distributions and summary statistics.
- SOCR random-number generator - enables sampling of any size from any of the SOCR Distributions.
- SOCR Analyses - all of the SOCR analyses allow random sampling from various populations appropriate for the user-specified analysis.
Observed data
The following collections include a number of real observed datasets from different disciplines, acquired using different techniques and applicable in different situations.
Climate Change Data
- Antarctic Ice Thickness at Mawson, Davis and Casey (01/Apr/1954 to 15/Jan/2002). Number of data points is 1636.
- Energy Resources, Production and Consumption Dataset
- California Ozone Data (1980-2006)
- California and US Ozone Data Snapshot
Population Data
- Human Height and Weight data
- Population Data by Country 2000-2006
- Los Angeles City Neighborhoods Data (from US Census)
- Ranking of the top 100 Countries in the World based on political, economic, health, and quality-of-life factors
Economic, Business and Stock Market Data
Consumer Price Index (CPI)
- Consumer Price Index (1981-2006) - Fuel and Food Data
- Consumer Price Index (1981-2007) - One-, Two- or Three-Way ANOVA Data by items, months and years
- Housing Price Index (2000-2006) (motion charts)
- S&P Home Price Index (1991-2009) (motion charts)
Stock Market Data
- Sun Microsystems (Java) Stock price (2007-2008)
- S&P 500 (2007-2008)
- US Economy by Sectors (1997-2007) and 2007-2009 Recession Data
- Ranking, Profits and Income of Fortune500 Companies (1955-2008) Dataset
Monetary-Base Data
- US Federal Reserve monetary-base data (1959-2009)
- Monthly US Economics data including monetary-base data, interest, CPI, HPI, S&P, Unemployment, Inflation, etc. (1959-2009)
- Monthly Monetary Inflation for Several Countries (2002-2012)
Budgets and Deficits Data
Sector Data, Population Perception Trends data
World Peace
Neuroimaging Data
- Neuroimaging study of 27 Alzheimer's disease (AD) subjects, 35 normal controls (NC), and 42 mild cognitive impairment subjects (MCI)
- Alzheimer's Disease neuroimaging Data
- Neuroimaging study of super-resolution image enhancing
- Neuroimaging study of Prefrontal Cortex Volume across Species and Tissue Types
- Normal and Schizophrenia Children Neuroimaging study
- A large Neuroimaging study of pain including visceral pain, irritable bowel syndrome, ulcerative colitis, and Crohn's disease
- A Neuroimaging study of Traumatic Brain Injury (TBI) including global and local volumetric measures of brain integrity at acute and chronic states
Biomedical Data
- Health Data Gymnasium
- Human Health: Predictive Big Data Analytics, Modeling and Visualization of Clinical, Genetic and Imaging Data for Parkinson’s Disease
- 1993 New York State Heart Attack Patients: Acute Myocardial Infarction (AMI), N=12,844
- Human Health: Modeling and Analysis of Clinical, Genetic and Imaging Data of Alzheimer’s Disease
- Allometric relationship between population density, body mass and metabolic activity in Plants
- Fisher's multivariate dataset on iris sepal and petal length
- Body Density & Body Mass Index (BMI) Data
- Knee Pain Centroid Locations Data
- Neonate Infant Pain Score (NIPS) Data (Vitamin K shots)
- Simulated Health Evaluation and Linkage to Primary (HELP) Care Dataset
- Demographic, clinical and cognitive variables in a cohort of traumatic brain injury (TBI) patients
Healthcare and Health Science Data
- A number of case-studies including Big and Heterogeneous clinical, nursing, and healthcare datasets.
- Harvard Dataverse (1,000's of case-studies).
US Census Data
- Los Angeles County Neighborhoods Data (from US Census)
- 2011 US Jobs Ranking (200 Best to Worst Jobs in the USA for 2011)
- 2019 US Jobs Ranking (200 Best to Worst Jobs in the USA for 2019)
US Elections Data
- US Electoral College vs. Popular Vote Presidential Elections Mandate Data (1828-2008)
- US Elections and Counties data for 2004
Other Data
- Turkiye Student Evaluation Data Set
- Brain to Body Weight Dataset
- California Earthquakes Data (1969-2007)
- California Lottery (1992-2011)
- Faculty Publications
- 2007 Advanced Placement (AP) Exam Scores by Discipline
- Online Math Center: A large archive of data from different scientific observations
- Largemouth Bass Mercury Contamination Dataset
- Latin Letters Frequency Data
- NISER Datasets
- Texas Wolfcamp aquifer data
- Hot Dog Calorie and Sodium Dataset
SOCR Course Data and Case-Studies
- UMich HS 853, Fall 2015
- UMich HS 853, Fall 2016
- UMich Data Science and Predictive Analytics (HS 650)
External Data Archives
- University of Michigan Institute for Healthcare Policy and Innovation (IHPI)
- AI.gov Data Resources
- Nature Scientific Data
- Google Data Search
- Centers for Medicare & Medicaid Services (CMS)
- US Census and US Census Graphical API Interface
- database of Genotypes and Phenotypes (dbGaP)
Machine Interfaces to Downloading SOCR Data
In addition to human interactions with the SOCR Data, we provide several machine interfaces to consume and process these data.
- SOCR Data can be copy pasted directly from the Wiki HTML pages into any of the SOCR Java applets.
- SOCR Analytical Toolbox (SOCRAT) provides a scalable web platform for in-browser applications for interactive data analysis and visualization.
- SOCR Data can also be loaded into an R computational environment automatically using the protocol below illustrated with the case of a Parkinson's Disease dataset:
library(rvest)
# Loading required package: xml2
wiki_url <- read_html("http://wiki.socr.umich.edu/index.php/SOCR_Data_PD_BiomedBigMetadata")
html_nodes(wiki_url, "#content")
pd_data <- html_table(html_nodes(wiki_url,"table")\([[1]]\)) head(pd_data); summary(pd_data)
- SOCR Home page: https://www.socr.umich.edu
Translate this page:
