Experiment 1: Forecast the nations that will have the most suicides, Data: Output variables: Method/Algorithm for this experiment Experiment 2: Find out the association of GDP and population size on suicide rates, Data: Output variables: Method/Algorithm for this experiment Experiment design 3: Predict which age groups are most prone to commit suicide Data: Output variables: Method/Algorithm …
Category: Root
May 22
Tools and Tutorials for Data Manipulation
Join Data from Multiple Sources •Power BI •Python •SQL •Databases and Data Warehouse •https://durhamcollege.desire2learn.com/d2l/le/content/467097/viewContent/6376898/View •Data Modeling and SQL •https://durhamcollege.desire2learn.com/d2l/le/content/467097/viewContent/6376900/View •Microsoft Power BI •https://durhamcollege.desire2learn.com/d2l/le/content/467097/viewContent/6377023/View Tutorials and Examples •MySQL Data Manipulation: •https://www.databasejournal.com/mysql/mysql-data-manipulation-and-query-statements/ •https://www.w3schools.com/sql/ •https://www.tutorialspoint.com/sql/index.htm •Workbench: https://www.tutorialspoint.com/create-a-new-database-with-mysql-workbench •SQL Server Data Manipulation •https://www.tutorialspoint.com/ms_sql_server/index.htm •Management Studio: •https://www.tutorialspoint.com/ms_sql_server/ms_sql_server_management_studio.htm •Power BI Data Manipulation •https://learn.microsoft.com/en-us/power-bi/connect-data/desktop-tutorial-importing-and-analyzing-data-from-a-web-page •Data Manipulation in Python •https://www.analyticsvidhya.com/blog/2021/06/data-manipulation-using-pandas-essential-functionalities-of-pandas-you-need-to-know/ Data Analytics, Machine …
May 22
Threat To Validity for Your Data Analytics Projects
•Internal •External •Construct •Statistical Conclusion •Internal: Informative variable missing. Bring data from other sources •External: Fixation variable make the result perfect. Model may not generalize •Construct: Class imbalance affects outcome badly •Statistical Conclusion: Based on the statistical measure used, the conclusion can be incorrect. •Data Mining: Association: Support, Confidence, and Lift Internal Validity Is your …
May 22
Threat To Validity for Your Data Analytics Projects
• Internal • External • Construct • Statistical Conclusion • Internal: Informative variable missing. Bring data from other sources • External: The Fixation variable makes the result perfect. The model may not generalize • Construct: Class imbalance affects the outcome badly • Statistical Conclusion: Based on the statistical measure used, the conclusion can be incorrect. …
May 22
McNemar’s Test
Chi-Square McNemar’s Test Chi-square: “A chi-square test is used to help determine if observed results are in line with expected results, and to rule out that observations are due to chance.” Coinflip as an example [1] References:1. https://www.investopedia.com/terms/c/chi-square-statistic.asp Data Analytics, Machine Learning, Data Science
May 22
Statistics for Data Analytics and Machine Learning Projects
•Null Hypothesis •[2] •Paired t-test •Unpaired t-test •Pearson Correlation •One Way: Analysis of variance •Spearman Correlation •Spearman •Kendal Tau Coef •Wilcoxon Sum test •Basic EDA •Mcnaimer’s test •Friedman test •Kruskal-Wallis Test •Two Way Analysis of variance •K-Fold Cross Validation paired t-test •Wilcoxon Signed Rank Test Data Analytics, Machine Learning, Data Science
May 22
Make Sense of your Data: For Data Analytics Project
Hypothesis-based versus data-driven analysis “Only those data analysts who are given time to explore and analyze data thoughtfully and thoroughly are consistently successful.” Data Identification and Prioritization Use Augmented data besides Data Pipeline Analytics Sandbox Characterizing the Data—Exploring a Single Variable Data: Descriptive analysis options Find: Distribution of quantitative variables Reference: [1]. Gregory S. Nelson. …
May 21
Model Selection
• Optimizations/Machine Learning/Data Mining/Deep Learning/Reinforcement Learning/Graph Mining/NLP/Genetic Algorithms • Regression • Linear • Non-Linear • Classifications • Logistics Regression • Sigmoid : Binary • Softmax: Multi-Class • Bayes Classifier • SVM • Bayesian: Regression/Classification • Clustering • K-NN • KNN+ • Kmeans, Hierarchical, Density •Machine Learning/Data Mining/Deep Learning/Reinforcement Learning/Graph Mining/NLP •Time Series Analysis •Decision (Regression, …






