Data Analytics, Machine Learning, Data Science
Category: Root
May 21
Evaluating Your Data Analytics Project Outcome
Regression Projects • R Square, Goodness of fit • RMSE Classification Projects • Confusion Matrix • ROC • Accuracy, Recall, Precision RL – Reinforcement • Reward – Cumulative Data Analytics, Machine Learning, Data Science
May 21
Dimensionality Reduction
Some Approaches •Feature Selection •Feature Extraction •PCA •SVD •LDA Data Analytics, Machine Learning, Data Science
May 21
Initial Analysis of Text and Image Data (Data Analytics and ML Projects)
Initial Analysis of Text Data • Stop word filter • Lemma • POS • Vocabulary Analysis Image Data: Initial Analysis • Fix image size, ratios • Image Scaling • Transform to Gray • Standardize Data Analytics, Machine Learning, Data Science
May 21
Data Requirements for Data Analytics Projects
Data • Dataset Characteristics •Large Scale, Real, Representative, Relevant Features, balanced classes, unit relevant • Adapting data/dataset for the project •Clean, normalize/standardize, bring more data, and bring more data of the missing type • Data Suitability for the project • Check for R Square Measure • Check for Bias, Variance, • Do Exploratory Analysis • …
May 21
Initial and Exploratory Analysis for Data Analytics Projects
To have a thorough understanding of the data. Two Types: • Initial Analysis • Exploratory Analysis Initial Analysis: Univariate Analysis • Deciding/Determining the dependent (target) variable • Assigning the correct data types, appropriate column names • Address: Inconsistencies, missing values, outliers • Categorical variables with too many levels (address the issue) • (understand) Distributions of …
May 20
Inductive and Deductive Methods for Data Analytics Projects
Inductive and Deductive Methods for Data Analytics Projects Deductive: Top-down approach. Take existing theories and apply to data Inductive: Bottom-up approach. Observe data and derive a hypothesis. “ Examples in Data Analytics: “ Ref: Internet/Google AI In a data analytics project, you may use both of the approaches. Initially, you may use an inductive approach …
May 18
Data Manipulation for ML and Data Analytics Projects.
•MySQL Data Manipulation: •https://www.databasejournal.com/mysql/mysql-data-manipulation-and-query-statements/ •https://www.w3schools.com/sql/ •https://www.tutorialspoint.com/sql/index.htm •Workbench: https://www.tutorialspoint.com/create-a-new-database-with-mysql-workbench •SQL Server Data Manipulation •https://www.tutorialspoint.com/ms_sql_server/index.htm •Management Studio: •https://www.tutorialspoint.com/ms_sql_server/ms_sql_server_management_studio.htm •Power BI Data Manipulation •https://learn.microsoft.com/en-us/power-bi/connect-data/desktop-tutorial-importing-and-analyzing-data-from-a-web-page •Data Manipulation in Python •https://www.analyticsvidhya.com/blog/2021/06/data-manipulation-using-pandas-essential-functionalities-of-pandas-you-need-to-know/ Data Analytics, Machine Learning, Data Science
May 18
How to Report (or Present) the outcome of your Analytics/ML Project
Reporting and Analysis •Examples •Results section: Page 51: STOCK MARKET PREDICTION USING ENSEMBLE OF GRAPHTHEORY, MACHINE LEARNING AND DEEP LEARNING MODELS •https://scholarworks.sjsu.edu/cgi/viewcontent.cgi?article=1692&context=etd_projects •Check Results and Discussion sections •https://arxiv.org/ftp/arxiv/papers/2203/2203.06848.pdf •A Comparative Study on Forecasting of Retail Sales May be complicated: Learning Context-Aware Classifier for Semantic Segmentation •https://arxiv.org/pdf/2303.11633.pdf •Learning Context-Aware Classifier for Semantic Segmentation •Check results section; …
May 17
Data Analytics Concepts and Methods
What is Analysis? [1] • “A comprehensive, data-driven strategy for problem solving” Analytics • “Analytics uses logic, inductive and deductive reasoning, critical thinking, and quantitative methods along with data to examine phenomena and determine its essential features” • “any solution that supports the identification of meaningful patterns and relationships among data.” CONCEPTS [1] Analytics Methods [1]: [1] …
