Initial Analysis of Text Data • Stop word filter • Lemma • POS • Vocabulary Analysis Image Data: Initial Analysis • Fix image size, ratios • Image Scaling • Transform to Gray • Standardize Data Analytics, Machine Learning, Data Science
Category: Root
May 21
Data Requirements for Data Analytics Projects
Data • Dataset Characteristics •Large Scale, Real, Representative, Relevant Features, balanced classes, unit relevant • Adapting data/dataset for the project •Clean, normalize/standardize, bring more data, and bring more data of the missing type • Data Suitability for the project • Check for R Square Measure • Check for Bias, Variance, • Do Exploratory Analysis • …
May 21
Initial and Exploratory Analysis for Data Analytics Projects
To have a thorough understanding of the data. Two Types: • Initial Analysis • Exploratory Analysis Initial Analysis: Univariate Analysis • Deciding/Determining the dependent (target) variable • Assigning the correct data types, appropriate column names • Address: Inconsistencies, missing values, outliers • Categorical variables with too many levels (address the issue) • (understand) Distributions of …
May 20
Inductive and Deductive Methods for Data Analytics Projects
Inductive and Deductive Methods for Data Analytics Projects Deductive: Top-down approach. Take existing theories and apply to data Inductive: Bottom-up approach. Observe data and derive a hypothesis. “ Examples in Data Analytics: “ Ref: Internet/Google AI In a data analytics project, you may use both of the approaches. Initially, you may use an inductive approach …
May 18
Data Manipulation for ML and Data Analytics Projects.
•MySQL Data Manipulation: •https://www.databasejournal.com/mysql/mysql-data-manipulation-and-query-statements/ •https://www.w3schools.com/sql/ •https://www.tutorialspoint.com/sql/index.htm •Workbench: https://www.tutorialspoint.com/create-a-new-database-with-mysql-workbench •SQL Server Data Manipulation •https://www.tutorialspoint.com/ms_sql_server/index.htm •Management Studio: •https://www.tutorialspoint.com/ms_sql_server/ms_sql_server_management_studio.htm •Power BI Data Manipulation •https://learn.microsoft.com/en-us/power-bi/connect-data/desktop-tutorial-importing-and-analyzing-data-from-a-web-page •Data Manipulation in Python •https://www.analyticsvidhya.com/blog/2021/06/data-manipulation-using-pandas-essential-functionalities-of-pandas-you-need-to-know/ Data Analytics, Machine Learning, Data Science
May 18
How to Report (or Present) the outcome of your Analytics/ML Project
Reporting and Analysis •Examples •Results section: Page 51: STOCK MARKET PREDICTION USING ENSEMBLE OF GRAPHTHEORY, MACHINE LEARNING AND DEEP LEARNING MODELS •https://scholarworks.sjsu.edu/cgi/viewcontent.cgi?article=1692&context=etd_projects •Check Results and Discussion sections •https://arxiv.org/ftp/arxiv/papers/2203/2203.06848.pdf •A Comparative Study on Forecasting of Retail Sales May be complicated: Learning Context-Aware Classifier for Semantic Segmentation •https://arxiv.org/pdf/2303.11633.pdf •Learning Context-Aware Classifier for Semantic Segmentation •Check results section; …
May 17
Data Analytics Concepts and Methods
What is Analysis? [1] • “A comprehensive, data-driven strategy for problem solving” Analytics • “Analytics uses logic, inductive and deductive reasoning, critical thinking, and quantitative methods along with data to examine phenomena and determine its essential features” • “any solution that supports the identification of meaningful patterns and relationships among data.” CONCEPTS [1] Analytics Methods [1]: [1] …
May 14
Some Basic SQLs in Oracle
— Find Tables in a Schema — for SH schema SELECT owner, table_nameFROM all_tableswhere OWNER = ‘SH’; — for HR Schema SELECT owner, table_nameFROM all_tableswhere OWNER = ‘HR’; — Create table based on another table DROP TABLE MyCustomer; — Create the structure but no data create table MyCustomer AS Select Cust_ID, Cust_First_Name, Cust_Last_Name FROM sh.Customers …
May 09
Linux Certification (RedHat, Ubuntu, Generic)
Linux Certification (RedHat, Ubuntu, Generic) For UBUNTU: CUE.01 Linux Quick Certification (QC) CUE.02 Desktop Quick Certification (QC) CUE.03 Server Quick Certification (QC) Ref: https://ubuntu.com/credentials RedHat: Red Hat Certified System Administrator Red Hat Certified Engineer Red Hat Certified Specialist in Containers Red Hat Certified OpenShift Administrator Ref: https://www.redhat.com/en/services/certifications Linux Professional Institute LPIC-1 LPIC-1, LPIC-2, LPIC-3 Ref: …
