Want to become a self-driving car engineer: "12 PROJECTS THAT HELP YOU BECOME SELF-DRIVING CAR ENGINEER (PYTHON and C++ CODE AVAILABLE)"

Project 1 – Finding Lane Lines on the Road

https://github.com/ndrplz/self-driving-car/tree/master/project_1_lane_finding_basic

Project 2 – Traffic Sign Classification

https://github.com/ndrplz/self-driving-car/tree/master/project_2_traffic_sign_classifier

Project 3 – Behavioral Cloning

https://github.com/ndrplz/self-driving-car/tree/master/project_3_behavioral_cloning

Project 4 – Advanced Lane Finding

https://github.com/ndrplz/self-driving-car/tree/master/project_4_advanced_lane_finding

Vehicle Detection Project

https://github.com/ndrplz/self-driving-car/tree/master/project_5_vehicle_detection

Extended Kalman Filter Project

https://github.com/ndrplz/self-driving-car/tree/master/project_6_extended_kalman_filter

Unscented Kalman Filter Project Starter Code

https://github.com/ndrplz/self-driving-car/tree/master/project_7_unscented_kalman_filter

Kidnapped Vehicle

https://github.com/ndrplz/self-driving-car/tree/master/project_8_kidnapped_vehicle

keeping the car on track by appropriately adjusting the steering angle.

https://github.com/ndrplz/self-driving-car/tree/master/project_9_PID_control

Model-predictictive control: CarND-Controls-MPC

https://github.com/ndrplz/self-driving-car/tree/master/project_10_MPC_control

Path Planning

https://github.com/ndrplz/self-driving-car/tree/master/project_11_path_planning

Road Segmentation

https://github.com/ndrplz/self-driving-car/tree/master/project_12_road_segmentation

https://github.com/ndrplz

Reference:

https://www.linkedin.com/feed/update/activity:6530021235290664960/

Svinicki, M. & McKeachie, W.J. (2014) McKeachie’s Teaching Tips: Strategies, Research and Theory for College and University Teachers. (14th ed). Australia: Wadsworth, Cengage Learning.

• Davis, B.G. (2009). Tools for Teaching. San Francisco, CA: Jossey-Bass.

• Bain, K. (2004). What the Best College Teachers Do. Cambridge, MA: Harvard University Press.

"

Gym:
https://gym.openai.com/

Gym is a toolkit for developing and comparing …. It supports teaching agents everything from walking to playing games like Pong or Pinball.

"
https://gym.openai.com/

—-

"Project Malmo integrates (deep) reinforcement learning, cognitive science, and many ideas from artificial intelligence. "

https://www.microsoft.com/en-us/research/project/project-malmo/

—-

DeepMind:
"DeepMind’s scientific mission is to push the boundaries of AI, developing systems that can learn to solve any complex problem without needing to be taught how"
https://deepmind.com/blog/open-sourcing-deepmind-lab/

—

UCL Course on RL

http://www0.cs.ucl.ac.uk/staff/d.silver/web/Teaching.html

Basics of RL

From: https://www.kdnuggets.com/2018/03/5-things-reinforcement-learning.html
"

1. What is reinforcement learning? How does it relate with other ML techniques?

Reinforcement Learning(RL) is a type of machine learning technique that enables an agent to learn in an interactive environment by trial and error using feedback from its own actions and experiences.

3. What are some most used Reinforcement Learning algorithms?

Q-learning and SARSA (State-Action-Reward-State-Action) are two commonly used model-free RL algorithms.

"

Uses of RL

" building AI for playing computer games"

" robotics and industrial automation "

"applications of RL include text summarization engines, dialog agents (text, speech) which can learn from user interactions and improve with time, learning optimal treatment policies in healthcare and RL based agents for online stock trading."

"WHAT ARE MAJOR REINFORCEMENT LEARNING ACHIEVEMENTS & PAPERS FROM 2018?"

Reference:
https://www.topbots.com/most-important-ai-reinforcement-learning-research/#ai-rl-paper-2018-10

"

1. Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor
2. IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
3. Temporal Difference Models: Model-Free Deep RL for Model-Based Control
4. Addressing Function Approximation Error in Actor-Critic Methods
5. Learning by Playing – Solving Sparse Reward Tasks from Scratch
6. Hierarchical Imitation and Reinforcement Learning
7. Unsupervised Predictive Memory in a Goal-Directed Agent
8. Data-Efficient Hierarchical Reinforcement Learning
9. Visual Reinforcement Learning with Imagined Goals
10. Horizon: Facebook’s Open Source Applied Reinforcement Learning Platform

"

Reinforcement Learning: Tutorials: Code: Questions and Answers

Must Check: Questions and Answers:
https://www.inf.ed.ac.uk/teaching/courses/rl/tutorials.html

Check if you can find an equation here: Check the grid example
https://medium.com/@zsalloum/monte-carlo-in-reinforcement-learning-the-easy-way-564c53010511

TD: Temporal Difference
https://towardsdatascience.com/td-in-reinforcement-learning-the-easy-way-f92ecfa9f3ce

Not that good:
https://courses.cs.washington.edu/courses/csep573/12au/lectures/18-rl.pdf
http://incompleteideas.net/609%20dropbox/slides%20(pdf%20and%20keynote)/9-10-MC.pdf

Learn Reinforcement Learning:

Why and where to use Reinforcement Learning?
Robotics for sure, Autonomous Vehicles for sure, Finance (creating better investment portfolio), Healthcare/Medical, Inventory Management, Manufacturing or similar.

https://chatbotsmagazine.com/reinforcement-learning-and-its-practical-applications-8499e60cf751

10 Sets of Presentation Slides:
https://www.slideserve.com/search/presentations/sutton-reinforcement-learning/1

https://www.slideserve.com/search/presentations/sutton-reinforcement-learning/2

https://www.slideserve.com/search/presentations/sutton-reinforcement-learning/3

https://www.slideserve.com/search/presentations/sutton-reinforcement-learning/4

https://www.slideserve.com/search/presentations/sutton-reinforcement-learning/5

https://www.slideserve.com/search/presentations/sutton-reinforcement-learning/6

https://www.slideserve.com/search/presentations/sutton-reinforcement-learning/7

https://www.slideserve.com/search/presentations/sutton-reinforcement-learning/8

https://www.slideserve.com/search/presentations/sutton-reinforcement-learning/9

https://www.slideserve.com/search/presentations/sutton-reinforcement-learning/10

Sayed Ahmed

sayedum

Linkedin: https://ca.linkedin.com/in/sayedjustetc

Blog: http://sitestree.com, http://bangla.salearningschool.com

Reference:
https://github.com/fchollet/deep-learning-with-python-notebooks

Jupyter notebooks for the code samples of the book "Deep Learning with Python"
Book Link: https://www.manning.com/books/deep-learning-with-python?a_aid=keras&a_bid=76564dff

You might want to search Google if the publisher/author published the book for free online viewing. Sometimes authors do that.

"This repository contains Jupyter notebooks implementing the code samples found in the book Deep Learning with Python (Manning Publications). "

"These notebooks use Python 3.6 and Keras 2.0.8. "

Canada’s post-secondary schools exploiting international students, says recruiter

https://www.cbc.ca/news/canada/windsor/international-student-recruiter-institution-exploitation-1.4668831

Competition and corruption in education: a lethal combination for academic integrity

https://blogs.biomedcentral.com/bmcblog/2018/08/06/competition-corruption-education-lethal-combination-academic-integrity/

Corruption in Higher Education: Does it Differ across the Nations and Why?

https://www.researchgate.net/publication/228618433_Corruption_in_Higher_Education_Does_it_Differ_across_the_Nations_and_Why

Global Corruption

Report:

Education

https://my.vanderbilt.edu/stephenheyneman/files/2011/09/Higher-education-institutions-Why-they-matter-and-why-corruption-puts-them-at-risk.pdf

Corruption and bribery in the classroom

https://www.bbc.com/news/business-24444599

One in five executives thinks corruption is widespread in Canada’s business world, EY report shows

https://business.financialpost.com/executive/leadership/ey-canada-curruption

University Legal Education in Canada is Corrupt Beyond Repair

https://canadianjusticereviewboard.ca/articles-caselaw/articles/university-legal-education-in-canada-is-corrupt-beyond-repair-writes-robert-martin

Curbing Corruption: Education

https://curbingcorruption.com/sector/education/

Canada not immune from corruption, E&Y study finds

https://www.theglobeandmail.com/report-on-business/canada-not-immune-from-corruption-ey-study-finds/article19130773/

Corruption in Canada

https://en.wikipedia.org/wiki/Corruption_in_Canada

Paying the price:

Confronting corruption in international business

https://www.tradecommissioner.gc.ca/canadexport/0000655.aspx?lang=eng

Bribery and corruption

https://www.international.gc.ca/trade-agreements-accords-commerciaux/topics-domaines/other-autre/corruption.aspx?lang=eng

Anti-Corruption and Bribery in Canada

https://www.lexology.com/library/detail.aspx?g=ed37f53e-195e-4290-9600-da01e2a08f13

The corporatization of post-secondary education

https://cupe.ca/corporatization-post-secondary-education

How Health Care Analytics Improves Patient Care

https://healthinformatics.uic.edu/blog/how-health-care-analytics-improves-patient-care/
—

What is Health Analytics?
https://www.evariant.com/faq/what-is-health-analytics

Why Is Data Analytics Important in Healthcare?
https://www.dataversity.net/data-analytics-important-healthcare/#

The opportunities and challenges of data analytics in health care
https://www.brookings.edu/research/the-opportunities-and-challenges-of-data-analytics-in-health-care/

12 Examples of Big Data Analytics In Healthcare That Can Save People
https://www.datapine.com/blog/big-data-examples-in-healthcare/

Three Principles for Making Healthcare Data Analytics Actionable
https://www.healthcatalyst.com/insights/3-principles-actionable-healthcare-data-analytics

93% of Healthcare Execs Seeking Improved Data Analytics, CDI
https://healthitanalytics.com/news/93-of-healthcare-execs-seeking-improved-data-analytics-cdi

Basics:
https://www.sisense.com/glossary/healthcare-analytics-basics/

Sayed Ahmed
sayedum

Linkedin: https://ca.linkedin.com/in/sayedjustetc

Blog: http://sitestree.com, http://bangla.salearningschool.com

On Text Classification based on Deep Learning/Neural Networks

Text Classification Using LSTM and visualize Word Embeddings: Part-1

https://medium.com/@sabber/classifying-yelp-review-comments-using-lstm-and-word-embeddings-part-1-eb2275e4066b

Different approaches of Text Classification

https://www.kdnuggets.com/2018/07/text-classification-lstm-cnn-pre-trained-word-vectors.html

How to do text classification with CNNs, TensorFlow and word embedding

https://towardsdatascience.com/how-to-do-text-classification-using-tensorflow-word-embeddings-and-cnn-edae13b3e575

Classification of Customer Complaints using Tensorflow: Text Classification with Word Embeddings

https://medium.com/@opalkabert/classification-of-customer-complaints-using-tensorflow-text-classification-with-word-embeddings-e87952b5147c

An analysis of hierarchical text classification using word embeddings

https://www.sciencedirect.com/science/article/pii/S0020025518306935

FastText Word Embeddings for Text Classification with MLP and Python

http://ai.intelligentonlinetools.com/ml/fasttext-word-embeddings-text-classification-python-mlp/

Text Classification With Word2Vec

http://nadbordrozd.github.io/blog/2016/05/20/text-classification-with-word2vec/

Text Classification with Word Embeddings

https://www.coursera.org/lecture/ai/text-classification-with-word-embeddings-Ieg9d

Understanding how Convolutional Neural Network (CNN) perform text classification with word embeddings

http://www.joshuakim.io/understanding-how-convolutional-neural-network-cnn-perform-text-classification-with-word-embeddings/

Using pre-trained word embeddings in a Keras model

https://blog.keras.io/using-pre-trained-word-embeddings-in-a-keras-model.html

Animated RNN, LSTM and GRU

https://towardsdatascience.com/animated-rnn-lstm-and-gru-ef124d06cf45

Sayed Ahmed
sayedum

Linkedin: https://ca.linkedin.com/in/sayedjustetc

Blog: http://sitestree.com, http://bangla.salearningschool.com