Ref: Google Proxy Pattern from Wikipedia Class Diagram from Wikipedia If you have access to Linkedin Courses, then the following Videos will be useful https://www.linkedin.com/learning/c-sharp-design-patterns-part-3-2017/proxy-pattern-explained?u=2199673 https://www.linkedin.com/learning/c-sharp-design-patterns-part-3-2017/walk-through-proxy-pattern?autoSkip=true&resume=false&u=2199673
Category: Root
Jan 01
Interesting Data Visualizations:
Interesting Data Visualizations: https://towardsdatascience.com/the-art-of-effective-visualization-of-multi-dimensional-data-6c7202990c57 Building Interactive Dashboards with Jupyter https://blog.dominodatalab.com/interactive-dashboards-in-jupyter Visualization: Mapping Global Earthquake Activity http://introtopython.org/visualization_earthquakes.html Mapping Data in Python with Pandas and Vincent http://wrobstory.github.io/2013/10/mapping-data-python.html Maps in R: Plotting data points on a map http://www.milanor.net/blog/maps-in-r-plotting-data-points-on-a-map/ Installing basemap on Mac / Python https://stackoverflow.com/questions/42299352/installing-basemap-on-mac-python https://stackoverflow.com/questions/21956683/enable-access-control-on-simple-http-server Vincent Repo: https://github.com/wrobstory/vincent_map_data
Jan 01
Advanced Data Visualization Resources (in Python)
Advanced Data Visualization Advanced Data Visualization Data Visualization Misc Data Visualization Misc Data Visualization Misc Repeat of previous topic: see title Basic Charts Resources Basic Charts Resources Basic Charts Resources Basic Charts Resources Basic Charts Resources Basic Charts Resources Network Visualizations Network Visualizations Network Visualizations Network Visualizations GEO VISUALIZATION GEO VISUALIZATION GEO VISUALIZATION Visualization of …
Dec 29
Idea, Applications, and Research: Multi Armed Bandit in Reinforcement Learning
Ref and Read: https://medium.com/@gridflowai/multi-armed-bandits-an-overview-on-classical-rl-algorithms-9a1e047cd98e https://www.kdnuggets.com/2023/01/introduction-multiarmed-bandit-problems.html Epsilon Greedy: https://medium.com/opex-analytics/multi-armed-bandits-101-6f4ac62b6bd6 https://cxl.com/blog/bandit-tests https://www.geeksforgeeks.org/epsilon-greedy-algorithm-in-reinforcement-learning https://sagemaker-examples.readthedocs.io/en/latest/reinforcement_learning/bandits_statlog_vw_customEnv/bandits_statlog_vw_customEnv.html
Dec 27
Reinforcement Learning Problem
Ref: https://www.cs.toronto.edu/~jlucas/teaching/csc411/lectures/lec21_22_handout.pdf Formulate: Read more from: https://www.cs.toronto.edu/~jlucas/teaching/csc411/lectures/lec21_22_handout.pdf What is a Policy (Deterministic Policy, Stochastic Policy) What is a Value Function What is a Model? What is Model Free. Markov Property for Model MDP Problems Exploration and Exploitation Bellman Equations Q-Learning Function Approximation for Large State Spaces
Dec 27
Topics: Reinforcement Learning (Interactive Learning in Decision Processes):
What is: Reinforcement Learning (Interactive Learning in Decision Processes)? — Is there a way to learn by interacting — i.e. interact have experience and use the experience to learn (predict the future) — Interact to explore and utilize what makes learning (goal/outcome) enhanced — The computation approach of this method is Reinforcement Learning (Interactive Learning …
Dec 25