Misc. Optimization. Machine Learning

"What is machine learning optimization?

Optimization is the most essential ingredient in the recipe of machine learning algorithms. It starts with defining some kind of loss function/cost function and ends with minimizing the it using one or the other optimization routine.Sep 5, 2018"
https://towardsdatascience.com/demystifying-optimizations-for-machine-learning-c6c6405d3eea

Ordered vector space

"Given a vector space V over the real numbers R and a preorder ≤ on the set V, the pair (V, ≤) is called a preordered vector space if for all x, y, z in V and 0 ≤ λ in R the following two axioms are satisfied

  1. xy implies x + zy + z
  2. yx implies λyλx.

If ≤ is a partial order, (V, ≤) is called an ordered vector space. The two axioms imply that translations and positive homotheties are automorphisms of the order structure and the mapping x ↦ −x is an isomorphism to the dual order structure. Ordered vector spaces are ordered groups under their addition operation."
https://en.wikipedia.org/wiki/Ordered_vector_space

Algebra > Vector Algebra >

Vector Ordering

"If the first nonzero component of the vector difference A-B is >0, then A≻B. If the first nonzero component of A-B is <0, then A≺B."

http://mathworld.wolfram.com/VectorOrdering.html

Vectors:

https://www.mathsisfun.com/algebra/vectors.html

Vector: Dot Product: Costheta

https://www.mathsisfun.com/algebra/vectors-dot-product.html

Vector Cross Product
https://www.mathsisfun.com/algebra/vectors-cross-product.html

"Optimization lies at the heart of machine learning. Most machine learning problems reduce to optimization problems."
https://www.quora.com/What-is-the-relationship-between-machine-learning-and-mathematical-optimization

"Why is optimization important?
The purpose of optimization is to achieve the “best” design relative to a set of prioritized criteria or constraints. These include maximizing factors such as productivity, strength, reliability, longevity, efficiency, and utilization. ... This decision-making process is known as optimization."
https://digitalcommons.usu.edu/cgi/viewcontent.cgi?article=1031&context=ncete_publications

*** . *** . ***
Sayed Ahmed

BSc. Eng. in Comp. Sc. & Eng. (BUET)
MSc. in Comp. Sc. (U of Manitoba, Canada)
MSc. in Data Science and Analytics (Ryerson University, Canada)
Linkedin: https://ca.linkedin.com/in/sayedjustetc

Blog: http://Bangla.SaLearningSchool.com, http://SitesTree.com
Online and Offline Training: http://Training.SitesTree.com
FB Group on Learning/Teaching: https://www.facebook.com/banglasalearningschool
Our free or paid events on IT/Data Science/Cloud/Programming/Similar: https://www.facebook.com/justetcsocial

Get access to courses on Big Data, Data Science, AI, Cloud, Linux, System Admin, Web Development and Misc. related. Also, create your own course to sell to others. http://sitestree.com/training/

If you want to contribute to the operation of this site (Bangla.SaLearn) including occasional free and/or low cost online/offline training: http://Training.SitesTree.com (or charitable/non-profit work in the education/health/social service sector), you can financially contribute to: safoundation at salearningschool.com using Paypal or Credit Card (on http://sitestree.com/training/enrol/index.php?id=114 ).