{"id":17362,"date":"2020-08-27T22:47:30","date_gmt":"2020-08-28T02:47:30","guid":{"rendered":"http:\/\/bangla.salearningschool.com\/recent-posts\/parameter-optimization-in-using-neural-network\/"},"modified":"2020-08-27T22:47:30","modified_gmt":"2020-08-28T02:47:30","slug":"parameter-optimization-in-using-neural-network","status":"publish","type":"post","link":"http:\/\/bangla.sitestree.com\/?p=17362","title":{"rendered":"Parameter Optimization in\/using Neural Network"},"content":{"rendered":"<p>Parameter optimization in neural networks<\/p>\n<p><a href=\"https:\/\/www.deeplearning.ai\/ai-notes\/optimization\/\">https:\/\/www.deeplearning.ai\/ai-notes\/optimization\/<\/a><\/p>\n<p><strong>Coding Deep Learning for Beginners \u2014 Linear Regression (Part 2): Cost Function<\/strong><\/p>\n<p><a href=\"https:\/\/towardsdatascience.com\/coding-deep-learning-for-beginners-linear-regression-part-2-cost-function-49545303d29f\">https:\/\/towardsdatascience.com\/coding-deep-learning-for-beginners-linear-regression-part-2-cost-function-49545303d29f<\/a><\/p>\n<p><strong>CBMM Tutorial: Optimization Notes<\/strong><\/p>\n<p><a href=\"https:\/\/cbmm.mit.edu\/sites\/default\/files\/documents\/CBMM_Optimization_Notes_2017.html\">https:\/\/cbmm.mit.edu\/sites\/default\/files\/documents\/CBMM_Optimization_Notes_2017.html<\/a><\/p>\n<p><strong>Gradient descent<\/strong><\/p>\n<p><a href=\"https:\/\/www.jeremyjordan.me\/gradient-descent\/\">https:\/\/www.jeremyjordan.me\/gradient-descent\/<\/a><\/p>\n<p><strong>Hyper-parameter Tuning Techniques in Deep Learning<\/strong><\/p>\n<p><a href=\"https:\/\/towardsdatascience.com\/hyper-parameter-tuning-techniques-in-deep-learning-4dad592c63c8\">https:\/\/towardsdatascience.com\/hyper-parameter-tuning-techniques-in-deep-learning-4dad592c63c8<\/a><\/p>\n<p><strong>Model Parameters and Hyperparameters in Machine Learning \u2014 What is the difference?<\/strong><\/p>\n<p><a href=\"https:\/\/towardsdatascience.com\/model-parameters-and-hyperparameters-in-machine-learning-what-is-the-difference-702d30970f6\">https:\/\/towardsdatascience.com\/model-parameters-and-hyperparameters-in-machine-learning-what-is-the-difference-702d30970f6<\/a><\/p>\n<p><strong>Lecture 8: Optimization<\/strong><\/p>\n<p><a href=\"https:\/\/www.cs.toronto.edu\/~rgrosse\/courses\/csc321_2018\/slides\/lec08.pdf\">https:\/\/www.cs.toronto.edu\/~rgrosse\/courses\/csc321_2018\/slides\/lec08.pdf<\/a><\/p>\n<p><strong>Optimization Techniques<\/strong><\/p>\n<p><a href=\"https:\/\/www.cs.cmu.edu\/afs\/cs\/academic\/class\/15782-f06\/slides\/optimization.pdf\">https:\/\/www.cs.cmu.edu\/afs\/cs\/academic\/class\/15782-f06\/slides\/optimization.pdf<\/a><\/p>\n<p><strong>Parameter optimization in neural networks<\/strong><\/p>\n<p><a href=\"https:\/\/www.deeplearning.ai\/ai-notes\/optimization\/\">https:\/\/www.deeplearning.ai\/ai-notes\/optimization\/<\/a><\/p>\n<p><strong>What is the Difference Between a Parameter and a Hyperparameter?<\/strong><\/p>\n<p><a href=\"https:\/\/machinelearningmastery.com\/difference-between-a-parameter-and-a-hyperparameter\/\">https:\/\/machinelearningmastery.com\/difference-between-a-parameter-and-a-hyperparameter\/<\/a><\/p>\n<p>*** . *** *** . *** . *** . ***<\/p>\n<p><em><strong><em><strong>Training Courses: <\/strong><a href=\"http:\/\/training.sitestree.com\/\">http:\/\/Training.SitesTree.com<\/a> <\/em><br \/>\nBlog<\/strong>: <a href=\"http:\/\/bangla.salearningschool.com\/\">http:\/\/Bangla.SaLearningSchool.com<\/a>, <a href=\"http:\/\/sitestree.com\">http:\/\/SitesTree.com<\/a><\/em><br \/>\n<em><strong>8112223 Canada Inc\/Justetc<\/strong>: <a href=\"http:\/\/JustEtc.net\">http:\/\/JustEtc.net<\/a><\/em><br \/>\n<em>Youtube: <\/em><a href=\"https:\/\/www.youtube.com\/channel\/UCHrtq0pV8mEuTLGd2-Lp9ig\/playlists\">https:\/\/www.youtube.com\/channel\/UCHrtq0pV8mEuTLGd2-Lp9ig\/playlists<\/a><br \/>\n<em><strong>Medium: <\/strong><\/em><a href=\"https:\/\/medium.com\/@SayedAhmedCanada\">https:\/\/medium.com\/@SayedAhmedCanada<\/a><\/p>\n<p><em><strong>Online Product Database: <\/strong><\/em><a href=\"http:\/\/www.shopforsoul.com\/\">http:\/\/www.shopforsoul.com\/<\/a> (Not For Retail Sales, Not actively Managed)<br \/>\n<em><\/em><br \/>\n<em><strong>Sayed Ahmed<\/strong><br \/>\n<\/em><br \/>\n<em><strong>BSc. Eng. in Comp. Sc. &amp; Eng. (BUET)<\/strong><\/em><br \/>\n<em><strong>MSc. in Comp. Sc. (U of Manitoba, Canada)<\/strong><\/em><br \/>\n<em><strong>MSc. in Data Science and Analytics (Ryerson University, Canada)<\/strong><\/em><br \/>\n<em><strong>Linkedin<\/strong>: <a href=\"https:\/\/ca.linkedin.com\/in\/sayedjustetc\">https:\/\/ca.linkedin.com\/in\/sayedjustetc<\/a><br \/>\n<\/em><\/p>\n<p><em><strong>Facebook Groups\/Forums to discuss (Q &amp; A): <\/strong><\/em><br \/>\n<a href=\"https:\/\/www.facebook.com\/salearningschool\/?ref=your_pages\">https:\/\/www.facebook.com\/salearningschool<\/a><\/p>\n<p><a href=\"https:\/\/www.facebook.com\/banglasalearningschool\">https:\/\/www.facebook.com\/banglasalearningschool<\/a><br \/>\n<a href=\"https:\/\/www.facebook.com\/justetcsocial\">https:\/\/www.facebook.com\/justetcsocial<\/a><\/p>\n<p><em>Get access to courses on Big Data, Data Science, AI, Cloud, Linux, System Admin, Web Development and Misc. related. Also, create your own course to sell to others. <\/em><a href=\"http:\/\/sitestree.com\/training\/\">http:\/\/sitestree.com\/training\/<\/a><\/p>\n<p><strong>Join, Discuss, and Thrive:<\/strong><br \/>\nFinance: <a href=\"https:\/\/www.facebook.com\/groups\/1792339521056034\">https:\/\/www.facebook.com\/groups\/1792339521056034<\/a><\/p>\n<p>Bangladesh and Canada: <a href=\"https:\/\/www.facebook.com\/groups\/398414183875009\">https:\/\/www.facebook.com\/groups\/398414183875009<\/a><\/p>\n<p>Bangladesh: IT &amp; Eng: Canada: <a href=\"https:\/\/www.facebook.com\/groups\/480297675634630\">https:\/\/www.facebook.com\/groups\/480297675634630<\/a><\/p>\n<p>BUETians in Ontario: <a href=\"https:\/\/www.facebook.com\/groups\/371982239854027\">https:\/\/www.facebook.com\/groups\/371982239854027<\/a><\/p>\n<p>Worldwide IT: <a href=\"https:\/\/www.facebook.com\/groups\/28362061867\">https:\/\/www.facebook.com\/groups\/28362061867<\/a><\/p>\n<p>JustEtc: <a href=\"https:\/\/www.facebook.com\/JustETC-Technologies-Inc-289864738261\">https:\/\/www.facebook.com\/JustETC-Technologies-Inc-289864738261<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Parameter optimization in neural networks https:\/\/www.deeplearning.ai\/ai-notes\/optimization\/ Coding Deep Learning for Beginners \u2014 Linear Regression (Part 2): Cost Function https:\/\/towardsdatascience.com\/coding-deep-learning-for-beginners-linear-regression-part-2-cost-function-49545303d29f CBMM Tutorial: Optimization Notes https:\/\/cbmm.mit.edu\/sites\/default\/files\/documents\/CBMM_Optimization_Notes_2017.html Gradient descent https:\/\/www.jeremyjordan.me\/gradient-descent\/ Hyper-parameter Tuning Techniques in Deep Learning https:\/\/towardsdatascience.com\/hyper-parameter-tuning-techniques-in-deep-learning-4dad592c63c8 Model Parameters and Hyperparameters in Machine Learning \u2014 What is the difference? https:\/\/towardsdatascience.com\/model-parameters-and-hyperparameters-in-machine-learning-what-is-the-difference-702d30970f6 Lecture 8: Optimization https:\/\/www.cs.toronto.edu\/~rgrosse\/courses\/csc321_2018\/slides\/lec08.pdf Optimization Techniques https:\/\/www.cs.cmu.edu\/afs\/cs\/academic\/class\/15782-f06\/slides\/optimization.pdf Parameter &hellip; <\/p>\n<p><a class=\"more-link btn\" href=\"http:\/\/bangla.sitestree.com\/?p=17362\">Continue reading<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[182],"tags":[],"class_list":["post-17362","post","type-post","status-publish","format-standard","hentry","category---blog","item-wrap"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":20250,"url":"http:\/\/bangla.sitestree.com\/?p=20250","url_meta":{"origin":17362,"position":0},"title":"On Machine Learning","author":"Sayed","date":"February 19, 2021","format":false,"excerpt":"FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance https:\/\/paperswithcode.com\/paper\/finrl-a-deep-reinforcement-learning-library OV2SLAM : A Fully Online and Versatile Visual SLAM for Real-Time Applications https:\/\/paperswithcode.com\/paper\/ov-2-slam-a-fully-online-and-versatile-visual Predicting with a Regression Equation https:\/\/opentextbc.ca\/introbusinessstatopenstax\/chapter\/predicting-with-a-regression-equation\/ Chapter 4. Regression and Prediction https:\/\/www.oreilly.com\/library\/view\/practical-statistics-for\/9781491952955\/ch04.html Loss and Loss Functions for Training Deep Learning Neural Networks https:\/\/machinelearningmastery.com\/loss-and-loss-functions-for-training-deep-learning-neural-networks\/\u2026","rel":"","context":"In &quot;\u09ac\u09cd\u09b2\u0997 \u0964 Blog&quot;","block_context":{"text":"\u09ac\u09cd\u09b2\u0997 \u0964 Blog","link":"http:\/\/bangla.sitestree.com\/?cat=182"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":26386,"url":"http:\/\/bangla.sitestree.com\/?p=26386","url_meta":{"origin":17362,"position":1},"title":"On Machine Learning #Root","author":"Author-Check- Article-or-Video","date":"April 23, 2021","format":false,"excerpt":"FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance https:\/\/paperswithcode.com\/paper\/finrl-a-deep-reinforcement-learning-library OV2SLAM : A Fully Online and Versatile Visual SLAM for Real-Time Applications https:\/\/paperswithcode.com\/paper\/ov-2-slam-a-fully-online-and-versatile-visual Predicting with a Regression Equation https:\/\/opentextbc.ca\/introbusinessstatopenstax\/chapter\/predicting-with-a-regression-equation\/ Chapter 4. Regression and Prediction https:\/\/www.oreilly.com\/library\/view\/practical-statistics-for\/9781491952955\/ch04.html Loss and Loss Functions for Training Deep Learning Neural Networks https:\/\/machinelearningmastery.com\/loss-and-loss-functions-for-training-deep-learning-neural-networks\/\u2026","rel":"","context":"In &quot;FromSitesTree.com&quot;","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":16619,"url":"http:\/\/bangla.sitestree.com\/?p=16619","url_meta":{"origin":17362,"position":2},"title":"Math\/Stat\/CS\/DS Topics that you need to know (with Cognitive, Psychomotor, Affective domain skills) to become a true and great Data Scientist","author":"Sayed","date":"January 7, 2020","format":false,"excerpt":"\"The core topics are cross-validation, shrinkage methods (ridge regression, the LASSO, etc.), neural networks, gradient boosting, separating hyperplanes, support vector machines, basis expansion and regularization (e.g., smoothing splines, wavelet smoothing, kernel smoothing), generalized additive models, bump hunting, multivariate adaptive regression splines (MARS), self-organizing maps, mixture model-based clustering, ensemble learning, and\u2026","rel":"","context":"In &quot;Math and Statistics for Data Science, and Engineering&quot;","block_context":{"text":"Math and Statistics for Data Science, and Engineering","link":"http:\/\/bangla.sitestree.com\/?cat=1908"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":16665,"url":"http:\/\/bangla.sitestree.com\/?p=16665","url_meta":{"origin":17362,"position":3},"title":"Bayesian Statistics and Machine Learning","author":"Sayed","date":"January 19, 2020","format":false,"excerpt":"Bayesian Statistics and Machine Learning \"Bayesian inference is a method of statistical inference in which Bayes' theorem is used to update the probability for a hypothesis as more evidence or information becomes available. Bayesian inference is an important technique in statistics, and especially in mathematical statistics.\" en.wikipedia.org \u203a wiki \u203a\u2026","rel":"","context":"In &quot;AI ML DS RL DL NN NLP Data Mining Optimization&quot;","block_context":{"text":"AI ML DS RL DL NN NLP Data Mining Optimization","link":"http:\/\/bangla.sitestree.com\/?cat=1910"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/bangla.sitestree.com\/wp-content\/uploads\/2020\/01\/image-1.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":16701,"url":"http:\/\/bangla.sitestree.com\/?p=16701","url_meta":{"origin":17362,"position":4},"title":"Misc. Math. Data Science. Machine Learning. Optimization. Vector, PCA, Basis, Covariance","author":"Sayed","date":"January 30, 2020","format":false,"excerpt":"Misc. Math. Data Science. Machine Learning. Optimization. Vector, PCA, Basis, Covariance Orthonormality: Orthonormal Vectors \"In linear algebra, two vectors in an inner product space are orthonormal if they are orthogonal and unit vectors. A set of vectors form an orthonormal set if all vectors in the set are mutually orthogonal\u2026","rel":"","context":"In &quot;AI ML DS RL DL NN NLP Data Mining Optimization&quot;","block_context":{"text":"AI ML DS RL DL NN NLP Data Mining Optimization","link":"http:\/\/bangla.sitestree.com\/?cat=1910"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/bangla.sitestree.com\/wp-content\/uploads\/2020\/01\/image-8-e1580436936625.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":14810,"url":"http:\/\/bangla.sitestree.com\/?p=14810","url_meta":{"origin":17362,"position":5},"title":"SQL Server (SSAS): Data Mining: Data Science: Data Analytics: Prediction: Neural Networks : Linear\/Logistics Regression","author":"Sayed","date":"June 15, 2019","format":false,"excerpt":"SQL Server Analysis Service: Data Mining Algorithms (Analysis Services - Data Mining) https:\/\/docs.microsoft.com\/en-us\/sql\/analysis-services\/data-mining\/data-mining-algorithms-analysis-services-data-mining?view=sql-server-2017 -- Microsoft Association Algorithm https:\/\/docs.microsoft.com\/en-us\/sql\/analysis-services\/data-mining\/microsoft-association-algorithm?view=sql-server-2017 -- Association Model Query Examples https:\/\/docs.microsoft.com\/en-us\/sql\/analysis-services\/data-mining\/association-model-query-examples?view=sql-server-2017 -- Microsoft Clustering Algorithm https:\/\/docs.microsoft.com\/en-us\/sql\/analysis-services\/data-mining\/microsoft-clustering-algorithm?view=sql-server-2017 Clustering Model Query Examples https:\/\/docs.microsoft.com\/en-us\/sql\/analysis-services\/data-mining\/clustering-model-query-examples?view=sql-server-2017 -- Microsoft Time Series Algorithm https:\/\/docs.microsoft.com\/en-us\/sql\/analysis-services\/data-mining\/microsoft-time-series-algorithm?view=sql-server-2017 --- Time Series Model Query Examples https:\/\/docs.microsoft.com\/en-us\/sql\/analysis-services\/data-mining\/time-series-model-query-examples?view=sql-server-2017 --- Microsoft Neural\u2026","rel":"","context":"In &quot;AI ML DS RL DL NN NLP Data Mining Optimization&quot;","block_context":{"text":"AI ML DS RL DL NN NLP Data Mining Optimization","link":"http:\/\/bangla.sitestree.com\/?cat=1910"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/17362","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=17362"}],"version-history":[{"count":0,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/17362\/revisions"}],"wp:attachment":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=17362"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=17362"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=17362"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}