{"id":16766,"date":"2020-02-07T12:14:09","date_gmt":"2020-02-07T17:14:09","guid":{"rendered":"https:\/\/bangla.salearningschool.com\/recent-posts\/part-1-bootstrapping-bagging-random-forests\/"},"modified":"2020-02-08T09:41:13","modified_gmt":"2020-02-08T14:41:13","slug":"part-1-bootstrapping-bagging-random-forests","status":"publish","type":"post","link":"http:\/\/bangla.sitestree.com\/?p=16766","title":{"rendered":"Part -1 : Bootstrapping, Bagging, Random Forests"},"content":{"rendered":"

What is a Classification Tree:<\/strong><\/p>\n

www.solver.com \u203a classification-tree<\/p>\n

<\/a><\/p>\n

Classification Tree | solver<\/a><\/h3>\n

<\/a><\/p>\n

A Classification tree<\/strong> labels, records, and assigns variables to discrete classes. A Classification tree<\/strong> can also provide a measure of confidence that the classification<\/strong> is correct. A Classification tree<\/strong> is built through a process known as binary recursive partitioning.<\/p>\n

Pros and Cons of Classification Trees<\/strong><\/p>\n

Advantages:<\/h1>\n
    \n
  1. Requires less effort for data preparation<\/li>\n
  2. normalization not required<\/li>\n
  3. scaling of data not required<\/li>\n
  4. Missing values in the data does not affect tree building that much<\/li>\n
  5. Easy to explain<\/li>\n<\/ol>\n

    Disadvantage:<\/h1>\n
      \n
    1. Small data change causes a large change in the decision tree<\/li>\n
    2. sometimes calculation can become far more complex<\/li>\n
    3. higher time to train the model<\/li>\n
    4. relatively expensive<\/li>\n<\/ol>\n

      https:\/\/medium.com\/@dhiraj8899\/top-5-advantages-and-disadvantages-of-decision-tree-algorithm-428ebd199d9a<\/a><\/p>\n

      What is Ensemble Learning?<\/strong><\/p>\n

      "In statistics and machine learning, ensemble methods use multiple learning algorithms to obtain better predictive performance than could be obtained from any of the constituent learning algorithms alone." Wikipedia<\/a><\/p>\n

      blog.statsbot.co \u203a ensemble-learning-d1dcd548e936<\/p>\n

      <\/a><\/p>\n

      Ensemble Learning to Improve Machine Learning Results<\/a><\/h3>\n

      <\/a><\/p>\n

      "Aug 22, 2017 – Ensemble methods<\/strong> are meta-algorithms that combine several machine learning techniques into one predictive model in order to decrease variance (bagging), bias (boosting), or improve predictions (stacking)."<\/p>\n

      What is Bootstraping?<\/strong><\/p>\n

      "In statistics, bootstrapping<\/strong> is any test or metric that relies on random sampling with replacement. Bootstrapping<\/strong> allows assigning measures of accuracy (defined in terms of bias, variance, confidence intervals, prediction error or some other such measure) to sample estimates."<\/p>\n

      en.wikipedia.org \u203a wiki \u203a Bootstrapping_(statistics)<\/p>\n

      <\/a><\/p>\n

      Bootstrapping (statistics) – Wikipedia<\/a><\/h3>\n

      <\/a><\/p>\n

      Bagging Steps<\/strong>:
      \n"Suppose there are N observations and M features in training data<\/strong> set. A sample from training data<\/strong> set is taken randomly with replacement. A subset of M features are selected randomly and whichever feature gives the best split is used to split the node iteratively. The tree is grown to the largest.Feb 19, 2018"<\/p>\n

      analyticsindiamag.com \u203a primer-ensemble-learning-bagging-boosting<\/p>\n

      <\/a><\/p>\n

      Bagging and Boosting – Analytics India Magazine<\/a><\/h3>\n

      <\/a><\/p>\n

      ***. ***. ***
      \nNote: Older short-notes from this site are posted on Medium: <\/strong><\/em>      https:\/\/medium.com\/@SayedAhmedCanada<\/a><\/p>\n

      *** . *** *** . *** . *** . ***
      \n<\/em>
      \nSayed Ahmed<\/strong>
      \n<\/em>
      \nBSc. Eng. in Comp. Sc. & Eng. (BUET)<\/strong><\/em>
      \nMSc. in Comp. Sc. (U of Manitoba, Canada)<\/strong><\/em>
      \nMSc. in Data Science and Analytics (Ryerson University, Canada)<\/strong><\/em>
      \nLinkedin<\/strong>:       https:\/\/ca.linkedin.com\/in\/sayedjustetc<\/a>
      \n<\/em><\/p>\n

      Blog<\/strong>: http:\/\/Bangla.SaLearningSchool.com<\/a>, http:\/\/SitesTree.com<\/a><\/em>
      \nOnline and Offline Training<\/strong>:       http:\/\/Training.SitesTree.com<\/a> (Also, can be free and low cost sometimes)<\/em><\/p>\n

      Facebook Group\/Form to discuss (Q & A): <\/em>https:\/\/www.facebook.com\/banglasalearningschool<\/a><\/p>\n

      Our free or paid training events: https:\/\/www.facebook.com\/justetcsocial<\/a><\/p>\n

      Get access to courses on Big Data, Data Science, AI, Cloud, Linux, System Admin, Web Development and Misc. related. Also, create your own course to sell to others. <\/em>http:\/\/sitestree.com\/training\/<\/a><\/p>\n

      I<\/strong>f you want to contribute to occasional free and\/or low cost online\/offline training or charitable\/non-profit work in the education\/health\/social service sector, you can financially contribute to: safoundation at salearningschool.com<\/a> using Paypal or Credit Card (on <\/em>http:\/\/sitestree.com\/training\/enrol\/index.php?id=114<\/a> ).<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

      What is a Classification Tree: www.solver.com \u203a classification-tree Classification Tree | solver A Classification tree labels, records, and assigns variables to discrete classes. A Classification tree can also provide a measure of confidence that the classification is correct. A Classification tree is built through a process known as binary recursive partitioning. Pros and Cons of … <\/p>\n

      Continue reading<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1910,182],"tags":[],"class_list":["post-16766","post","type-post","status-publish","format-standard","hentry","category-ai-ml-ds-rl-dl-nn-nlp-data-mining-optimization","category---blog","item-wrap"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":24955,"url":"http:\/\/bangla.sitestree.com\/?p=24955","url_meta":{"origin":16766,"position":0},"title":"Text Classification such as article category classification with Deep Learning\/Neural Network Approach #Root","author":"Author-Check- Article-or-Video","date":"April 14, 2021","format":false,"excerpt":"Text Classification such as article category classification with Deep Learning\/Neural Network Approach What deep learning method to use to classify text files? https:\/\/www.quora.com\/What-deep-learning-method-to-use-to-classify-text-files Classification Examples: https:\/\/faroit.com\/keras-docs\/0.3.3\/examples\/ Best Practices for Document Classification with Deep Learning https:\/\/machinelearningmastery.com\/best-practices-document-classification-deep-learning\/ LSTM with sentence representations for document-level sentiment classification https:\/\/www.sciencedirect.com\/science\/article\/pii\/S092523121830479X A C-LSTM Neural Network for Text\u2026","rel":"","context":"In "FromSitesTree.com"","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":24957,"url":"http:\/\/bangla.sitestree.com\/?p=24957","url_meta":{"origin":16766,"position":1},"title":"On Text Classification based on Deep Learning\/Neural Networks #Root","author":"Author-Check- Article-or-Video","date":"April 14, 2021","format":false,"excerpt":"On Text Classification based on Deep Learning\/Neural Networks Text Classification Using LSTM and visualize Word Embeddings: Part-1 https:\/\/medium.com\/@sabber\/classifying-yelp-review-comments-using-lstm-and-word-embeddings-part-1-eb2275e4066b Different approaches of Text Classification https:\/\/www.kdnuggets.com\/2018\/07\/text-classification-lstm-cnn-pre-trained-word-vectors.html How to do text classification with CNNs, TensorFlow and word embedding https:\/\/towardsdatascience.com\/how-to-do-text-classification-using-tensorflow-word-embeddings-and-cnn-edae13b3e575 Classification of Customer Complaints using Tensorflow: Text Classification with Word Embeddings https:\/\/medium.com\/@opalkabert\/classification-of-customer-complaints-using-tensorflow-text-classification-with-word-embeddings-e87952b5147c An analysis\u2026","rel":"","context":"In "FromSitesTree.com"","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":24953,"url":"http:\/\/bangla.sitestree.com\/?p=24953","url_meta":{"origin":16766,"position":2},"title":"Sequence Classification using Deep Learning #Root","author":"Author-Check- Article-or-Video","date":"April 14, 2021","format":false,"excerpt":"\"Sequence classification has a broad range of applications such as genomic analysis, information retrieval, health informatics, finance, and abnormal detection....\" Ref: Theory: https:\/\/www.cs.sfu.ca\/~jpei\/publications\/Sequence%20Classification.pdf Sequence Classification in Keras\/Python, LSTM, GRU, BIDirectional LSTM https:\/\/machinelearningmastery.com\/develop-bidirectional-lstm-sequence-classification-python-keras\/ Sequence Classification Using Deep Learning \"This example uses the Japanese Vowels data set as described in [1] and\u2026","rel":"","context":"In "FromSitesTree.com"","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":14735,"url":"http:\/\/bangla.sitestree.com\/?p=14735","url_meta":{"origin":16766,"position":3},"title":"Sequence Classification using Deep Learning","author":"Sayed","date":"April 21, 2019","format":false,"excerpt":"\"Sequence classification has a broad range of applications such as genomic analysis, information retrieval, health informatics, finance, and abnormal detection....\" Ref: Theory: https:\/\/www.cs.sfu.ca\/~jpei\/publications\/Sequence%20Classification.pdf Sequence Classification in Keras\/Python, LSTM, GRU, BIDirectional LSTM https:\/\/machinelearningmastery.com\/develop-bidirectional-lstm-sequence-classification-python-keras\/ Sequence Classification Using Deep Learning \"This example uses the Japanese Vowels data set as described in [1] and\u2026","rel":"","context":"In "\u09ac\u09cd\u09b2\u0997 \u0964 Blog"","block_context":{"text":"\u09ac\u09cd\u09b2\u0997 \u0964 Blog","link":"http:\/\/bangla.sitestree.com\/?cat=182"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":14736,"url":"http:\/\/bangla.sitestree.com\/?p=14736","url_meta":{"origin":16766,"position":4},"title":"Text Classification such as article category classification with Deep Learning\/Neural Network Approach","author":"Sayed","date":"April 21, 2019","format":false,"excerpt":"Text Classification such as article category classification with Deep Learning\/Neural Network Approach What deep learning method to use to classify text files? https:\/\/www.quora.com\/What-deep-learning-method-to-use-to-classify-text-files Classification Examples: https:\/\/faroit.com\/keras-docs\/0.3.3\/examples\/ Best Practices for Document Classification with Deep Learning https:\/\/machinelearningmastery.com\/best-practices-document-classification-deep-learning\/ LSTM with sentence representations for document-level sentiment classification https:\/\/www.sciencedirect.com\/science\/article\/pii\/S092523121830479X A C-LSTM Neural Network for Text\u2026","rel":"","context":"In "\u09ac\u09cd\u09b2\u0997 \u0964 Blog"","block_context":{"text":"\u09ac\u09cd\u09b2\u0997 \u0964 Blog","link":"http:\/\/bangla.sitestree.com\/?cat=182"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":14739,"url":"http:\/\/bangla.sitestree.com\/?p=14739","url_meta":{"origin":16766,"position":5},"title":"On Text Classification based on Deep Learning\/Neural Networks","author":"Sayed","date":"April 22, 2019","format":false,"excerpt":"On Text Classification based on Deep Learning\/Neural Networks Text Classification Using LSTM and visualize Word Embeddings: Part-1 https:\/\/medium.com\/@sabber\/classifying-yelp-review-comments-using-lstm-and-word-embeddings-part-1-eb2275e4066b Different approaches of Text Classification https:\/\/www.kdnuggets.com\/2018\/07\/text-classification-lstm-cnn-pre-trained-word-vectors.html How to do text classification with CNNs, TensorFlow and word embedding https:\/\/towardsdatascience.com\/how-to-do-text-classification-using-tensorflow-word-embeddings-and-cnn-edae13b3e575 Classification of Customer Complaints using Tensorflow: Text Classification with Word Embeddings https:\/\/medium.com\/@opalkabert\/classification-of-customer-complaints-using-tensorflow-text-classification-with-word-embeddings-e87952b5147c An analysis\u2026","rel":"","context":"In "\u09ac\u09cd\u09b2\u0997 \u0964 Blog"","block_context":{"text":"\u09ac\u09cd\u09b2\u0997 \u0964 Blog","link":"http:\/\/bangla.sitestree.com\/?cat=182"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/16766","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=16766"}],"version-history":[{"count":1,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/16766\/revisions"}],"predecessor-version":[{"id":16792,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/16766\/revisions\/16792"}],"wp:attachment":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=16766"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=16766"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=16766"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}