{"id":22533,"date":"2021-03-15T01:01:31","date_gmt":"2021-03-15T05:01:31","guid":{"rendered":"http:\/\/bangla.salearningschool.com\/recent-posts\/big-data-solutions-root-by-sayed-ahmed-misc-hadoop-stuff-data-warehouse-misc-big-data\/"},"modified":"2021-03-15T01:01:31","modified_gmt":"2021-03-15T05:01:31","slug":"big-data-solutions-root-by-sayed-ahmed-misc-hadoop-stuff-data-warehouse-misc-big-data","status":"publish","type":"post","link":"http:\/\/bangla.sitestree.com\/?p=22533","title":{"rendered":"Big Data Solutions #Root #By Sayed Ahmed #Misc Hadoop Stuff #Data Warehouse Misc #Big Data"},"content":{"rendered":"<p><strong>Traditional Approach of Data Analysis:<\/strong><\/p>\n<p>Data is stored in RDBMS in one or couple of computers. And software are written for analysis. However, if the data is too big this approach is not sufficient. Also, all data may not fit\/well-suited for RDBMS.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Google&#8217;s Approach:<\/strong><\/p>\n<p>Google invented MAP Reduce to address big data challenge. Tasks and data are divided, and assigned to many computers, and then the results are combined to get the final result. This is a simplified description.<\/p>\n<p>&nbsp;<\/p>\n<p><img data-recalc-dims=\"1\" loading=\"lazy\" decoding=\"async\" class=\"\" src=\"https:\/\/i0.wp.com\/xiaochongzhang.me\/blog\/wp-content\/uploads\/2013\/05\/MapReduce_Work_Structure.png?resize=646%2C300\" alt=\"\" width=\"646\" height=\"300\" \/><\/p>\n<p>&nbsp;<\/p>\n<h2>Hadoop<\/h2>\n<p>Is an open source project by Apache. It utilizes the Map Reduce algorithm. You can use Hadoop framework to develop applications that can run in clusters of computers and can do data statistical analysis on a big set of data.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp; From: http:\/\/sitestree.com\/?p=1986<br \/> Categories:Root, By Sayed Ahmed, Misc Hadoop Stuff, Data Warehouse Misc, Big Data<br \/>Tags:<br \/> Post Data:2015-04-03 21:29:29<\/p>\n<p>\t\tShop Online: <a href='https:\/\/www.ShopForSoul.com\/' target='new' rel=\"noopener\">https:\/\/www.ShopForSoul.com\/<\/a><br \/>\n\t\t(Big Data, Cloud, Security, Machine Learning): Courses: <a href='http:\/\/Training.SitesTree.com' target='new' rel=\"noopener\"> http:\/\/Training.SitesTree.com<\/a><br \/>\n\t\tIn Bengali: <a href='http:\/\/Bangla.SaLearningSchool.com' target='new' rel=\"noopener\">http:\/\/Bangla.SaLearningSchool.com<\/a><br \/>\n\t\t<a href='http:\/\/SitesTree.com' target='new' rel=\"noopener\">http:\/\/SitesTree.com<\/a><br \/>\n\t\t8112223 Canada Inc.\/JustEtc: <a href='http:\/\/JustEtc.net' target='new' rel=\"noopener\">http:\/\/JustEtc.net (Software\/Web\/Mobile\/Big-Data\/Machine Learning) <\/a><br \/>\n\t\tShop Online: <a href='https:\/\/www.ShopForSoul.com'> https:\/\/www.ShopForSoul.com\/<\/a><br \/>\n\t\tMedium: <a href='https:\/\/medium.com\/@SayedAhmedCanada' target='new' rel=\"noopener\"> https:\/\/medium.com\/@SayedAhmedCanada <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Traditional Approach of Data Analysis: Data is stored in RDBMS in one or couple of computers. And software are written for analysis. However, if the data is too big this approach is not sufficient. Also, all data may not fit\/well-suited for RDBMS. &nbsp; Google&#8217;s Approach: Google invented MAP Reduce to address big data challenge. Tasks &hellip; <\/p>\n<p><a class=\"more-link btn\" href=\"http:\/\/bangla.sitestree.com\/?p=22533\">Continue reading<\/a><\/p>\n","protected":false},"author":8,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1917],"tags":[],"class_list":["post-22533","post","type-post","status-publish","format-standard","hentry","category-fromsitestree-com","item-wrap"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":20653,"url":"http:\/\/bangla.sitestree.com\/?p=20653","url_meta":{"origin":22533,"position":0},"title":"Hadoop Random Notes","author":"Author-Check- Article-or-Video","date":"February 25, 2021","format":false,"excerpt":"Some Random Notes on Hadoop... Why Hadoop? ...randomly came across again....so, Just some random stuff. I may try to relate my exposure to it (or something), even that remotely relates to Hadoop What is Hadoop? Apache Hadoop is an open-source software framework for storage and large scale processing of data-sets\u2026","rel":"","context":"In &quot;FromSitesTree.com&quot;","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":68329,"url":"http:\/\/bangla.sitestree.com\/?p=68329","url_meta":{"origin":22533,"position":1},"title":"Some Big Data Terms #Big Data","author":"Author-Check- Article-or-Video","date":"August 1, 2021","format":false,"excerpt":"MapReduce \" MapReduce is a programming model and an associated implementation for processing and generating big data sets with a parallel, distributed algorithm on a cluster.[1][2] A MapReduce program is composed of a Map() procedure (method) that performs filtering and sorting (such as sorting students by first name into queues,\u2026","rel":"","context":"In &quot;FromSitesTree.com&quot;","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":74235,"url":"http:\/\/bangla.sitestree.com\/?p=74235","url_meta":{"origin":22533,"position":2},"title":"Demo: Hadoop Job Execution. Big Data and Hadoop Concepts","author":"Sayed","date":"April 23, 2022","format":false,"excerpt":"https:\/\/youtu.be\/y3It9aoaoT8","rel":"","context":"In &quot;From Youtube Channel&quot;","block_context":{"text":"From Youtube Channel","link":"http:\/\/bangla.sitestree.com\/?cat=1952"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/img.youtube.com\/vi\/y3It9aoaoT8\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":20739,"url":"http:\/\/bangla.sitestree.com\/?p=20739","url_meta":{"origin":22533,"position":3},"title":"Hadoop, NoSQL, PHP","author":"Author-Check- Article-or-Video","date":"February 27, 2021","format":false,"excerpt":"MongoDB (from \"humongous\") is an open-source document database, and the leading NoSQL database. Written in C++. http:\/\/www.mongodb.org\/ If you are in USA, Hadoop\/NoSQL can pay you a lot... http:\/\/www.indeed.com\/salary\/q-Hadoop-l-San-Jose,-CA.html PHP Programming in the area: http:\/\/developer.marklogic.com\/labs\/mlphp Apache Hadoop http:\/\/en.wikipedia.org\/wiki\/Apache_Hadoop Facebook and Hadoop http:\/\/gigaom.com\/2013\/11\/06\/facebook-open-sources-its-sql-on-hadoop-engine-and-the-web-rejoices\/ From: http:\/\/sitestree.com\/?p=519 Categories:Web Development, Root, By Sayed AhmedTags:\u2026","rel":"","context":"In &quot;FromSitesTree.com&quot;","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":22577,"url":"http:\/\/bangla.sitestree.com\/?p=22577","url_meta":{"origin":22533,"position":4},"title":"Some Data Analysis Tools #Root #By Sayed Ahmed #Data Warehouse Misc #Big Data","author":"Author-Check- Article-or-Video","date":"March 16, 2021","format":false,"excerpt":"Just some Links: Data Collection and Analysis Tools http:\/\/asq.org\/learn-about-quality\/data-collection-analysis-tools\/overview\/overview.html \u00a0 Big Data Analytics: Time For New Tools http:\/\/www.informationweek.com\/big-data\/big-data-analytics\/big-data-analytics-time-for-new-tools\/a\/d-id\/1318106 \u00a0 Data analysis tools target non-experts Tools simplify the application of advanced analytics and the interpretation of results http:\/\/radar.oreilly.com\/2013\/08\/data-analysis-tools-target-non-experts.html \u00a0 Guide to big data analytics tools, trends and best practices http:\/\/searchbusinessanalytics.techtarget.com\/essentialguide\/Guide-to-big-data-analytics-tools-trends-and-best-practices \u00a0\u2026","rel":"","context":"In &quot;FromSitesTree.com&quot;","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":71524,"url":"http:\/\/bangla.sitestree.com\/?p=71524","url_meta":{"origin":22533,"position":5},"title":"Big Data Conferences","author":"Sayed","date":"October 23, 2021","format":false,"excerpt":"Oreilly Strata\/Hadoop World \u2022 Hadoop Summit \u2022 Cassandra Summit \u2022 H2O World \u2022 Solr Revolution \u2022 GraphLab Conference \u2022 Qcon \u2022 MLconf \u2022 PAW \u2013 Predictive Analytics World \u2022 SAS Conference","rel":"","context":"In &quot;\u09ac\u09cd\u09b2\u0997 \u0964 Blog&quot;","block_context":{"text":"\u09ac\u09cd\u09b2\u0997 \u0964 Blog","link":"http:\/\/bangla.sitestree.com\/?cat=182"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/22533","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=22533"}],"version-history":[{"count":0,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/22533\/revisions"}],"wp:attachment":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=22533"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=22533"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=22533"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}