{"id":68333,"date":"2021-08-01T04:10:05","date_gmt":"2021-08-01T08:10:05","guid":{"rendered":"http:\/\/bangla.salearningschool.com\/recent-posts\/big-data-and-aws-big-data\/"},"modified":"2021-08-01T04:10:05","modified_gmt":"2021-08-01T08:10:05","slug":"big-data-and-aws-big-data","status":"publish","type":"post","link":"http:\/\/bangla.sitestree.com\/?p=68333","title":{"rendered":"Big Data and AWS #Big Data"},"content":{"rendered":"<p>AWS Concepts and Tools for Big Data Implementation<\/p>\n<p><strong>Amazon Kinesis<\/strong><br \/>\nBig Data Streaming and Amazon Kinesis<br \/>\nExample: Using Amazon Kinesis to Stream and Analyze Apache Server Log Data<\/p>\n<p><strong>Amazon Athena<\/strong><br \/>\nBig Data Processing and Analytics<br \/>\nExample: Using Amazon Athena to Query Log Data From Amazon S3<\/p>\n<p><strong>DynamoDB<\/strong><br \/>\nNo SQL DBMS: Storing and Querying Data on Amazon DynamoDB<\/p>\n<p><strong>Amazon EMR:<\/strong><br \/>\nApache Hadoop and Amazon EMR<br \/>\nUsing Amazon EMR<br \/>\nHadoop Programming Frameworks<br \/>\nExample: Processing Server Logs With Hive on Amazon EMR<\/p>\n<p>Web Interfaces on Amazon EMR<br \/>\nExample: Running Pig Scripts in Hue on Amazon EMR<\/p>\n<p>Apache Spark on Amazon EMR<br \/>\nExample: Processing NY Taxi data using Spark on Amazon EMR<\/p>\n<p><strong>Amazon Redshift<\/strong><br \/>\nAmazon Redshift and Big Data<br \/>\nVisualizing and Orchestrating Big Data<br \/>\nExample: Using TIBCO Spotfire to Visualize Data<\/p>\n<p><strong>Storage<\/strong><br \/>\nMapReduce and HDFS\/S3 From: http:\/\/sitestree.com\/?p=10682<br \/> Categories:Big Data<br \/>Tags:<br \/> Post Data:2017-07-01 07:04:26<\/p>\n<p>\t\tShop Online: <a href='https:\/\/www.ShopForSoul.com\/' target='new' rel=\"noopener\">https:\/\/www.ShopForSoul.com\/<\/a><br \/>\n\t\t(Big Data, Cloud, Security, Machine Learning): Courses: <a href='http:\/\/Training.SitesTree.com' target='new' rel=\"noopener\"> http:\/\/Training.SitesTree.com<\/a><br \/>\n\t\tIn Bengali: <a href='http:\/\/Bangla.SaLearningSchool.com' target='new' rel=\"noopener\">http:\/\/Bangla.SaLearningSchool.com<\/a><br \/>\n\t\t<a href='http:\/\/SitesTree.com' target='new' rel=\"noopener\">http:\/\/SitesTree.com<\/a><br \/>\n\t\t8112223 Canada Inc.\/JustEtc: <a href='http:\/\/JustEtc.net' target='new' rel=\"noopener\">http:\/\/JustEtc.net (Software\/Web\/Mobile\/Big-Data\/Machine Learning) <\/a><br \/>\n\t\tShop Online: <a href='https:\/\/www.ShopForSoul.com'> https:\/\/www.ShopForSoul.com\/<\/a><br \/>\n\t\tMedium: <a href='https:\/\/medium.com\/@SayedAhmedCanada' target='new' rel=\"noopener\"> https:\/\/medium.com\/@SayedAhmedCanada <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>AWS Concepts and Tools for Big Data Implementation Amazon Kinesis Big Data Streaming and Amazon Kinesis Example: Using Amazon Kinesis to Stream and Analyze Apache Server Log Data Amazon Athena Big Data Processing and Analytics Example: Using Amazon Athena to Query Log Data From Amazon S3 DynamoDB No SQL DBMS: Storing and Querying Data on &hellip; <\/p>\n<p><a class=\"more-link btn\" href=\"http:\/\/bangla.sitestree.com\/?p=68333\">Continue reading<\/a><\/p>\n","protected":false},"author":8,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1917],"tags":[],"class_list":["post-68333","post","type-post","status-publish","format-standard","hentry","category-fromsitestree-com","item-wrap"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":14606,"url":"http:\/\/bangla.sitestree.com\/?p=14606","url_meta":{"origin":68333,"position":0},"title":"Recent Announcements from AWS","author":"Sayed","date":"January 22, 2019","format":false,"excerpt":"A Weekly Review from AWS Newsletter A Weekly Review of the Latest Announcements from AWS What's New with AWS Amazon EBS Integrates with AWS Backup to Protect Your Volumes Introducing Amazon Elastic File System Integration with AWS Backup AWS Storage Gateway Integrates with AWS Backup to Protect Volumes Managed through\u2026","rel":"","context":"In &quot;Jobs in Canada and USA&quot;","block_context":{"text":"Jobs in Canada and USA","link":"http:\/\/bangla.sitestree.com\/?cat=1953"},"img":{"alt_text":"Storage","src":"https:\/\/i0.wp.com\/pages.awscloud.com\/rs\/112-TZM-766\/images\/60-file-box-orange-os.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":68152,"url":"http:\/\/bangla.sitestree.com\/?p=68152","url_meta":{"origin":68333,"position":1},"title":"On Amazon Web Services (AWS) #By Sayed Ahmed #Amazon Web Services","author":"Author-Check- Article-or-Video","date":"July 30, 2021","format":false,"excerpt":"Amazon EC2: Amazon Elastic Compute Cloud (Amazon EC2) provides scalable computing capacity in the Amazon Web Services (AWS) cloud. Using Amazon EC2 eliminates your need to invest in hardware up front, so you can develop and deploy applications faster. https:\/\/docs.aws.amazon.com\/AWSEC2\/latest\/UserGuide\/EC2_GetStarted.html?icmpid=docs_ec2_console Amazon EC2, ECS: EC2 Container Service Amazon ECS makes it\u2026","rel":"","context":"In &quot;FromSitesTree.com&quot;","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":14401,"url":"http:\/\/bangla.sitestree.com\/?p=14401","url_meta":{"origin":68333,"position":2},"title":"Recent Announcements from AWS","author":"Sayed","date":"July 31, 2018","format":false,"excerpt":"Browse below to learn about the latest product, service, and feature announcements from AWS. AWS Release Notes A Weekly Review of the Latest Announcements from AWS Introducing Amazon EC2 R5 Instances, the next generation of memory-optimized instances Introducing Amazon EC2 z1d Instances with a sustained all core frequency of up\u2026","rel":"","context":"In &quot;\u09aa\u09cd\u09b0\u0995\u09b2\u09cd\u09aa \u09a8\u09bf\u09df\u09a8\u09cd\u09a4\u09cd\u09b0\u09a3 \u0964 Project Management (PMP) Basics&quot;","block_context":{"text":"\u09aa\u09cd\u09b0\u0995\u09b2\u09cd\u09aa \u09a8\u09bf\u09df\u09a8\u09cd\u09a4\u09cd\u09b0\u09a3 \u0964 Project Management (PMP) Basics","link":"http:\/\/bangla.sitestree.com\/?cat=187"},"img":{"alt_text":"Compute","src":"https:\/\/i0.wp.com\/s3.amazonaws.com\/aws-email-assets\/Product%2BCategory%2BIcons%2B250x250\/Product_Icons_Grey_Compute.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":24598,"url":"http:\/\/bangla.sitestree.com\/?p=24598","url_meta":{"origin":68333,"position":3},"title":"Tech Talk Follow Up: Best Practices for Security in Amazon S3 #Root","author":"Author-Check- Article-or-Video","date":"April 12, 2021","format":false,"excerpt":"The on-demand content is now available. Webinar: Best Practices for Security in Amazon S3 Recording Presentation slides From: http:\/\/sitestree.com\/tech-talk-follow-up-best-practices-for-security-in-amazon-s3\/ Categories:RootTags: Post Data:2018-07-30 20:13:59 Shop Online: https:\/\/www.ShopForSoul.com\/ (Big Data, Cloud, Security, Machine Learning): Courses: http:\/\/Training.SitesTree.com In Bengali: http:\/\/Bangla.SaLearningSchool.com http:\/\/SitesTree.com 8112223 Canada Inc.\/JustEtc: http:\/\/JustEtc.net (Software\/Web\/Mobile\/Big-Data\/Machine Learning) Shop Online: https:\/\/www.ShopForSoul.com\/ Medium: https:\/\/medium.com\/@SayedAhmedCanada","rel":"","context":"In &quot;FromSitesTree.com&quot;","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"Amazon Web Services","src":"https:\/\/i0.wp.com\/pages.awscloud.com\/rs\/112-TZM-766\/images\/AWS_logo_RGB_2017_100x60.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":20653,"url":"http:\/\/bangla.sitestree.com\/?p=20653","url_meta":{"origin":68333,"position":4},"title":"Hadoop Random Notes","author":"Author-Check- Article-or-Video","date":"February 25, 2021","format":false,"excerpt":"Some Random Notes on Hadoop... Why Hadoop? ...randomly came across again....so, Just some random stuff. I may try to relate my exposure to it (or something), even that remotely relates to Hadoop What is Hadoop? Apache Hadoop is an open-source software framework for storage and large scale processing of data-sets\u2026","rel":"","context":"In &quot;FromSitesTree.com&quot;","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":68329,"url":"http:\/\/bangla.sitestree.com\/?p=68329","url_meta":{"origin":68333,"position":5},"title":"Some Big Data Terms #Big Data","author":"Author-Check- Article-or-Video","date":"August 1, 2021","format":false,"excerpt":"MapReduce \" MapReduce is a programming model and an associated implementation for processing and generating big data sets with a parallel, distributed algorithm on a cluster.[1][2] A MapReduce program is composed of a Map() procedure (method) that performs filtering and sorting (such as sorting students by first name into queues,\u2026","rel":"","context":"In &quot;FromSitesTree.com&quot;","block_context":{"text":"FromSitesTree.com","link":"http:\/\/bangla.sitestree.com\/?cat=1917"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/68333","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=68333"}],"version-history":[{"count":0,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/68333\/revisions"}],"wp:attachment":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=68333"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=68333"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=68333"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}