{"id":22879,"date":"2021-03-21T21:49:28","date_gmt":"2021-03-22T01:49:28","guid":{"rendered":"http:\/\/bangla.salearningschool.com\/recent-posts\/?p=22879"},"modified":"2021-03-21T21:49:31","modified_gmt":"2021-03-22T01:49:31","slug":"graph-mining-hits-pagerank-hubs-anchors-and-graph-theories","status":"publish","type":"post","link":"http:\/\/bangla.sitestree.com\/?p=22879","title":{"rendered":"Graph Mining: HITS Pagerank HUBS Anchors and Graph Theories"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Resources to Learn From<\/h2>\n\n\n\n<p>Resources:<br \/><br \/>HITS Algorithm<br \/>https:\/\/en.wikipedia.org\/wiki\/HITS_algorithm<br \/><br \/>http:\/\/pi.math.cornell.edu\/~mec\/Winter2009\/RalucaRemus\/Lecture4\/lecture4.html<br \/>Last modified: Thursday, 24 October 2019, 9:32 PM<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Read the resources above and Learn by finding Answers to the Following Questions. Can you answer the following questions?<\/h2>\n\n\n\n<p>Graph Mining: Hits. Learn by finding Answers to the Following Questions.<\/p>\n\n\n\n<p>What is HITS algorithm in Graph Mining esp. for Web?<\/p>\n\n\n\n<p>What does HITS stand for?<\/p>\n\n\n\n<p>What is another similar Algorithm?<\/p>\n\n\n\n<p>What are different between the PageRank algorithm and HITS?<\/p>\n\n\n\n<p>What is the PageRank algorithm? What is the purpose?<\/p>\n\n\n\n<p>Where and how PageRank is used?<\/p>\n\n\n\n<p>Where and how HITS is used?<\/p>\n\n\n\n<p>Describe HITS?<\/p>\n\n\n\n<p>Describe the PageRank algorithm.<\/p>\n\n\n\n<p>What are the two core concepts in HITS algorithm?<\/p>\n\n\n\n<p>Web-pages that serves as large directories of other pages with useful information &#8211; what are they called in HITS algorithm?<\/p>\n\n\n\n<p>Web-pages that serves to provide information on Specific topics &#8211; what are they called in the HITS algorithm?<\/p>\n\n\n\n<p>What are HUBs in HITS algorithm? What purpose do they serve?<\/p>\n\n\n\n<p>What are Authorities in HITS algorithm? What purpose do they serve?<\/p>\n\n\n\n<p>Compare HITS and PageRank.<\/p>\n\n\n\n<p>A web-page containing links to Top 1000 Universities in the world &#8211; is this a HUB or Authority in HITS?<\/p>\n\n\n\n<p>What is the Govt. of Canada website that provides information on all Govt. Services? Is this a Hub or an Authority?<\/p>\n\n\n\n<p>How do you measure a Good Hub?<\/p>\n\n\n\n<p>How do you measure a Good Authority?<\/p>\n\n\n\n<p>Can a web-page be both Hub and Authority? Can you assign both measures to a page irrespective of how good or bad?<\/p>\n\n\n\n<p>What are the two scores that HITS assign to a web-page?<\/p>\n\n\n\n<p>What is authority score for a web-page?<\/p>\n\n\n\n<p>What is the hub score for a web-page?<\/p>\n\n\n\n<p>What does hub score measure?<\/p>\n\n\n\n<p>What does authority score measure?<\/p>\n\n\n\n<p>What are the three matrices that are used for HITS algorithm? i.e. when you want to implement HITS algorithm.<\/p>\n\n\n\n<p>What is a Transition Matrix in HITS?<\/p>\n\n\n\n<p>What is a HUB vector? What does it contain initially?<\/p>\n\n\n\n<p>What is an Authority vector? What does it contain initially?<\/p>\n\n\n\n<p>For the graph below, provide the Initial Transition, Hub, Authority Vector\/Matrices.<\/p>\n\n\n\n<p>Directed Graph {Source, Destination}<br \/>Node: Yahoo, Amazon, Microsoft<br \/>Edges: {Yahoo, Yahoo} {Yahoo, Amazon} {Yahoo, Microsoft} {Amazon, Yahoo} {Amazon, Microsoft} {Microsoft, Amazon}<\/p>\n\n\n\n<p>For the same graph above, explain your transition matrix?<\/p>\n\n\n\n<p>If Transition Matrix is A, Hub Vector = h0, Authority Vector = a0.<br \/>How is Hub Score for a page is updated?, How is Authority Score for a page is updated? How long does this update happen?<\/p>\n\n\n\n<p>The algorithm\/steps as mentioned above: will the update converge to a state where Hub and Authority values will no longer change? Why, why not? if convergence does not happen what to do?<\/p>\n\n\n\n<p>What is HITS normalization? i.e. after each iteration. Why it might be important.<\/p>\n\n\n\n<p>Give steps\/equations used for HITS normalization.<\/p>\n\n\n\n<p>What are the two ways, you can make the HITS algorithm stop? i.e. stopping points.<\/p>\n\n\n\n<p>True or False, Destiny of PageRank and HITS were different. What does it mean?<\/p>\n\n\n\n<p>Can you stop the HITS algorithm after a certain number of iterations?<\/p>\n\n\n\n<p>In real life, are HITS and PageRank used\/applied for the whole graph i.e. whole Internet for example? Or majority of the times, they are applied on contextual graphs?<\/p>\n\n\n\n<p>What are contextual graphs, anyway?<\/p>\n\n\n\n<p>Give example use cases for HITS and PageRank?<\/p>\n\n\n\n<p>Can you think of the value aspect of these algorithms? i.e. how they affect people, communities, societies?<\/p>\n\n\n\n<p>What are the programming languages where you will find libraries that implement the HITS and PageRank algorithm? Give the name of the libraries.<\/p>\n\n\n\n<p>Implement the algorithms from scratch in Python or in R without using the libraries. What did you use to debug your implementation and how?<br \/>What are the challenges that you faced to implement, how did you resolve? How did you represent the Graphs (i.e. on the graph you applied for testing).<\/p>\n\n\n\n<p><strong>Some Answers:<\/strong><br \/>For the graph below, provide the Initial Transition, Hub, Authority Vector\/Matrices.<\/p>\n\n\n\n<p>Ans: Transition Matrix<\/p>\n\n\n\n<p>A =[<\/p>\n\n\n\n<p>1 &nbsp;1 &nbsp;1<br \/>1 &nbsp;0 &nbsp;1<br \/>0 &nbsp;1 &nbsp;0<\/p>\n\n\n\n<p>]<\/p>\n\n\n\n<p>Initial Hub Vector = h0<br \/>[<br \/>Yahoo<br \/>Amazon<br \/>Microsoft<br \/>]<br \/>=[<br \/>1<br \/>1<br \/>1]<\/p>\n\n\n\n<p>Authority Vector: a0<br \/>[<br \/>Yahoo<br \/>Amazon<br \/>Microsoft<br \/>]<\/p>\n\n\n\n<p>=<br \/>[<br \/>1<br \/>1<br \/>1<br \/>]<\/p>\n\n\n\n<p>For the same graph above, explain your transition matrix?<\/p>\n\n\n\n<p>First Row: Yahoo<br \/>2nd Row: Amazon<br \/>3rd Row: Microsoft<\/p>\n\n\n\n<p>Columns: Yahoo &#8212;- Amazon &#8212; Microsoft<\/p>\n\n\n\n<p>Transition Matrix<\/p>\n\n\n\n<p>[Yahoo-&gt; Yahoo, Yahoo-&gt; Amazon, Yahoo-&gt; Microsoft]<br \/>[Amazon-&gt;Yahoo, Amazon-&gt;Amazon, Amazon-&gt;Microsoft]<br \/>[Microsoft-&gt;yahoo, Microsoft-&gt;Amazon, Microsoft-&gt;microsoft]<\/p>\n\n\n\n<p>using: 1 if page i links to page j, otherwise 0<br \/>[1, &nbsp;1, 1 ]<br \/>[1, &nbsp;0, 1]<br \/>[0, &nbsp;1, 0]<\/p>\n\n\n\n<p>If Transition Matrix is A, Hub Vector = h0, Authority Vector = a0.<br \/>How is Hub Score for a page is updated?, How is Authority Score for a page is updated?<br \/>A * a0 = h1 : Hub Score Update: based on authority score of outgoing links<br \/>transition(A) h1 = a1 : Authority Score Update : based on hub score of incoming links<br \/>Last modified: Wednesday, 30 October 2019, 5:40 PM<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><em><strong>Shop <\/strong><\/em> <em><strong>Online:&nbsp;<\/strong><\/em><a href=\"http:\/\/www.shopforsoul.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.ShopForSoul.com\/<\/a><\/p>\n\n\n\n<p><em><strong>8112223 Canada Inc.\/JustEtc<\/strong>: <a href=\"http:\/\/justetc.net\/\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/JustEtc.net<\/a><\/em><\/p>\n\n\n\n<p><em><strong>Linkedin<\/strong>: <a href=\"https:\/\/ca.linkedin.com\/in\/sayedjustetc\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/ca.linkedin.com\/in\/sayedjustetc<\/a><\/em><\/p>\n\n\n\n<p><em><strong><em><strong>Courses:&nbsp;<\/strong><a href=\"http:\/\/training.sitestree.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/Training.SitesTree.com<\/a>&nbsp;(Big Data, Cloud, Security, Machine Learning)<\/em><\/strong><\/em><\/p>\n\n\n\n<p><em><strong>Blog<\/strong>:&nbsp;<a href=\"http:\/\/bangla.salearningschool.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/Bangla.SaLearningSchool.com<\/a>,&nbsp;<a href=\"http:\/\/sitestree.com\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/SitesTree.com<\/a><\/em><\/p>\n\n\n\n<p><strong>Medium<\/strong>:&nbsp;<a href=\"https:\/\/medium.com\/@SayedAhmedCanada\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/medium.com\/@SayedAhmedCanada<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Resources to Learn From Resources: HITS Algorithmhttps:\/\/en.wikipedia.org\/wiki\/HITS_algorithm http:\/\/pi.math.cornell.edu\/~mec\/Winter2009\/RalucaRemus\/Lecture4\/lecture4.htmlLast modified: Thursday, 24 October 2019, 9:32 PM Read the resources above and Learn by finding Answers to the Following Questions. Can you answer the following questions? Graph Mining: Hits. Learn by finding Answers to the Following Questions. What is HITS algorithm in Graph Mining esp. for Web? &hellip; <\/p>\n<p><a class=\"more-link btn\" href=\"http:\/\/bangla.sitestree.com\/?p=22879\">Continue reading<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1905],"tags":[],"class_list":["post-22879","post","type-post","status-publish","format-standard","hentry","category-graph-mining","item-wrap"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":16322,"url":"http:\/\/bangla.sitestree.com\/?p=16322","url_meta":{"origin":22879,"position":0},"title":"Graph Mining: Hits. Learn by finding Answers to the Following Questions. Can you answer the following questions?","author":"Sayed","date":"October 12, 2019","format":false,"excerpt":"Graph Mining: Hits. Learn by finding Answers to the Following Questions. What is HITS algorithm in Graph Mining esp. for Web? What does HITS stand for? What is another similar Algorithm? What are different between the PageRank algorithm and HITS? What is the PageRank algorithm? What is the purpose? Where\u2026","rel":"","context":"In &quot;Graph Mining&quot;","block_context":{"text":"Graph Mining","link":"http:\/\/bangla.sitestree.com\/?cat=1905"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":22873,"url":"http:\/\/bangla.sitestree.com\/?p=22873","url_meta":{"origin":22879,"position":1},"title":"Graph Mining: Learning Resources","author":"Sayed","date":"March 21, 2021","format":false,"excerpt":"Resources: Public URLs Graph Mining: Introducing Graphs: Learn by finding answers to the following questions?\u00a0http:\/\/bangla.salearningschool.com\/recent-posts\/graph-mining-introducing-graphs-learn-by-finding-answers-to-the-following-questions\/ Graph Mining: What is Graph Mining? Learn by finding answers to the following questions. Can you answer the following questions?\u00a0http:\/\/bangla.salearningschool.com\/recent-posts\/graph-mining-what-is-graph-mining-learn-by-finding-answers-to-the-following-questions-can-you-answer-the-following-questions\/ Graph Mining: Shared Nearest Neighbors : Clustering : Community Detection.\u00a0http:\/\/bangla.salearningschool.com\/recent-posts\/graph-mining-shared-nearest-neighbors-clustering-community-detection\/ Graph Mining: Betweenness Based Clustering:\u2026","rel":"","context":"In &quot;Graph Mining&quot;","block_context":{"text":"Graph Mining","link":"http:\/\/bangla.sitestree.com\/?cat=1905"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":22891,"url":"http:\/\/bangla.sitestree.com\/?p=22891","url_meta":{"origin":22879,"position":2},"title":"Graph Mining: Misc. Topics to Learn: Misc. Resources to Learn From","author":"Sayed","date":"March 21, 2021","format":false,"excerpt":"Graph Mining: Misc. Topics to Learn: Misc. Resources to Learn From Influence\/Virus\/Label Propagation Resources to learn fromPage A presentation on Influence\/Virus PropagationURL Big Data Graph Databases Resources to Learn FromPage Graph DatabaseURL Neo4jPage Big Data Graph Processing Resources to Learn FromPage ToolURL Techniques, Tools and Applications of Graph AnalyticURL Graph\u2026","rel":"","context":"In &quot;Graph Mining&quot;","block_context":{"text":"Graph Mining","link":"http:\/\/bangla.sitestree.com\/?cat=1905"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":16311,"url":"http:\/\/bangla.sitestree.com\/?p=16311","url_meta":{"origin":22879,"position":3},"title":"Graph Mining: What is Graph Mining? Learn by finding answers to the following questions. Can you answer the following questions?","author":"Sayed","date":"October 9, 2019","format":false,"excerpt":"Graph Mining: What is Graph Mining? Learn by finding answers to the following questions. Can you answer the following questions? What is Graph Mining? What is a Graph anyway? Is Graph mining just a kind of Machine Learning? i.e. is Machine Learning the only primary component of Graph Mining? Does\u2026","rel":"","context":"In &quot;AI ML DS RL DL NN NLP Data Mining Optimization&quot;","block_context":{"text":"AI ML DS RL DL NN NLP Data Mining Optimization","link":"http:\/\/bangla.sitestree.com\/?cat=1910"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":22881,"url":"http:\/\/bangla.sitestree.com\/?p=22881","url_meta":{"origin":22879,"position":4},"title":"Graph Mining: Node Importance","author":"Sayed","date":"March 21, 2021","format":false,"excerpt":"Resources to Learn From A Book. Nagiza F. Samatova, William Hendrix, John Jenkins, Kanchana Padmanabhan, and Arpan Chakraborty. 2013. Practical Graph Mining with R. Chapman & Hall\/CRC. Read the resources above to find answers. Betweenness Based Clustering: Learn by finding answers to the following questions. Can you answer the following?\u2026","rel":"","context":"In &quot;Graph Mining&quot;","block_context":{"text":"Graph Mining","link":"http:\/\/bangla.sitestree.com\/?cat=1905"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":22885,"url":"http:\/\/bangla.sitestree.com\/?p=22885","url_meta":{"origin":22879,"position":5},"title":"Graph Mining: Shared Nearest Neighbors &#8211; Community Detection","author":"Sayed","date":"March 21, 2021","format":false,"excerpt":"Resources to Learn From Resources:Jarvis-Patrick Clusteringhttps:\/\/btluke.com\/jpclust.htmlEmpirical Comparison of Algorithms for Network Community Detectionhttps:\/\/cs.stanford.edu\/~jure\/pubs\/communities-www10.pdf Read the resources above to find answers. Shared Nearest Neighbors : Clustering : Community Detection Graph Mining: Shared Nearest Neighbors : Clustering : Community Detection Graph Mining: Shared Nearest Neighbors (SNN): Clustering : Community Detection: Learn by\u2026","rel":"","context":"In &quot;Graph Mining&quot;","block_context":{"text":"Graph Mining","link":"http:\/\/bangla.sitestree.com\/?cat=1905"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/22879","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=22879"}],"version-history":[{"count":2,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/22879\/revisions"}],"predecessor-version":[{"id":22900,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/22879\/revisions\/22900"}],"wp:attachment":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=22879"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=22879"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=22879"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}