{"id":22885,"date":"2021-03-21T21:51:34","date_gmt":"2021-03-22T01:51:34","guid":{"rendered":"http:\/\/bangla.salearningschool.com\/recent-posts\/?p=22885"},"modified":"2021-03-21T21:51:37","modified_gmt":"2021-03-22T01:51:37","slug":"graph-mining-shared-nearest-neighbors-community-detection","status":"publish","type":"post","link":"http:\/\/bangla.sitestree.com\/?p=22885","title":{"rendered":"Graph Mining: Shared Nearest Neighbors &#8211; Community Detection"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Resources to Learn From<\/h2>\n\n\n\n<p>Resources:<br \/><br \/>Jarvis-Patrick Clustering<br \/>https:\/\/btluke.com\/jpclust.html<br \/><br \/>Empirical Comparison of Algorithms for Network Community Detection<br \/>https:\/\/cs.stanford.edu\/~jure\/pubs\/communities-www10.pdf<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Read the resources above to find answers. Shared Nearest Neighbors : Clustering : Community Detection<\/h2>\n\n\n\n<p>Graph Mining: Shared Nearest Neighbors : Clustering : Community Detection<\/p>\n\n\n\n<p>Graph Mining: Shared Nearest Neighbors (SNN): Clustering : Community Detection: Learn by Finding Answers to the Following Questions.<\/p>\n\n\n\n<p>Will use SNN sometimes.<\/p>\n\n\n\n<p>What is one another name of the algorithm: Shared Nearest Neighbors?<\/p>\n\n\n\n<p>What is the purpose of the Algorithm: Shared Nearest Neighbors?<\/p>\n\n\n\n<p>Can you name other Algorithms that serve the same or similar purpose?<\/p>\n\n\n\n<p>What is the Criteria that SNN uses?<\/p>\n\n\n\n<p>Is SNN Hierarchical? What does Hierarchical mean in the context of Clustering\/Community detection?<\/p>\n\n\n\n<p>How does SNN work? i.e. what is the algorithm? i.e. how does SNN create clusters\/communities?<\/p>\n\n\n\n<p>Give and explain the steps in SNN with a small example.<\/p>\n\n\n\n<p>What is threshold \u03c4 in the SNN algorithm? Is it numeric? What can be the maximum and the minimum values?<\/p>\n\n\n\n<p>For the following Undirected and unweighted Graphs, show the steps and the final clusters.<br \/>Edges: {0, 1} {0, 2} {0, 3} {1, 2}, {1, 3} {2, 3} {2, 4} {3, 4}<br \/>You can draw the graph first. You can use \u03c4 = 2.<\/p>\n\n\n\n<p>What is Node Similarity or Node Proximity between two nodes in SNN?<\/p>\n\n\n\n<p>What is the output of SNN? i.e. on an undirected and unweighted Graph?<\/p>\n\n\n\n<p>Will the output will have weights on the edges?<\/p>\n\n\n\n<p>Give the pseudocode for SNN algorithm<\/p>\n\n\n\n<p>Implement the SNN algorithm in Python or R or Matlab &#8211; whichever you prefer.<\/p>\n\n\n\n<p>Can you apply SNN on weighted Graphs?<\/p>\n\n\n\n<p>If you can apply SNN on weighted graphs, then how will you apply the Threshold, say theta?<\/p>\n\n\n\n<p>What is the first step in applying theta &#8211; if that is doable?<\/p>\n\n\n\n<p>What is the difference between tau (\u03c4) and theta.<\/p>\n\n\n\n<p>What is k in SNN algorithms (if Weighted)?<\/p>\n\n\n\n<p>How do we know which tau(\u03c4) or \u201dk\u201d to choose?<\/p>\n\n\n\n<p>What are some evaluation metrics for tau or k?<\/p>\n\n\n\n<p>what is Conductance?<\/p>\n\n\n\n<p>Conductance whose property is this? The input graph, the output graph or the possible communities (from where you select the final communities)<\/p>\n\n\n\n<p>Is low value or high value of Conductance &#8211; that is used for the communities?<\/p>\n\n\n\n<p>When comparing two k or tau values &#8211; which k or tau that you accept? Think in terms of Conductance.<\/p>\n\n\n\n<p>So, what was the purpose behind choosing these K or Tau values? What do we want to achieve ultimately? Is it to achieve Stronger communities by checking all possible communities and then measuring the community strength using Conductance? If it is &#8211; do all the questions on Weighted Graphs make sense? Why, Why not? How?<\/p>\n\n\n\n<p>Write a Pseudo-code for SNN on Undirected Weighted Graphs. Find the optimal value for K and tau.<\/p>\n\n\n\n<p>Implement SNN on Undirected Weighted Graphs. Print the optimal value for K and tau.<\/p>\n\n\n\n<p>Why are we detecting communities and clusters anyway? What are the practical applications of such algorithms?<br \/>Hint: Check notes on Introduction to Clustering\/Community detection<\/p>\n\n\n\n<p><strong>Some Answers:<\/strong><br \/>What is one another name of the algorithm: Shared Nearest Neighbors?<br \/>Ans: Jarvis-Patrick algorithm<\/p>\n\n\n\n<p>Can you name other Algorithms that serve the same or similar purpose?<br \/>Ans: Maximal-Clique Enumeration, K- Spanning Tree, Shared Nearest Neighbor, Highly Connected Components, MinCut, Betweenness Based Algorithms, Louvain Modularity, CNM Algorithm<\/p>\n\n\n\n<p>What is the Criteria that SNN uses?<br \/>Ans: Two nodes are similar if they share a lot of neighbors<\/p>\n\n\n\n<p>Is SNN Hierarchical?<br \/>Ans: No<\/p>\n\n\n\n<p>What is Node Similarity or Node Proximity between two nodes in SNN?<br \/>Ans: Count of the shared number of nodes\/neighbors<\/p>\n\n\n\n<p>What is k in SNN algorithms (if Weighted)?<br \/>retain its k neighbors<\/p>\n\n\n\n<p><strong>Resources:<\/strong><\/p>\n\n\n\n<p>Jarvis-Patrick Clustering<br \/><a href=\"https:\/\/btluke.com\/jpclust.html\">https:\/\/btluke.com\/jpclust.html<\/a><\/p>\n\n\n\n<p>Empirical Comparison of Algorithms for Network Community Detection<br \/><a href=\"https:\/\/cs.stanford.edu\/~jure\/pubs\/communities-www10.pdf\">https:\/\/cs.stanford.edu\/~jure\/pubs\/communities-www10.pdf<\/a><\/p>\n\n\n\n<p><strong>By<\/strong><\/p>\n\n\n\n<p><strong>Sayed Ahmed<\/strong><\/p>\n\n\n\n<p><strong>Linkedin<\/strong>:&nbsp;<a href=\"https:\/\/ca.linkedin.com\/in\/sayedjustetc\">https:\/\/ca.linkedin.com\/in\/sayedjustetc<\/a><\/p>\n\n\n\n<p><strong>Blog<\/strong>:\u00a0<a href=\"http:\/\/bangla.salearningschool.com\/\">http:\/\/Bangla.SaLearningSchool.com<\/a>,\u00a0<a href=\"http:\/\/sitestree.com\/\">http:\/\/SitesTree.com<\/a><br \/><strong>Online and Offline Training<\/strong>:\u00a0<a href=\"http:\/\/training.sitestree.com\/\">http:\/\/Training.SitesTree.com<\/a><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><em><strong>Shop <\/strong><\/em> <em><strong>Online:&nbsp;<\/strong><\/em><a href=\"http:\/\/www.shopforsoul.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.ShopForSoul.com\/<\/a><\/p>\n\n\n\n<p><em><strong>8112223 Canada Inc.\/JustEtc<\/strong>: <a href=\"http:\/\/justetc.net\/\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/JustEtc.net<\/a><\/em><\/p>\n\n\n\n<p><em><strong>Linkedin<\/strong>: <a href=\"https:\/\/ca.linkedin.com\/in\/sayedjustetc\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/ca.linkedin.com\/in\/sayedjustetc<\/a><\/em><\/p>\n\n\n\n<p><em><strong><em><strong>Courses:&nbsp;<\/strong><a href=\"http:\/\/training.sitestree.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/Training.SitesTree.com<\/a>&nbsp;(Big Data, Cloud, Security, Machine Learning)<\/em><\/strong><\/em><\/p>\n\n\n\n<p><em><strong>Blog<\/strong>:&nbsp;<a href=\"http:\/\/bangla.salearningschool.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/Bangla.SaLearningSchool.com<\/a>,&nbsp;<a href=\"http:\/\/sitestree.com\" target=\"_blank\" rel=\"noreferrer noopener\">http:\/\/SitesTree.com<\/a><\/em><\/p>\n\n\n\n<p><strong>Medium<\/strong>:&nbsp;<a href=\"https:\/\/medium.com\/@SayedAhmedCanada\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/medium.com\/@SayedAhmedCanada<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Resources to Learn From Resources: Jarvis-Patrick Clusteringhttps:\/\/btluke.com\/jpclust.html Empirical Comparison of Algorithms for Network Community Detectionhttps:\/\/cs.stanford.edu\/~jure\/pubs\/communities-www10.pdf Read the resources above to find answers. Shared Nearest Neighbors : Clustering : Community Detection Graph Mining: Shared Nearest Neighbors : Clustering : Community Detection Graph Mining: Shared Nearest Neighbors (SNN): Clustering : Community Detection: Learn by Finding Answers to &hellip; <\/p>\n<p><a class=\"more-link btn\" href=\"http:\/\/bangla.sitestree.com\/?p=22885\">Continue reading<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1905],"tags":[],"class_list":["post-22885","post","type-post","status-publish","format-standard","hentry","category-graph-mining","item-wrap"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":16302,"url":"http:\/\/bangla.sitestree.com\/?p=16302","url_meta":{"origin":22885,"position":0},"title":"Graph Mining: Shared Nearest Neighbors : Clustering : Community Detection","author":"Sayed","date":"October 7, 2019","format":false,"excerpt":"Graph Mining: Shared Nearest Neighbors : Clustering : Community Detection Graph Mining: Shared Nearest Neighbors (SNN): Clustering : Community Detection: Learn by Finding Answers to the Following Questions. Will use SNN sometimes. What is one another name of the algorithm: Shared Nearest Neighbors? What is the purpose of the Algorithm:\u2026","rel":"","context":"In &quot;Graph Mining&quot;","block_context":{"text":"Graph Mining","link":"http:\/\/bangla.sitestree.com\/?cat=1905"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":22873,"url":"http:\/\/bangla.sitestree.com\/?p=22873","url_meta":{"origin":22885,"position":1},"title":"Graph Mining: Learning Resources","author":"Sayed","date":"March 21, 2021","format":false,"excerpt":"Resources: Public URLs Graph Mining: Introducing Graphs: Learn by finding answers to the following questions?\u00a0http:\/\/bangla.salearningschool.com\/recent-posts\/graph-mining-introducing-graphs-learn-by-finding-answers-to-the-following-questions\/ Graph Mining: What is Graph Mining? Learn by finding answers to the following questions. Can you answer the following questions?\u00a0http:\/\/bangla.salearningschool.com\/recent-posts\/graph-mining-what-is-graph-mining-learn-by-finding-answers-to-the-following-questions-can-you-answer-the-following-questions\/ Graph Mining: Shared Nearest Neighbors : Clustering : Community Detection.\u00a0http:\/\/bangla.salearningschool.com\/recent-posts\/graph-mining-shared-nearest-neighbors-clustering-community-detection\/ Graph Mining: Betweenness Based Clustering:\u2026","rel":"","context":"In &quot;Graph Mining&quot;","block_context":{"text":"Graph Mining","link":"http:\/\/bangla.sitestree.com\/?cat=1905"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":22883,"url":"http:\/\/bangla.sitestree.com\/?p=22883","url_meta":{"origin":22885,"position":2},"title":"Graph Mining: Community and Cluster Detection","author":"Sayed","date":"March 21, 2021","format":false,"excerpt":"Resources to Learn From Resources:Defining and identifying communities in networkshttps:\/\/www.pnas.org\/content\/101\/9\/2658Community Structure:https:\/\/en.wikipedia.org\/wiki\/Community_structureGraph Clustering:https:\/\/www.csc2.ncsu.edu\/faculty\/nfsamato\/practical-graph-mining-with-R\/slides\/pdf\/Graph_Cluster_Analysis.pdf Read the resources above to find answers. Community Detection: Learn by finding answers to the following questions. Can you answer the following questions on Community Detection? Graph Mining: Community Detection: Learn by finding answers to the following questions.\u2026","rel":"","context":"In &quot;Graph Mining&quot;","block_context":{"text":"Graph Mining","link":"http:\/\/bangla.sitestree.com\/?cat=1905"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":16300,"url":"http:\/\/bangla.sitestree.com\/?p=16300","url_meta":{"origin":22885,"position":3},"title":"Graph Mining: Community Detection: Learn by finding answers to the following questions. Can you answer the following questions on Community Detection?","author":"Sayed","date":"October 7, 2019","format":false,"excerpt":"Graph Mining: Community Detection: Learn by finding answers to the following questions. Can you answer the following questions on Community Detection? What is a community anyway? Describe from your real-world\/social understanding of it? Can you relate it to the Graphs concept in Computer Science? In your daily life do you\u2026","rel":"","context":"In &quot;AI ML DS RL DL NN NLP Data Mining Optimization&quot;","block_context":{"text":"AI ML DS RL DL NN NLP Data Mining Optimization","link":"http:\/\/bangla.sitestree.com\/?cat=1910"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":22871,"url":"http:\/\/bangla.sitestree.com\/?p=22871","url_meta":{"origin":22885,"position":4},"title":"Graph Mining: Possible Course Topics","author":"Sayed","date":"March 21, 2021","format":false,"excerpt":"Course Topics Graph Theory Introduction,\u00a0Graph Mining Introduction,\u00a0Network Properties, Random Graphs, Small World Graphs,\u00a0Node Importance,\u00a0Node Similarity,\u00a0Clustering & Community Detection,\u00a0Link Prediction,\u00a0Anomaly detection,\u00a0Time Evolving Graphs,\u00a0Influence\/Virus Propagation,\u00a0Graph Mining Use Cases,\u00a0Big Data Graph Databases,\u00a0Big Data Graph ProcessingLast modified: Wednesday, 23 October 2019, 12:44 PM Shop Online:\u00a0https:\/\/www.ShopForSoul.com\/ 8112223 Canada Inc.\/JustEtc: http:\/\/JustEtc.net Linkedin: https:\/\/ca.linkedin.com\/in\/sayedjustetc Courses:\u00a0http:\/\/Training.SitesTree.com\u00a0(Big Data, Cloud,\u2026","rel":"","context":"In &quot;Graph Mining&quot;","block_context":{"text":"Graph Mining","link":"http:\/\/bangla.sitestree.com\/?cat=1905"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":22881,"url":"http:\/\/bangla.sitestree.com\/?p=22881","url_meta":{"origin":22885,"position":5},"title":"Graph Mining: Node Importance","author":"Sayed","date":"March 21, 2021","format":false,"excerpt":"Resources to Learn From A Book. Nagiza F. Samatova, William Hendrix, John Jenkins, Kanchana Padmanabhan, and Arpan Chakraborty. 2013. Practical Graph Mining with R. Chapman & Hall\/CRC. Read the resources above to find answers. Betweenness Based Clustering: Learn by finding answers to the following questions. Can you answer the following?\u2026","rel":"","context":"In &quot;Graph Mining&quot;","block_context":{"text":"Graph Mining","link":"http:\/\/bangla.sitestree.com\/?cat=1905"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/22885","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=22885"}],"version-history":[{"count":2,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/22885\/revisions"}],"predecessor-version":[{"id":22903,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/22885\/revisions\/22903"}],"wp:attachment":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=22885"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=22885"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=22885"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}