{"id":17260,"date":"2020-06-24T11:17:17","date_gmt":"2020-06-24T15:17:17","guid":{"rendered":"http:\/\/bangla.salearningschool.com\/recent-posts\/performance-measurement-metrics-for-target-aeroplanes-people-tracking\/"},"modified":"2020-06-25T22:01:16","modified_gmt":"2020-06-26T02:01:16","slug":"performance-measurement-metrics-for-target-aeroplanes-people-tracking","status":"publish","type":"post","link":"http:\/\/bangla.sitestree.com\/?p=17260","title":{"rendered":"Performance Measurement Metrics for Target (Aeroplanes, People) Tracking"},"content":{"rendered":"<p>Performance Measurement Metrics for Target (Aeroplanes, People) Tracking<\/p>\n<p><strong>By Sayed Ahmed<\/strong><\/p>\n<p>Let\u2019s see, you want to track the aeroplanes in the sky using some radar and tracking algorithms. You have written simulation software for that. How will you measure that your software and algorithm is doing a great job. Even in real life, how will you know that your aero plane tracking is working well?<\/p>\n<p>You can define some metrics for that i.e. to measure the performance.<\/p>\n<p><strong>T<\/strong>: Tracks : your decision\/finding of the aero plane trajectory<\/p>\n<p><strong>L<\/strong>: Truths : The actual trajectory of the aero planes<\/p>\n<p><strong>M<\/strong>: Measures: your radar measurements<\/p>\n<p><strong>What is the general performance metric? What does it mean?<\/strong><\/p>\n<ul>\n<li><strong>p <\/strong>= <strong>g <\/strong>(M, L, T )<\/li>\n<\/ul>\n<p><strong>What are performance categories?<\/strong><\/p>\n<ul>\n<li>Sensor Related: Independent of tracking result (Cramer Rao Lower Bound, Sensor Characteristics)<\/li>\n<li>Tracker Related : Tracking Result, Tracker Type, application of interest<\/li>\n<\/ul>\n<p><strong>What are the subdivisions of Tracker Dependent Metrics?<\/strong><\/p>\n<ul>\n<li>Algorithm free: Based on Available Truth and Unavailable Truth (tracking and truth)<\/li>\n<li>Algorithm dependent : application dependent : For MHT, Dynamic Programming<\/li>\n<\/ul>\n<p><strong>Algorithm Free<\/strong><\/p>\n<ul>\n<li><strong>Cardinality Measures, <\/strong>based on some numbers\n<ul>\n<li>Count of Valid Tracks, false tracks, missed tracks, spurious tracks, completeness, broken tracks, swaps in tracks<\/li>\n<\/ul>\n<\/li>\n<li><strong>Time Measures: <\/strong>Performance based on Time Measures\n<ul>\n<li>Rate of false alarm, redundant track ratio, probability of detection, fragmentation rate, track latency<\/li>\n<\/ul>\n<\/li>\n<li><strong>Available Truths <\/strong>\n<ul>\n<li>Truth to Track Association -&gt; association matrix at each scan and monte carlo run<\/li>\n<li>Distance metric -&gt; between truths and tracks<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<ul>\n<li><strong>Unavailable Truths<\/strong>:\n<ul>\n<li>Consistency of estimations -&gt; To innovation of estimation<\/li>\n<\/ul>\n<\/li>\n<li><strong>Track Cardinality Measures<\/strong>\n<ul>\n<li><strong>Track result and Truth Data<\/strong><\/li>\n<li><strong>Valid Tracks: <\/strong>A target is assigned to one track, the target is not assigned to any other<\/li>\n<li><strong>Missed Tracks:<\/strong> If a target is not assigned to any tracks<\/li>\n<li><strong>False Tracks:<\/strong> No target is assigned to that track, only false alarms for example<\/li>\n<li><strong>Spurious Tracks:<\/strong> A track is assigned to multiple targets<\/li>\n<li><strong>Completeness:<\/strong> Number of valid tracks per truth<\/li>\n<li><strong>Swaps in Tracks:<\/strong> Track Crossings by targets. Count of track segments for each target over the total time<\/li>\n<li><strong>Broken Tracks: <\/strong>For each timestamp, there is no track assigned to the truth. Count B (l, m) : l_th truth, m_th run. Count of broken tracks<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<ul>\n<li><strong>Time Measures<\/strong>\n<ul>\n<li><strong>Track Latency<\/strong>\n<ul>\n<li>Confirmation latency: does it mean target start to track confirmation<\/li>\n<li>Termination Latency : does it mean target disappear to termination time\n<ul>\n<li>Timestamp i.e. time required<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li><strong>Rate of False Alarm:<\/strong>\n<ul>\n<li>Average number of false tracks per time<\/li>\n<\/ul>\n<\/li>\n<li><strong>Track Probability of Detection<\/strong>\n<ul>\n<li>( duration l th target is assigned to a valid track) \/ (l th track last scan time \u2013 l th track first scan time)<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li><strong>Accuracy Measures<\/strong>\n<ul>\n<li><strong>RMSE:<\/strong><\/li>\n<li>kth scan, l th target, M monte carlo run : Mth monte carlo<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<ul>\n<li>Average Euclidean Error:\n<ul>\n<li>RMSE without Square Root, no square in the error<\/li>\n<\/ul>\n<\/li>\n<li>Geometric Average Error:\n<ul>\n<li>Average Euclidean Error, just sum of log<\/li>\n<\/ul>\n<\/li>\n<li>Harmonic: 1\/(sum(1\/error)\/Cont_monte_carlo_run )<\/li>\n<\/ul>\n<p><strong>Sensor Metrics<\/strong><\/p>\n<ul>\n<li><strong>Probability of detection<\/strong>: within scenario, within FOV<\/li>\n<li><strong>Coverage<\/strong>: Average, minimum, maximum<\/li>\n<li><strong>Detection Gap<\/strong>: Average, Minimum, Maximum<\/li>\n<\/ul>\n<p><strong>Estimator Consistency<\/strong><\/p>\n<ul>\n<li>Normalized Estimation Error Squared<\/li>\n<\/ul>\n<p><strong>Selected Metrics: <\/strong><\/p>\n<ul>\n<li>Number of false tracks,<\/li>\n<li>track probability of detection,<\/li>\n<li>fragmentation rate,<\/li>\n<li>track latency (confirmation, deletion),<\/li>\n<li>swap count,<\/li>\n<li>RMSE<\/li>\n<\/ul>\n<p><strong>Score:<\/strong><\/p>\n<p>Un-normalized score, Normalized Score, Best = 1.00 , worst = 0.0<\/p>\n<p><strong>References:<\/strong><\/p>\n<p><a href=\"https:\/\/ieeexplore.ieee.org\/author\/37398523300\">A. A. Gorji <\/a>; <a href=\"https:\/\/ieeexplore.ieee.org\/author\/37398741000\">R. Tharmarasa <\/a>; <a href=\"https:\/\/ieeexplore.ieee.org\/author\/37268358200\">T. Kirubarajan<\/a>: Performance measures for multiple target tracking problems<\/p>\n<p>*** . *** *** . *** . *** . ***<\/p>\n<p><em><strong><em><strong>Training Courses: <\/strong><a href=\"http:\/\/training.sitestree.com\/\">http:\/\/Training.SitesTree.com<\/a> <\/em><br \/>\nBlog<\/strong>: <a href=\"http:\/\/bangla.salearningschool.com\/\">http:\/\/Bangla.SaLearningSchool.com<\/a>, <a href=\"http:\/\/sitestree.com\">http:\/\/SitesTree.com<\/a><\/em><br \/>\n<em><strong>8112223 Canada Inc\/Justetc<\/strong>: <a href=\"http:\/\/JustEtc.net\">http:\/\/JustEtc.net<\/a><\/em><br \/>\n<em>Youtube: <\/em><a href=\"https:\/\/www.youtube.com\/channel\/UCHrtq0pV8mEuTLGd2-Lp9ig\/playlists\">https:\/\/www.youtube.com\/channel\/UCHrtq0pV8mEuTLGd2-Lp9ig\/playlists<\/a><br \/>\n<em><strong>Medium: <\/strong><\/em><a href=\"https:\/\/medium.com\/@SayedAhmedCanada\">https:\/\/medium.com\/@SayedAhmedCanada<\/a><\/p>\n<p><em><\/em><br \/>\n<em><strong>Sayed Ahmed<\/strong><br \/>\n<\/em><br \/>\n<em><strong>BSc. Eng. in Comp. Sc. &amp; Eng. (BUET)<\/strong><\/em><br \/>\n<em><strong>MSc. in Comp. Sc. (U of Manitoba, Canada)<\/strong><\/em><br \/>\n<em><strong>MSc. in Data Science and Analytics (Ryerson University, Canada)<\/strong><\/em><br \/>\n<em><strong>Linkedin<\/strong>: <a href=\"https:\/\/ca.linkedin.com\/in\/sayedjustetc\">https:\/\/ca.linkedin.com\/in\/sayedjustetc<\/a><br \/>\n<\/em><\/p>\n<p><em><strong>Facebook Groups\/Forums to discuss (Q &amp; A): <\/strong><\/em><br \/>\n<a href=\"https:\/\/www.facebook.com\/salearningschool\/?ref=your_pages\">https:\/\/www.facebook.com\/salearningschool<\/a><\/p>\n<p><a href=\"https:\/\/www.facebook.com\/banglasalearningschool\">https:\/\/www.facebook.com\/banglasalearningschool<\/a><br \/>\n<a href=\"https:\/\/www.facebook.com\/justetcsocial\">https:\/\/www.facebook.com\/justetcsocial<\/a><\/p>\n<p><em>Get access to courses on Big Data, Data Science, AI, Cloud, Linux, System Admin, Web Development and Misc. related. Also, create your own course to sell to others. <\/em><a href=\"http:\/\/sitestree.com\/training\/\">http:\/\/sitestree.com\/training\/<\/a><\/p>\n<p><strong>Join, Discuss, and Thrive:<\/strong><br \/>\nFinance: <a href=\"https:\/\/www.facebook.com\/groups\/1792339521056034\">https:\/\/www.facebook.com\/groups\/1792339521056034<\/a><\/p>\n<p>Bangladesh and Canada: <a href=\"https:\/\/www.facebook.com\/groups\/398414183875009\">https:\/\/www.facebook.com\/groups\/398414183875009<\/a><\/p>\n<p>Bangladesh: IT &amp; Eng: Canada: <a href=\"https:\/\/www.facebook.com\/groups\/480297675634630\">https:\/\/www.facebook.com\/groups\/480297675634630<\/a><\/p>\n<p>BUETians in Ontario: <a href=\"https:\/\/www.facebook.com\/groups\/371982239854027\">https:\/\/www.facebook.com\/groups\/371982239854027<\/a><\/p>\n<p>Worldwide IT: <a href=\"https:\/\/www.facebook.com\/groups\/28362061867\">https:\/\/www.facebook.com\/groups\/28362061867<\/a><\/p>\n<p>JustEtc: <a href=\"https:\/\/www.facebook.com\/JustETC-Technologies-Inc-289864738261\">https:\/\/www.facebook.com\/JustETC-Technologies-Inc-289864738261<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Performance Measurement Metrics for Target (Aeroplanes, People) Tracking By Sayed Ahmed Let\u2019s see, you want to track the aeroplanes in the sky using some radar and tracking algorithms. You have written simulation software for that. How will you measure that your software and algorithm is doing a great job. Even in real life, how will &hellip; <\/p>\n<p><a class=\"more-link btn\" href=\"http:\/\/bangla.sitestree.com\/?p=17260\">Continue reading<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1916,182],"tags":[],"class_list":["post-17260","post","type-post","status-publish","format-standard","hentry","category-tracking-and-estimation-for-good-cause","category---blog","item-wrap"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":16447,"url":"http:\/\/bangla.sitestree.com\/?p=16447","url_meta":{"origin":17260,"position":0},"title":"Radar\/Lidar Detection and Self-Driving Agents","author":"Sayed","date":"December 2, 2019","format":false,"excerpt":"What are basic Radar functions? Whatever comes to your mind? Though the goal is not to find core radar applications; however, functions of radars that are used in the applications. What is the goal of the radar function named: Detection? Answer, in terms of signals Does radar take images of\u2026","rel":"","context":"In &quot;AI ML DS RL DL NN NLP Data Mining Optimization&quot;","block_context":{"text":"AI ML DS RL DL NN NLP Data Mining Optimization","link":"http:\/\/bangla.sitestree.com\/?cat=1910"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":17262,"url":"http:\/\/bangla.sitestree.com\/?p=17262","url_meta":{"origin":17260,"position":1},"title":"Lec 2 performance measurement categories for performance measurements of tracking applications such","author":"Sayed","date":"June 25, 2020","format":false,"excerpt":"","rel":"","context":"In &quot;Tracking and Estimation for Good Cause&quot;","block_context":{"text":"Tracking and Estimation for Good Cause","link":"http:\/\/bangla.sitestree.com\/?cat=1916"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":17261,"url":"http:\/\/bangla.sitestree.com\/?p=17261","url_meta":{"origin":17260,"position":2},"title":"Misc. Information on Multi-Target Tracking: Algorithm Comparisons","author":"Sayed","date":"June 24, 2020","format":false,"excerpt":"Misc. Information on Multi-Target Tracking: Algorithm Comparisons Any information on IMM-SD? Theoretically IMM-SD and IMM-MHT should provide equivalent performance in tracking Can be considered as an implementation of IMM-MHT However, simulation shows that IMM-SD performs better. How can IMM-SD achieve better performance than IMM-MHT? IMM-SD finds the global optimal where\u2026","rel":"","context":"In &quot;Tracking and Estimation for Good Cause&quot;","block_context":{"text":"Tracking and Estimation for Good Cause","link":"http:\/\/bangla.sitestree.com\/?cat=1916"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":76322,"url":"http:\/\/bangla.sitestree.com\/?p=76322","url_meta":{"origin":17260,"position":3},"title":"lec 2 performance measurement categories for performance measurements of tracking applications such","author":"Sayed","date":"September 1, 2024","format":false,"excerpt":"https:\/\/youtu.be\/p88UOH_QPXk","rel":"","context":"In &quot;From Youtube Channel&quot;","block_context":{"text":"From Youtube Channel","link":"http:\/\/bangla.sitestree.com\/?cat=1952"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/img.youtube.com\/vi\/p88UOH_QPXk\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":17325,"url":"http:\/\/bangla.sitestree.com\/?p=17325","url_meta":{"origin":17260,"position":4},"title":"Youtube Playlist: On AI, Target Tracking, Computer Vision, and Surveillance","author":"Sayed","date":"August 3, 2020","format":false,"excerpt":"(Youtube Playlist: On AI, Target Tracking, Computer Vision, and Surveillance) Youtube Playlist: https:\/\/lnkd.in\/efZMdV3 on Related Research Paper Study for Machine Learning Aided Track Management for Multitarget Tracking, Track Quality Management, Maneuvering target tracking-fuzzy-logic-RLSF, Tracking with random sample consensus in dense clutter, On Deep Learning Research for Multi-Object Tracking. A study\u2026","rel":"","context":"In &quot;\u09ac\u09cd\u09b2\u0997 \u0964 Blog&quot;","block_context":{"text":"\u09ac\u09cd\u09b2\u0997 \u0964 Blog","link":"http:\/\/bangla.sitestree.com\/?cat=182"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":72012,"url":"http:\/\/bangla.sitestree.com\/?p=72012","url_meta":{"origin":17260,"position":5},"title":"#Sensor: #Canada: #Job\/Contract\/Project: #Sensor, #Tracking, #Fusion, #Estimation, #Surveillance, #sensor network, #target #tracking, #security 2021-11-27","author":"Author-Check- Article-or-Video","date":"November 26, 2021","format":false,"excerpt":"Date Posted:2021-11-27 .Apply yourself, or submit others as candidates; Build a recruitment team to submit others as candidates; submit RFP to be considered for projects in future; Try to become a vendor so that you are asked to submit consultants\/resources in future. If these work for you. This list is\u2026","rel":"","context":"In &quot;Sensor, Tracking, Surveillance, Security - Jobs and Projects&quot;","block_context":{"text":"Sensor, Tracking, Surveillance, Security - Jobs and Projects","link":"http:\/\/bangla.sitestree.com\/?cat=1923"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/17260","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=17260"}],"version-history":[{"count":1,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/17260\/revisions"}],"predecessor-version":[{"id":17275,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=\/wp\/v2\/posts\/17260\/revisions\/17275"}],"wp:attachment":[{"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=17260"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=17260"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/bangla.sitestree.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=17260"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}