{"id":557,"date":"2023-12-19T10:10:29","date_gmt":"2023-12-19T09:10:29","guid":{"rendered":"https:\/\/research.dii.unipd.it\/mts\/?page_id=557"},"modified":"2024-07-05T11:33:59","modified_gmt":"2024-07-05T09:33:59","slug":"vision-based-navigation","status":"publish","type":"page","link":"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/","title":{"rendered":"Vision-based Navigation"},"content":{"rendered":"<div data-label=\"Content\" data-id=\"content--2\" data-export-id=\"content-12\" data-category=\"content\" class=\"content-12 content-section content-section-spacing\" id=\"content-2\">\r\n<div class=\"gridContainer\">\r\n<div class=\"row text-center\">\r\n<div class=\"section-title-col\" data-type=\"column\">\r\n<h2 class=\"\">Vision-based proximity navigation between satellites<\/h2>\r\n<\/div>\r\n<\/div>\r\n<div class=\"row center-xs middle-xs\">\r\n<div class=\"col-sm-9\" data-type=\"column\">\r\n<p class=\"\" style=\"text-align: left\">In recent years, there has been an increasing interest in utilizing <strong>Artificial Intelligence algorithms<\/strong> for space applications. Among the spectrum of Machine Learning techniques available, <strong>Convolutional Neural Networks (CNNs)<\/strong> emerge as a well-suited deep learning approach for optimizing Guidance, Navigation, and Control systems during close-proximity operations between satellites.&nbsp;<\/p>\r\n<p style=\"text-align: left\">Our research group has been developing and validating a pipeline for satellite relative navigation based on computer vision algorithms with the aim of computing the measurement vector used in the navigation filter (Extended Kalman Filter) to estimate the relative motion between a chaser satellite hosting a stereo camera and an uncooperative target satellite.<\/p>\r\n<p style=\"text-align: center\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/Vision-based_overview.png\" alt=\"\" width=\"600\" height=\"387\" class=\"alignnone wp-image-666 aligncenter\"> Experimental setup used to validate neural networks for proximity navigation between satellites.<\/p>\r\n\r\n<div style=\"height: 30px\"><\/div>\r\n<p style=\"text-align: left\">Our research group is focused on the following activities:<\/p>\r\n\r\n<ol style=\"list-style-type: lower-roman\">\r\n \t<li style=\"list-style-type: none\">\r\n<ul style=\"list-style-type: disc\">\r\n \t<li style=\"text-align: left\">training of <strong>state-of-the-art CNNs<\/strong> (e.g., YOLOv7) with both datasets available on the web (pretraining with SPEED and\/or COCO) and two datasets, one for object detection and the other for segmentation, realized in laboratory using the facility SPARTANS and data augmentation methods;<\/li>\r\n \t<li style=\"text-align: left\">Development and use of <strong>Image Analysis algorithms<\/strong> (e.g., ORB) for key point detection and relative pose estimation between uncooperative satellites;<\/li>\r\n \t<li style=\"text-align: left\">Test and validation of <strong>Object Detection and Segmentation CNNs<\/strong> using the representative facility SPARTANS with a 2 unit cubesat target mockup and a chaser mockup.<\/li>\r\n<\/ul>\r\n<\/li>\r\n<\/ol>\r\n<ol style=\"list-style-type: lower-roman\"><\/ol>\r\n<p style=\"text-align: center\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/Vision-based_ROI.png\" alt=\"\" width=\"639\" height=\"253\" class=\"alignnone wp-image-668 aligncenter\">\r\n(LEFT) the target satellite mock-up identified by the CNN (violet box) with key-points (red crosses) used for relative motion estimation. The ROI, the violet box, is the output of the object detection task. (RIGHT): output of the segmentation task for recognizing the target mock-up contour.<\/p>\r\n\r\n<div style=\"height: 30px\"><\/div>\r\n<div style=\"width: 1920px;\" class=\"wp-video\"><video class=\"wp-video-shortcode\" id=\"video-557-1\" width=\"1920\" height=\"1080\" autoplay preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/vision-based-video1.mp4?_=1\" \/><a href=\"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/vision-based-video1.mp4\">https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/vision-based-video1.mp4<\/a><\/video><\/div>\r\n\r\n<div style=\"width: 1920px;\" class=\"wp-video\"><video class=\"wp-video-shortcode\" id=\"video-557-2\" width=\"1920\" height=\"1080\" autoplay preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/vision-based-video2.mp4?_=2\" \/><a href=\"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/vision-based-video2.mp4\">https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/vision-based-video2.mp4<\/a><\/video><\/div>\r\n\r\n<div style=\"width: 1920px;\" class=\"wp-video\"><video class=\"wp-video-shortcode\" id=\"video-557-3\" width=\"1920\" height=\"1080\" autoplay preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/vision-based-video3.mp4?_=3\" \/><a href=\"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/vision-based-video3.mp4\">https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/vision-based-video3.mp4<\/a><\/video><\/div>\r\n\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>","protected":false},"excerpt":{"rendered":"<p>Vision-based proximity navigation between satellites In recent years, there has been an increasing interest in utilizing Artificial Intelligence algorithms for space applications. Among the spectrum of Machine Learning techniques available, Convolutional Neural Networks (CNNs) emerge as a well-suited deep learning approach for optimizing Guidance, Navigation, and Control systems during close-proximity operations between satellites.&nbsp; Our research&hellip; <br \/> <a class=\"read-more\" href=\"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/\">Leggi tutto<\/a><\/p>\n","protected":false},"author":134,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"pro\/page-templates\/full-width-page.php","meta":{"ngg_post_thumbnail":0,"footnotes":""},"folder":[],"class_list":["post-557","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Vision-based Navigation - MTS<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/\" \/>\n<meta property=\"og:locale\" content=\"it_IT\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Vision-based Navigation - MTS\" \/>\n<meta property=\"og:description\" content=\"Vision-based proximity navigation between satellites In recent years, there has been an increasing interest in utilizing Artificial Intelligence algorithms for space applications. Among the spectrum of Machine Learning techniques available, Convolutional Neural Networks (CNNs) emerge as a well-suited deep learning approach for optimizing Guidance, Navigation, and Control systems during close-proximity operations between satellites.&nbsp; Our research&hellip; Leggi tutto\" \/>\n<meta property=\"og:url\" content=\"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/\" \/>\n<meta property=\"og:site_name\" content=\"MTS\" \/>\n<meta property=\"article:modified_time\" content=\"2024-07-05T09:33:59+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/Vision-based_overview.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Tempo di lettura stimato\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minuti\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/vision-based-navigation\\\/\",\"url\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/vision-based-navigation\\\/\",\"name\":\"Vision-based Navigation - MTS\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/vision-based-navigation\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/vision-based-navigation\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/wp-content\\\/uploads\\\/sites\\\/93\\\/2024\\\/02\\\/Vision-based_overview.png\",\"datePublished\":\"2023-12-19T09:10:29+00:00\",\"dateModified\":\"2024-07-05T09:33:59+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/vision-based-navigation\\\/#breadcrumb\"},\"inLanguage\":\"it-IT\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/vision-based-navigation\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"it-IT\",\"@id\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/vision-based-navigation\\\/#primaryimage\",\"url\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/wp-content\\\/uploads\\\/sites\\\/93\\\/2024\\\/02\\\/Vision-based_overview.png\",\"contentUrl\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/wp-content\\\/uploads\\\/sites\\\/93\\\/2024\\\/02\\\/Vision-based_overview.png\",\"width\":1273,\"height\":822},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/vision-based-navigation\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Vision-based Navigation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/#website\",\"url\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/\",\"name\":\"MTS\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/research.dii.unipd.it\\\/mts\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"it-IT\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Vision-based Navigation - MTS","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/","og_locale":"it_IT","og_type":"article","og_title":"Vision-based Navigation - MTS","og_description":"Vision-based proximity navigation between satellites In recent years, there has been an increasing interest in utilizing Artificial Intelligence algorithms for space applications. Among the spectrum of Machine Learning techniques available, Convolutional Neural Networks (CNNs) emerge as a well-suited deep learning approach for optimizing Guidance, Navigation, and Control systems during close-proximity operations between satellites.&nbsp; Our research&hellip; Leggi tutto","og_url":"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/","og_site_name":"MTS","article_modified_time":"2024-07-05T09:33:59+00:00","og_image":[{"url":"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/Vision-based_overview.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Tempo di lettura stimato":"2 minuti"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/","url":"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/","name":"Vision-based Navigation - MTS","isPartOf":{"@id":"https:\/\/research.dii.unipd.it\/mts\/#website"},"primaryImageOfPage":{"@id":"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/#primaryimage"},"image":{"@id":"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/#primaryimage"},"thumbnailUrl":"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/Vision-based_overview.png","datePublished":"2023-12-19T09:10:29+00:00","dateModified":"2024-07-05T09:33:59+00:00","breadcrumb":{"@id":"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/#breadcrumb"},"inLanguage":"it-IT","potentialAction":[{"@type":"ReadAction","target":["https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/"]}]},{"@type":"ImageObject","inLanguage":"it-IT","@id":"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/#primaryimage","url":"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/Vision-based_overview.png","contentUrl":"https:\/\/research.dii.unipd.it\/mts\/wp-content\/uploads\/sites\/93\/2024\/02\/Vision-based_overview.png","width":1273,"height":822},{"@type":"BreadcrumbList","@id":"https:\/\/research.dii.unipd.it\/mts\/vision-based-navigation\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/research.dii.unipd.it\/mts\/"},{"@type":"ListItem","position":2,"name":"Vision-based Navigation"}]},{"@type":"WebSite","@id":"https:\/\/research.dii.unipd.it\/mts\/#website","url":"https:\/\/research.dii.unipd.it\/mts\/","name":"MTS","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/research.dii.unipd.it\/mts\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"it-IT"}]}},"_links":{"self":[{"href":"https:\/\/research.dii.unipd.it\/mts\/wp-json\/wp\/v2\/pages\/557","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/research.dii.unipd.it\/mts\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/research.dii.unipd.it\/mts\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/research.dii.unipd.it\/mts\/wp-json\/wp\/v2\/users\/134"}],"replies":[{"embeddable":true,"href":"https:\/\/research.dii.unipd.it\/mts\/wp-json\/wp\/v2\/comments?post=557"}],"version-history":[{"count":27,"href":"https:\/\/research.dii.unipd.it\/mts\/wp-json\/wp\/v2\/pages\/557\/revisions"}],"predecessor-version":[{"id":740,"href":"https:\/\/research.dii.unipd.it\/mts\/wp-json\/wp\/v2\/pages\/557\/revisions\/740"}],"wp:attachment":[{"href":"https:\/\/research.dii.unipd.it\/mts\/wp-json\/wp\/v2\/media?parent=557"}],"wp:term":[{"taxonomy":"folder","embeddable":true,"href":"https:\/\/research.dii.unipd.it\/mts\/wp-json\/wp\/v2\/folder?post=557"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}