{"id":4404,"date":"2021-11-29T17:00:00","date_gmt":"2021-11-29T17:00:00","guid":{"rendered":"https:\/\/www.lasar.polimi.it\/?p=4404"},"modified":"2023-01-12T17:07:33","modified_gmt":"2023-01-12T17:07:33","slug":"new-publication-2","status":"publish","type":"post","link":"https:\/\/www.lasar.polimi.it\/?p=4404","title":{"rendered":"New Publication!"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><strong>New Publication!<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Title:&nbsp;<\/strong>Optimization of the Operation and Maintenance of renewable energy systems by Deep Reinforcement Learning<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Journal:&nbsp;<\/strong>Renewable Energy<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Authors:&nbsp;<\/strong>Luca Pinciroli, Piero Baraldi, Guido Ballabio, Michele Compare, Enrico Zio<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Citation<\/strong>:&nbsp;Pinciroli, L.; Baraldi, P.; Ballabio, G.; Compare, M.; Zio, E. Optimization of the Operation and Maintenance of renewable energy systems by Deep Reinforcement Learning.&nbsp;Renewable&nbsp;Energy&nbsp;2022,&nbsp;183, 752-763. https:\/\/doi.org\/10.1016\/j.renene.2021.11.052<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This is an open-access article that can be downloaded from the following link before Jan 14, 2022:&nbsp;<a href=\"https:\/\/authors.elsevier.com\/a\/1e8OO3QJ-dhrWR\">https:\/\/authors.elsevier.com\/a\/1e8OO3QJ-dhrWR<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Abstract:<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Equipment of renewable energy systems are being supported by Prognostics &amp; Health Management (PHM) capabilities to estimate their current health state and predict their Remaining Useful Life (RUL). The PHM health state estimates and RUL predictions can be used for the optimization of the systems Operation and Maintenance (O&amp;M). This is an ambitious and challenging task, which requires to consider many factors, including the availability of maintenance crews, the variability of energy demand and production, the influence of the operating conditions on equipment performance and degradation and the long time horizons of renewable energy systems usage. We develop a novel formulation of the O&amp;M optimization as a sequential decision problem and we resort to Deep Reinforcement Learning (DRL) to solve it. The proposed solution approach combines proximal policy optimization, imitation learning, for pre-training the learning agent, and a model of the environment which describes the renewable energy system behavior. The solution approach is tested by its application to a wind farm O&amp;M problem. The optimal solution found is shown to outperform those provided by other DRL algorithms. Also, the approach does not require to select a-priori a maintenance strategy, but, rather, it discovers the best performing policy by itself.<\/p>\n<div class=\"pvc_clear\"><\/div><p id=\"pvc_stats_4404\" class=\"pvc_stats all  \" data-element-id=\"4404\" style=\"\"><i class=\"pvc-stats-icon medium\" aria-hidden=\"true\"><svg aria-hidden=\"true\" focusable=\"false\" data-prefix=\"far\" data-icon=\"chart-bar\" role=\"img\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\" class=\"svg-inline--fa fa-chart-bar fa-w-16 fa-2x\"><path fill=\"currentColor\" d=\"M396.8 352h22.4c6.4 0 12.8-6.4 12.8-12.8V108.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v230.4c0 6.4 6.4 12.8 12.8 12.8zm-192 0h22.4c6.4 0 12.8-6.4 12.8-12.8V140.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v198.4c0 6.4 6.4 12.8 12.8 12.8zm96 0h22.4c6.4 0 12.8-6.4 12.8-12.8V204.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v134.4c0 6.4 6.4 12.8 12.8 12.8zM496 400H48V80c0-8.84-7.16-16-16-16H16C7.16 64 0 71.16 0 80v336c0 17.67 14.33 32 32 32h464c8.84 0 16-7.16 16-16v-16c0-8.84-7.16-16-16-16zm-387.2-48h22.4c6.4 0 12.8-6.4 12.8-12.8v-70.4c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v70.4c0 6.4 6.4 12.8 12.8 12.8z\" class=\"\"><\/path><\/svg><\/i> <img loading=\"lazy\" decoding=\"async\" width=\"16\" height=\"16\" alt=\"Loading\" src=\"https:\/\/www.lasar.polimi.it\/wp-content\/plugins\/page-views-count\/ajax-loader-2x.gif\" border=0 \/><\/p><div class=\"pvc_clear\"><\/div>","protected":false},"excerpt":{"rendered":"<p>New Publication! Title:&nbsp;Optimization of the Operation and Maintenance of renewable energy systems by Deep Reinforcement Learning Journal:&nbsp;Renewable Energy Authors:&nbsp;Luca Pinciroli, Piero Baraldi, Guido Ballabio, Michele Compare, Enrico Zio Citation:&nbsp;Pinciroli, L.; Baraldi, P.; Ballabio, G.; Compare, M.; Zio, E. Optimization of the Operation and Maintenance of renewable energy systems by Deep [&hellip;]<\/p>\n<div class=\"pvc_clear\"><\/div>\n<p id=\"pvc_stats_4404\" class=\"pvc_stats all  \" data-element-id=\"4404\" style=\"\"><i class=\"pvc-stats-icon medium\" aria-hidden=\"true\"><svg aria-hidden=\"true\" focusable=\"false\" data-prefix=\"far\" data-icon=\"chart-bar\" role=\"img\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 512 512\" class=\"svg-inline--fa fa-chart-bar fa-w-16 fa-2x\"><path fill=\"currentColor\" d=\"M396.8 352h22.4c6.4 0 12.8-6.4 12.8-12.8V108.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v230.4c0 6.4 6.4 12.8 12.8 12.8zm-192 0h22.4c6.4 0 12.8-6.4 12.8-12.8V140.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v198.4c0 6.4 6.4 12.8 12.8 12.8zm96 0h22.4c6.4 0 12.8-6.4 12.8-12.8V204.8c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v134.4c0 6.4 6.4 12.8 12.8 12.8zM496 400H48V80c0-8.84-7.16-16-16-16H16C7.16 64 0 71.16 0 80v336c0 17.67 14.33 32 32 32h464c8.84 0 16-7.16 16-16v-16c0-8.84-7.16-16-16-16zm-387.2-48h22.4c6.4 0 12.8-6.4 12.8-12.8v-70.4c0-6.4-6.4-12.8-12.8-12.8h-22.4c-6.4 0-12.8 6.4-12.8 12.8v70.4c0 6.4 6.4 12.8 12.8 12.8z\" class=\"\"><\/path><\/svg><\/i> <img loading=\"lazy\" decoding=\"async\" width=\"16\" height=\"16\" alt=\"Loading\" src=\"https:\/\/www.lasar.polimi.it\/wp-content\/plugins\/page-views-count\/ajax-loader-2x.gif\" border=0 \/><\/p>\n<div class=\"pvc_clear\"><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-4404","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"a3_pvc":{"activated":true,"total_views":24,"today_views":0},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/www.lasar.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/4404","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.lasar.polimi.it\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.lasar.polimi.it\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.lasar.polimi.it\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.lasar.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4404"}],"version-history":[{"count":1,"href":"https:\/\/www.lasar.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/4404\/revisions"}],"predecessor-version":[{"id":4405,"href":"https:\/\/www.lasar.polimi.it\/index.php?rest_route=\/wp\/v2\/posts\/4404\/revisions\/4405"}],"wp:attachment":[{"href":"https:\/\/www.lasar.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4404"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.lasar.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4404"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.lasar.polimi.it\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4404"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}