{"id":13437,"date":"2022-06-22T16:03:21","date_gmt":"2022-06-22T08:03:21","guid":{"rendered":"https:\/\/virtual.math.ntnu.edu.tw\/?p=13437"},"modified":"2022-07-04T15:27:06","modified_gmt":"2022-07-04T07:27:06","slug":"1-192","status":"publish","type":"post","link":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/2022\/06\/22\/1-192\/","title":{"rendered":"<span style=\"color:#3566BD\">[\u5c08\u984c\u6f14\u8b1b] <\/span>\u30107\u67085\u65e5\u3011\u6cd5\u570b\u683c\u52d2\u8afe\u8c9d\u723e-\u963f\u723e\u5351\u65af\u5927\u5b78 \u8b1d\u5b87\u89c0\u535a\u58eb\u5019\u9078\u4eba"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"13437\" class=\"elementor elementor-13437\">\n\t\t\t\t\t\t<div class=\"elementor-inner\">\n\t\t\t\t<div class=\"elementor-section-wrap\">\n\t\t\t\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-4b425d5 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"4b425d5\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t\t\t<div class=\"elementor-row\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-67443e8\" data-id=\"67443e8\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-column-wrap elementor-element-populated\">\n\t\t\t\t\t\t\t<div class=\"elementor-widget-wrap\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7f8202a elementor-widget elementor-widget-text-editor\" data-id=\"7f8202a\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t<div class=\"elementor-text-editor elementor-clearfix\">\n\t\t\t\t<p><strong>Speaker:<\/strong> \u8b1d\u5b87\u89c0 (Yu-Guan Hsieh)\u535a\u58eb\u5019\u9078\u4eba (\u6cd5\u570b\u683c\u52d2\u8afe\u8c9d\u723e-\u963f\u723e\u5351\u65af\u5927\u5b78, University of Grenoble Alpes, France)<\/p><p>\u5c08\u9577: Online learning, Distributed optimization, Learning in games<\/p><p>\u500b\u4eba\u7db2\u7ad9:<br \/><span style=\"color: #0000ff;\"><a style=\"color: #0000ff;\" href=\"https:\/\/www.cyber-meow.com\/\" target=\"_blank\" rel=\"noopener\">https:\/\/www.cyber-meow.com\/<\/a><\/span><\/p><p><strong>Title:<\/strong> Anticipating the future for better performance: Optimistic gradient algorithms for learning in games<\/p><p><strong>Abstract:<\/strong><br \/>Recent advances in machine learning have called for the need for optimization beyond the minimization of a single loss function. This includes, for example, multi-agent reinforcement learning and the training of generative adversarial networks. In these problems, multiple learners are \u200cin competition or in collaboration, and the \u201csolution\u201d of the problem can often be encoded by the equilibrium of a game. Meanwhile, the interplay between the dynamic and the static solution concepts of games has been an intriguing problem in the field of game theory for decades, and the study of various learning-in-game dynamics has particularly gained popularity in the past few years.<\/p><p>In this talk, we will focus on optimistic gradient descent, a family of algorithms that equip the vanilla gradient method with a look-ahead step. It inherits many nice properties from extra-gradient \u2014 its two-call variant \u2014 and in particular resolves the non-convergence behavior of the vanilla gradient method in bilinear games (i.e. min_{x} max_{y} xy). We will provide intuition, discuss convergence guarantees, and look into the stochastic and adaptive variants of the method that can be applied in more realistic scenarios.<\/p><p><img loading=\"lazy\" class=\"aligncenter wp-image-13440\" src=\"https:\/\/virtual.math.ntnu.edu.tw\/wp-content\/uploads\/2022\/06\/1110705\u6f14\u8b1b\u5167\u5bb9\u63d2\u5716-1024x1024.jpg\" alt=\"\" width=\"640\" height=\"640\" srcset=\"https:\/\/virtual.math.ntnu.edu.tw\/wp-content\/uploads\/2022\/06\/1110705\u6f14\u8b1b\u5167\u5bb9\u63d2\u5716-1024x1024.jpg 1024w, https:\/\/virtual.math.ntnu.edu.tw\/wp-content\/uploads\/2022\/06\/1110705\u6f14\u8b1b\u5167\u5bb9\u63d2\u5716-300x300.jpg 300w, https:\/\/virtual.math.ntnu.edu.tw\/wp-content\/uploads\/2022\/06\/1110705\u6f14\u8b1b\u5167\u5bb9\u63d2\u5716-150x150.jpg 150w, https:\/\/virtual.math.ntnu.edu.tw\/wp-content\/uploads\/2022\/06\/1110705\u6f14\u8b1b\u5167\u5bb9\u63d2\u5716-768x768.jpg 768w, https:\/\/virtual.math.ntnu.edu.tw\/wp-content\/uploads\/2022\/06\/1110705\u6f14\u8b1b\u5167\u5bb9\u63d2\u5716-1536x1536.jpg 1536w, https:\/\/virtual.math.ntnu.edu.tw\/wp-content\/uploads\/2022\/06\/1110705\u6f14\u8b1b\u5167\u5bb9\u63d2\u5716.jpg 2000w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/p><p><strong>Date:<\/strong> Tuesday, July 5, 2022<\/p><p><strong>Time:<\/strong>\u00a014:00-15:00<\/p><p><strong>Venue:<\/strong> M212<\/p><p><strong>Refreshment:<\/strong> 13:30-14:00, M104<\/p><p>\u672c\u6f14\u8b1b\u4ea6\u53ef\u7dda\u4e0a\u53c3\u52a0<\/p><p><span style=\"color: #0000ff;\"><a style=\"color: #0000ff;\" href=\"https:\/\/meet.google.com\/fww-nkka-pny\" target=\"_blank\" rel=\"noopener\">https:\/\/meet.google.com\/fww-nkka-pny<\/a><\/span><\/p>\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<p class=\"wpf_wrapper\"><a class=\"print_link\" href=\"\" target=\"_blank\">\u53cb\u5584\u5217\u5370<\/a><\/p><!-- .wpf_wrapper -->","protected":false},"excerpt":{"rendered":"<p>Speaker: \u8b1d\u5b87\u89c0 (Yu-Guan Hsieh)\u535a\u58eb\u5019\u9078\u4eba (\u6cd5\u570b\u683c\u52d2\u8afe\u8c9d\u723e-\u963f\u723e\u5351\u65af\u5927\u5b78, Univ [&hellip;]<\/p>\n","protected":false},"author":9,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1,124,64],"tags":[],"_links":{"self":[{"href":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/wp-json\/wp\/v2\/posts\/13437"}],"collection":[{"href":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/wp-json\/wp\/v2\/comments?post=13437"}],"version-history":[{"count":12,"href":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/wp-json\/wp\/v2\/posts\/13437\/revisions"}],"predecessor-version":[{"id":13545,"href":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/wp-json\/wp\/v2\/posts\/13437\/revisions\/13545"}],"wp:attachment":[{"href":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/wp-json\/wp\/v2\/media?parent=13437"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/wp-json\/wp\/v2\/categories?post=13437"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/virtual.math.ntnu.edu.tw\/index.php\/wp-json\/wp\/v2\/tags?post=13437"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}