{"id":111,"date":"2020-08-17T11:42:59","date_gmt":"2020-08-17T14:42:59","guid":{"rendered":"http:\/\/www.cemeai.icmc.usp.br\/4EABDA\/?page_id=111"},"modified":"2021-07-26T11:51:34","modified_gmt":"2021-07-26T14:51:34","slug":"curso-6","status":"publish","type":"page","link":"https:\/\/cemeai.icmc.usp.br\/5EABDA\/curso-6\/","title":{"rendered":"Curso VI"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-page\" data-elementor-id=\"111\" class=\"elementor elementor-111\" data-elementor-settings=\"[]\">\n\t\t\t\t\t\t\t<div class=\"elementor-section-wrap\">\n\t\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-3ed9e55 elementor-section-full_width elementor-hidden-phone elementor-section-height-default elementor-section-height-default\" data-id=\"3ed9e55\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-no\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-eb25f85\" data-id=\"eb25f85\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-79e06dc elementor-widget elementor-widget-edu-featured-slider\" data-id=\"79e06dc\" data-element_type=\"widget\" data-widget_type=\"edu-featured-slider.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\r\n        <div class=\"feature-slides-wrapper feature-slick-slider\" >\r\n            <div class=\"feature-slider slider-6ae7b8d9977a4\" data-animation=\"up\">\r\n\t\t\t\t<div class=\"elementor-repeater-item-b159737 slick-slide\"><div class=\"feature-slide-bg\"><\/div><div  class=\"feature-slide-inner\"><div class=\"feature-slide-content animated fadeInUp\"><h2 class=\"feature-slide-heading\">Curso VI<\/h2><p class=\"feature-slide-description\">Processamento de Linguagem Natural usando Aprendizado Profundo<\/p><\/div><\/div><\/div>            <\/div>\r\n        <\/div>\r\n        <script type=\"text\/javascript\">\r\n            (function($) {\r\n                \"use strict\";\r\n \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0$('.slider-6ae7b8d9977a4').slick({    \r\n                          \r\n                                    });\r\n            })(jQuery);\r\n        <\/script>\r\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-150722e elementor-widget-divider--view-line elementor-widget elementor-widget-divider\" data-id=\"150722e\" data-element_type=\"widget\" data-widget_type=\"divider.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-divider\">\n\t\t\t<span class=\"elementor-divider-separator\">\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-d413fe1 elementor-section-full_width elementor-hidden-desktop elementor-hidden-tablet elementor-section-height-default elementor-section-height-default\" data-id=\"d413fe1\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-no\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-0f77681\" data-id=\"0f77681\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-b8d828c elementor-widget elementor-widget-edu-featured-slider\" data-id=\"b8d828c\" data-element_type=\"widget\" data-widget_type=\"edu-featured-slider.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\r\n        <div class=\"feature-slides-wrapper feature-slick-slider\" >\r\n            <div class=\"feature-slider slider-6ae7b8d99a972\" data-animation=\"up\">\r\n\t\t\t\t<div class=\"elementor-repeater-item-b159737 slick-slide\"><div class=\"feature-slide-bg\"><\/div><div  class=\"feature-slide-inner\"><div class=\"feature-slide-content animated fadeInUp\"><h2 class=\"feature-slide-heading\">Curso VI<\/h2><p class=\"feature-slide-description\">Processamento de Linguagem Natural usando Aprendizado Profundo<\/p><\/div><\/div><\/div>            <\/div>\r\n        <\/div>\r\n        <script type=\"text\/javascript\">\r\n            (function($) {\r\n                \"use strict\";\r\n \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0$('.slider-6ae7b8d99a972').slick({    \r\n                          \r\n                                    });\r\n            })(jQuery);\r\n        <\/script>\r\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5e3b8e9 elementor-widget-divider--view-line elementor-widget elementor-widget-divider\" data-id=\"5e3b8e9\" data-element_type=\"widget\" data-widget_type=\"divider.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<div class=\"elementor-divider\">\n\t\t\t<span class=\"elementor-divider-separator\">\n\t\t\t\t\t\t<\/span>\n\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-332ae7ca elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"332ae7ca\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-23c2b954\" data-id=\"23c2b954\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t\t\t<div class=\"elementor-element elementor-element-1c26bb50 elementor-widget elementor-widget-text-editor\" data-id=\"1c26bb50\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<!-- wp:shortcode -->\n<p><strong>Ministrante:<\/strong> Rodrigo Frassetto Nogueira<\/p>\n<p><strong>Resumo:<\/strong> Modelos de aprendizado profundo s\u00e3o hoje o estado da arte em diversas tarefas de processamento de linguagem natural como tradu\u00e7\u00e3o, sumariza\u00e7\u00e3o, busca, e sistemas de perguntas e respostas. Este curso abordar\u00e1 os principais conceitos consolidados na \u00e1rea, como word embeddings, modelos seq2seq, modelos de aten\u00e7\u00e3o, transformers e BERT.<\/p>\n<p><strong>Conte\u00fado:<\/strong> Neste minicurso aprenderemos de onde esses modelos vieram, como funcionam e como adapt\u00e1-los para tarefas em Portugu\u00eas. Ao final, demonstraremos como treinar um modelo de tradu\u00e7\u00e3o Ingl\u00eas-Portugu\u00eas com desempenho compar\u00e1vel ao do Google Translate.<\/p>\n<p><strong>Refer\u00eancias:<\/strong><\/p>\n<p>Bengio, Yoshua, R\u00e9jean Ducharme, and Pascal Vincent. &#8220;A neural probabilistic language model.&#8221; Advances in Neural Information Processing Systems. 2001.<\/p>\n<p>Mikolov, Tomas, et al. &#8220;Distributed representations of words and phrases and their compositionality.&#8221; Advances in neural information processing systems. 2013.<\/p>\n<p>Vaswani, Ashish, et al. &#8220;Attention is all you need.&#8221; Advances in neural information processing systems. 2017.<\/p>\n<p>Devlin, Jacob, et al. &#8220;BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.&#8221; NAACL-HLT (1). 2019.<\/p>\n<p>Raffel, Colin, et al. &#8220;Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer.&#8221; Journal of Machine Learning Research 21 (2020): 1-67.<\/p>\n<p><strong>Mini-CV:<\/strong><\/p>\n<p><strong>Rodrigo Frassetto Nogueira<\/strong> possui doutorado pela Universidade de Nova York (NYU), onde trabalhou na interse\u00e7\u00e3o de Deep Learning, PLN e sistemas de busca. Possui gradua\u00e7\u00e3o e mestrado pela UNICAMP. \u00c9 co-autor do livro &#8220;Pretrained Transformers for Text Ranking: BERT and Beyond&#8221;. \u00c9 atualmente professor adjunto na UNICAMP, p\u00f3s-doutorando na Universidade de Waterloo e cientista chefe na NeuralMind.<\/p>\n<!-- \/wp:shortcode -->\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Curso VI Processamento de Linguagem Natural usando Aprendizado Profundo Curso VI Processamento de Linguagem Natural usando Aprendizado Profundo<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"elementor_header_footer","meta":{"footnotes":""},"class_list":["post-111","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/cemeai.icmc.usp.br\/5EABDA\/wp-json\/wp\/v2\/pages\/111","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cemeai.icmc.usp.br\/5EABDA\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/cemeai.icmc.usp.br\/5EABDA\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/cemeai.icmc.usp.br\/5EABDA\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cemeai.icmc.usp.br\/5EABDA\/wp-json\/wp\/v2\/comments?post=111"}],"version-history":[{"count":6,"href":"https:\/\/cemeai.icmc.usp.br\/5EABDA\/wp-json\/wp\/v2\/pages\/111\/revisions"}],"predecessor-version":[{"id":176,"href":"https:\/\/cemeai.icmc.usp.br\/5EABDA\/wp-json\/wp\/v2\/pages\/111\/revisions\/176"}],"wp:attachment":[{"href":"https:\/\/cemeai.icmc.usp.br\/5EABDA\/wp-json\/wp\/v2\/media?parent=111"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}