TY - GEN
T1 - A Gentle Introduction to Deep Nets and Opportunities for the Future
AU - Church, Kenneth
AU - Kordoni, Valia
AU - Marcus, Gary
AU - Davis, Ernest
AU - Ma, Yanjun
AU - Chen, Zeyu
N1 - Publisher Copyright:
© 2022 Proceedings of the Annual Meeting of the Association for Computational Linguistics. All rights reserved.
PY - 2022
Y1 - 2022
N2 - The first half of this tutorial will make deep nets more accessible to a broader audience, following “Deep Nets for Poets” and “A Gentle Introduction to Fine-Tuning.” We will also introduce, gft (general fine tuning), a little language for fine tuning deep nets with short (one line) programs that are as easy to code as regression in statistics packages such as R using glm (general linear models). Based on the success of these methods on a number of benchmarks, one might come away with the impression that deep nets are all we need. However, we believe the glass is half-full: while there is much that can be done with deep nets, there is always more to do. The second half of this tutorial will discuss some of these opportunities.
AB - The first half of this tutorial will make deep nets more accessible to a broader audience, following “Deep Nets for Poets” and “A Gentle Introduction to Fine-Tuning.” We will also introduce, gft (general fine tuning), a little language for fine tuning deep nets with short (one line) programs that are as easy to code as regression in statistics packages such as R using glm (general linear models). Based on the success of these methods on a number of benchmarks, one might come away with the impression that deep nets are all we need. However, we believe the glass is half-full: while there is much that can be done with deep nets, there is always more to do. The second half of this tutorial will discuss some of these opportunities.
UR - http://www.scopus.com/inward/record.url?scp=85136106313&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85136106313&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85136106313
T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics
SP - 1
EP - 6
BT - ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics, Tutorial Abstracts
A2 - Benotti, Luciana
A2 - Okazaki, Naoaki
A2 - Scherrer, Yves
A2 - Zampieri, Marcos
PB - Association for Computational Linguistics (ACL)
T2 - 60th Annual Meeting of the Association for Computational Linguistics, ACL 2022
Y2 - 22 May 2022 through 27 May 2022
ER -