NeuralGen Workshop @NeuralGen
Workshop on Methods for Optimizing and Evaluating Neural Language Generation (NeuralGen). To be held @NAACLHLT 2019 on June 6, 2019 neuralgen.io Minneapolis, MN Joined December 2018-
Tweets102
-
Followers590
-
Following262
-
Likes88
at @NeuralGen panel, I mentioned in the 80s, Joshi & Webber wrote abt ethics NLG, per the image, but couldn't remember cite & promised to tweet it's here: aclweb.org/anthology/P84-… (& sorry Ralph for forgetting you!) i learned about this from Smiley et al aclweb.org/anthology/pape…
@NeuralGen @NAACLHLT thanks for inviting me! talk was covering joint work with @raosudha89, Trista Cao, Sean Welleck, @xkianteb and @kchonyc.... who all did all the hard work!
.@NeuralGen poster session: @mdigangiPA presenting a new method for augmenting training data for neural text simplification using weak supervision @DH_FBK @ziorufus @sara_hlt @Turchi_Marco @negri_teo @mdigangiPA #NeuralGen2019
And this is the end of #neuralgen2019 at #naacl2019 Thanks to all speakers, authors, organizer, reviewers, live-tweeters and... our great audience! 👏 Check the other exciting events coming in the field of language generation👇
Pretrained large language models (GPT-2, BERT, etc) are going to make it easier to work on some exiting things that were previously inaccessible or too expensive. But we don’t really know what’s in them or how much prejudicial bias they contain.
Only 30% of audience at natural language generation workshop admit to taking an ethics course. Shocked. Don’t undergrad CS degree programs require a general ethics course? (tho most general undergrad CS courses are not very good to begin with)
Graham recommends that everyone read The ethics of persuasion. Sasha: we should have concensus in the community and not simply listen to what companies say
Join us for an amazing panel @NeuralGen workshop
Graham asks audience how many people took ethics classes. 3% say yes. Graham: Well that's the problem. On point!
#NeuralGen2019 panel topic switching to ethics. Yejin: to study fake news detection, we need to study fake news generation.
Yejin Choi (@YejinChoinka) about pretraining at the #NeuralGen2019 panel: in Academia we are just waiting around until companies give us the next sesame street character. They should just give us more GPUs and TPUs! #NAACL2019
Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-science
Sebastian Gehrmann @sebgehr
5K Followers 2K Following Head of NLP, CTO office, @Bloomberg. (he/him) Generating natural language, one word at a time. Also making sense of that language afterwards. views my own
clem 🤗 @ClementDelangue
91K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI builders
Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).
Sebastian Ruder @seb_ruder
80K Followers 1K Following Multilingual LLMs @cohere • Prev: @GoogleDeepMind • Newsletter: https://t.co/7JGh2qpG98
Nouha Dziri @nouhadziri
3K Followers 676 Following Research Scientist @allen_ai / @ai2_mosaic, PhD in NLP/Dialogue 🤖 UofA. Ex Visiting researcher @Mila_Quebec Ex Research intern at @GoogleDeepMind @MSFTResearch
Tuhin Chakrabarty @TuhinChakr
2K Followers 622 Following Newly minted Ph.D. from @ColumbiaCompSci studying creativity. Ex affiliations: @GoogleDeepmind @SFResearch @allen_ai
Jacob Andreas @jacobandreas
14K Followers 958 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Leo Boytsov @srchvrs
7K Followers 2K Following Sr. Research Scientist @AWS Labs (ph-D @LTIatCMU) working on unnatural language processing, speaking πtorch & C++. Opinions sampled from MY OWN 100T param LM.
Julien Chaumond @julien_c
47K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique
Mikel Artetxe @artetxem
6K Followers 221 Following Co-founder @RekaAILabs and Honorary Researcher @IxaGroup (University of the Basque Country) | Past: Research Scientist @AIatMeta (FAIR)
LesleyMaugham @Pc8rJ5letVPaf9
0 Followers 186 Following
AdaHansom @R53EaSIAl6FD4m
1 Followers 249 Following
Levi | Take5 on AI @Take5_ai
50 Followers 144 Following Unlock AI’s potential with Take5: Tutorials, trends, and news all in one place
Muizz @muizzkhan77
38 Followers 1K Following
anas @anas0ra
2 Followers 188 Following
adanish @adanish65594148
91 Followers 3K Following Technology & Entrepreneurship - build & inspire orgs, Computing & Accelerators for DL, Transformers, Systems & Bioinformatics; https://t.co/9d6EbfWU1c
Brain🧠 @Moroccan_Rocket
255 Followers 750 Following Game recognize game, and you lookin kinda unfamiliar right now
Vishala Mishra @vishala_mishra
272 Followers 3K Following Physician and Clinical Informaticist interested in using data for health equity.
Josh @joshuarowe
881 Followers 855 Following
Marc Semper @marc_semper
44 Followers 500 Following
Simulated annealing @SimAnnealing
2 Followers 21 Following
adddddd @anandnew38
334 Followers 5K Following
researcher Gpt LLM @researchGptllm
235 Followers 4K Following
Haipeng Ruan @Wsycysdrhpa
5 Followers 102 Following
randcat @random_cat_dog
0 Followers 490 Following
孙兴 @Phasorhand
1 Followers 119 Following
aiwooo @aiwooo182156
2 Followers 42 Following
wenhao @dw3nhao
11 Followers 1K Following
time traveling sikkun.. @254c_remove
641 Followers 5K Following TIMEWAR GOT YOU FEELING WEAK? GET OUR FREE 30-DAY BEACH BODY BOOTCAMP NOW! MAKE THE DARK FOREST YOUR STAGE WITH A NEW TRANSFORMATION!
気持ちを言葉に.. @fggHrd86gKuj9cO
68 Followers 204 Following 気持ちを言葉にする練習用。自分のメモ用。鵜呑みにしないように。でも正しいことを言うようには気をつける
R @leartiemis
2 Followers 632 Following
Hayabuza2 @hayabuza_2
248 Followers 2K Following
Kshitiz @ksh_676
35 Followers 2K Following AI-dabbling CS undergrad, equation wrangler, espresso extractor.
Wenwen Tao @shirlytao
225 Followers 1K Following
Jovan Sardinha @JovanSardinha
364 Followers 3K Following Machine Learning @Reddit. Ex-@Quora, @UofT 🇨🇦 jovan.sardinha__at__gmail.com
deciphyre @deciphyre
78 Followers 101 Following Batman Fan || Amateur cook || Thinking of writing and sketching comics (still thinking) || sigh
Ritvik @innmetaverse
371 Followers 5K Following Perpetual learner :: Anti-social-introvert , Passionate about Sustainability,Climate Change :: learning and growing ;: I talk too machines often .
Nathan Fradet @NathanFradet
171 Followers 436 Following PhD candidate @Sorbonne_Univ_ @lip6_lab - Deep Learning, NLP, music generation
Saurabh Gayali @SaurabhGayali
296 Followers 1K Following Business Analyst, Excelra Tech | Former Research Scientist (NPDF) at CSIR-IGIB | Researcher | Illustrator-Graphic Artist | Musician
johnmendis @janu1701
18 Followers 712 Following
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K Following
Yann LeCun @ylecun
713K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Andrej Karpathy @karpathy
981K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
Sasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGz
AI at Meta @AIatMeta
533K Followers 256 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
François Chollet @fchollet
470K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.
Christopher Manning @chrmanning
127K Followers 116 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋
Andrew Ng @AndrewYNg
1.0M Followers 913 Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Richard Socher @RichardSocher
101K Followers 971 Following CEO @youSearchEngine Investing at @aixventuresHQ Before: Stanford Adj Prof in AI/NLP, Chief Scientist at Salesforce, MetaMind
Google DeepMind @GoogleDeepMind
945K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-science
Tal Linzen @tallinzen
16K Followers 894 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAI
Google AI @GoogleAI
2.2M Followers 23 Following Google AI is focused on bringing the benefits of AI to everyone. In conducting and applying our research, we advance the state-of-the-art in many domains.
Sam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Sebastian Gehrmann @sebgehr
5K Followers 2K Following Head of NLP, CTO office, @Bloomberg. (he/him) Generating natural language, one word at a time. Also making sense of that language afterwards. views my own
Yoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaC
Lianhui Qin @Lianhuiq
4K Followers 397 Following Incoming Assistant Professor at UCSD CSE. Currently postdoc at AI2 Mosaic. NLP, ML, AI. I’m recruiting PhD students.
Jianfeng Gao @JianfengGao0217
1K Followers 26 Following Distinguished Scientist & Vice President, Microsoft Research. IEEE Fellow.
Sean Welleck @wellecks
3K Followers 223 Following Assistant Professor at CMU. Marathoner, @thesisreview.
ε/ember manning @EmmaSManning
2K Followers 936 Following he/they. Linguist @ Google (opinions mine), NLG evaluation. Alt-text your images. 🏳️🌈🏳️⚧️ I'm not here anymore! Find me on Mastodon: @[email protected]
Dr. Erika Varis @ErikaVaris
952 Followers 479 Following the other kind of Dr., linguist, NLPer, machine learning practitioner, reader, geek, amateur foodie, mama, etc. She/Her. also on: [email protected]
Asad Sayeed @asayeed@.. @asayeed
2K Followers 833 Following Computational psycholinguist in @OfClasp, Senior Lecturer at the University of Gothenburg. Decided to become thought leader. Ready to lead your thoughts.
roeeaharoni @roeeaharoni
2K Followers 758 Following Research Scientist @GoogleAI Tel-Aviv | Phd @BIUNLP Lab
Yonatan Belinkov @boknilev
4K Followers 1K Following Assistant professor of computer science @TechnionLive. #NLProc
Tuhin Chakrabarty @TuhinChakr
2K Followers 622 Following Newly minted Ph.D. from @ColumbiaCompSci studying creativity. Ex affiliations: @GoogleDeepmind @SFResearch @allen_ai
Nazneen Rajani @nazneenrajani
4K Followers 2K Following Something new 🧪 | Previously: @huggingface 🤗, @SFResearch, PhD @utcompsci
Sudipta Kar @cryptexcode
323 Followers 470 Following Sr. Applied Scientist @Amazon AGI. 🇧🇩 Co-CTO @ReviewAcl. Music (metal) and NLP research. Opinions are my own.
Bashar Alhafni @balhafni
455 Followers 1K Following CS PhD student @nyuniversity. Previously: @Grammarly, @Dataminr, @USC_ISI
Lysandre @LysandreJik
7K Followers 582 Following Head of Open-Source at Hugging Face. Maintainer of 🤗/Transformers. I tweet about Open Source. He/him
Ahmad Rashid @ahmadrash
65 Followers 311 Following Machine Learning Research @UWaterloo and Noah's Ark, Huawei
HenryE @Henry_E__
2K Followers 1K Following Working on a bunch of random stuff at the moment Prev: Built a number of smart contracts on Solana using the anchor framework Prev: deep learning NLG PhD
Tatsunori Hashimoto @tatsu_hashimoto
6K Followers 202 Following Assistant Prof at Stanford CS, member of @stanfordnlp and statsml groups; Formerly at Microsoft / postdoc at Stanford CS / Stats.
Shaojie Jiang @Shaojie_Jiang
303 Followers 366 Following I am a Manager of AI at SKIM. I apply cutting-edge AI technology, such as chatbots, image understanding and generation, to Market Research.
MT Group at FBK @fbk_mt
1K Followers 457 Following #MachineTranslation Research Unit @FBK_research. #nlproc #deeplearning #ai
DH Group at FBK @DH_FBK
2K Followers 1K Following Digital Humanities Research Group at Fondazione Bruno Kessler
Aurélien Geron @aureliengeron
28K Followers 334 Following Author of the book Hands-On #MachineLearning with #ScikitLearn, #Keras and #TensorFlow. Former PM of #YouTube video classification. Founder of telco operator.
Braden Hancock @bradenjhancock
1K Followers 157 Following Machine learning researcher, developer, and entrepreneur. Co-Founder & Head of Technology at @SnorkelAI.
Thomas Viehmann @ThomasViehmann
5K Followers 0 Following Thunder at https://t.co/p7EZaYIpg1 Author of Deep Learning with PyTorch @[email protected]
Arash Eshghi @arash_eshghi
50 Followers 89 Following
Verena Rieser @verena_rieser
4K Followers 1K Following Researcher @DeepMind working on safer Conversational AI | Honorary Professor @HeriotWattUni | Co-founder @helloalana | mother of dragons | own opinions only
Andrew Trask @iamtrask
74K Followers 195 Following @openminedorg, @GoogleDeepMind ethics team, @OxfordUni phd candidate, @UN pet lab, @GovAI_, creator of #GrokkingDeepLearning, NALU, and sense2vec
Devi Parikh @deviparikh
23K Followers 151 Following Former Sr. Director, GenAI @Meta. Prof @GeorgiaTech. Generative artist https://t.co/z4n9IRQ3s5. Co-founded Caliper. @CarnegieMellon @RowanUniversity alum.
Amber Boydstun @ProfBoydstun
842 Followers 118 Following Professor @ucdavis, Visiting Fellow @hooverinst, data scientist, dogged optimist
Leo Boytsov @srchvrs
7K Followers 2K Following Sr. Research Scientist @AWS Labs (ph-D @LTIatCMU) working on unnatural language processing, speaking πtorch & C++. Opinions sampled from MY OWN 100T param LM.
Joel Grus 🤠 @joelgrus
17K Followers 919 Following engineering • ML • AI • NLP • author Data Science from Scratch • https://t.co/UJpCHsY5mM • I don't like notebooks • etc...
Christopher Potts @ChrisGPotts
11K Followers 620 Following Stanford Professor of Linguistics and, by courtesy, of Computer Science, and member of @stanfordnlp and @StanfordAILab. He/Him/His.
William Wang @WilliamWangNLP
14K Followers 720 Following UCSB NLP Lab + ML Center. https://t.co/6TOnqbk6YT https://t.co/KJYhnav3Et Mellichamp Chair Prof. at UCSB CS. PhD @ CMU SCS. Areas: #NLProc, Machine Learning, AI.
Julien Chaumond @julien_c
47K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @Polytechnique
12th INLG Conference @INLG2019
252 Followers 8 Following International conference on natural language generation
Brenden Lake @LakeBrenden
7K Followers 197 Following Associate Professor of Psychology and Data Science @ NYU. Co-Director of the NYU Minds, Brains, and Machines Initiative.
Shane Legg @ShaneLegg
51K Followers 58 Following Co-founder and Chief AGI Scientist, Google DeepMind
Demis Hassabis @demishassabis
357K Followers 126 Following Co-founder & CEO @GoogleDeepMind - working on AGI. Trying to understand the fundamental nature of reality. Also revolutionising drug discovery @IsomorphicLabs
TensorFlow @TensorFlow
378K Followers 117 Following TensorFlow is a fast, flexible, and scalable open-source machine learning library for research and production.
ICML Conference @icmlconf
70K Followers 17 Following Int'l Conf on ML • July 21-27, 2024 (Vienna, Austria) • #icml2024 • Contact: https://t.co/6saHKWV01y • https://t.co/6UpPvOXToj
WiML @WiMLworkshop
18K Followers 1K Following Women in Machine Learning organization. Maintains a list of women in ML. Profiles the research of women in ML. Annual workshop and other events.
NeurIPS Conference @NeurIPSConf
112K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].
Maarten Sap (he/him) @MaartenSap
5K Followers 645 Following Working on #NLProc for social good. Currently at @LTIatCMU, previously at @UWNLP, @MSFTResearch, and @allen_ai. 🏳🌈
Hanna Wallach (@hanna.. @hannawallach
22K Followers 944 Following Microsoft Research NYC. Fairness, accountability & transparency in AI/ML. NeurIPS & ICML board member, WiML co-founder, sloth enthusiast. She/her.at @NeuralGen panel, I mentioned in the 80s, Joshi & Webber wrote abt ethics NLG, per the image, but couldn't remember cite & promised to tweet it's here: aclweb.org/anthology/P84-… (& sorry Ralph for forgetting you!) i learned about this from Smiley et al aclweb.org/anthology/pape…
Hi all. I’ve posted my slides from my talk today dropbox.com/s/2o8enj7amaxx… Topics covered: (1) the potential benefits of narrative AI systems, (2) historical perspectives on story generation, (3) machine learning for story generation, (4) controlling neural text generation systems
I’ll be giving an invited talk Friday at the #NAACL2019 workshop on Narrative Understanding sites.google.com/view/narrative…
New slides: "Pretraining for Generation" at #neuralgen2019 bit.ly/2K3S14G … . Includes overview of methods and new gpt-2 experiments on "pseudo-self attention".pic.twitter.com/dZabLoJrf9 - x.com/srush_nlp/stat… #Analytics thanks @RichardEudes
New slides: "Pretraining for Generation" at #neuralgen2019 nlp.seas.harvard.edu/slides/Pre-tra… . Includes overview of methods and new gpt-2 experiments on "pseudo-self attention".
@_dmh @NeuralGen Yeah I realize this. Plus different standards around the world. Still, was expecting higher.
@mark_riedl @NeuralGen Also, not everyone in NLG comes from a CS background. Folks also might have had limited specific training (e.g. a workshop) as part of their professionalization rather than a full university course as a taught program.
.@NeuralGen poster session: @mdigangiPA presenting a new method for augmenting training data for neural text simplification using weak supervision @DH_FBK @ziorufus @sara_hlt @Turchi_Marco @negri_teo @mdigangiPA #NeuralGen2019
@NeuralGen @NAACLHLT thanks for inviting me! talk was covering joint work with @raosudha89, Trista Cao, Sean Welleck, @xkianteb and @kchonyc.... who all did all the hard work!
I wish I had time to read all the cool new NLP stuff. No one told me the PhD would get BUSIER the longer I threw my body against it.
Hal Daumé II talking about how you can generate language non-monotonically: instead of generating words from left-to-right, the model will generate words in arbitrary order and arrange them in sequences. Ex: arxiv.org/abs/1902.02192 #neuralgen2019 #naacl2019 @NAACLHLT
Thanks @NeuralGen organizers for the amazing workshop. That was super well managed with amazing speakers and topics. See you next year at the better named follow-up!
@mark_riedl Ah, apologies for the typo. Points stands, we should be near 100%
Pretrained large language models (GPT-2, BERT, etc) are going to make it easier to work on some exiting things that were previously inaccessible or too expensive. But we don’t really know what’s in them or how much prejudicial bias they contain.
Only 30% of audience at natural language generation workshop admit to taking an ethics course. Shocked. Don’t undergrad CS degree programs require a general ethics course? (tho most general undergrad CS courses are not very good to begin with)
Graham recommends that everyone read The ethics of persuasion. Sasha: we should have concensus in the community and not simply listen to what companies say
Join us for an amazing panel @NeuralGen workshop
Graham asks audience how many people took ethics classes. 3% say yes. Graham: Well that's the problem. On point!
#NeuralGen2019 panel topic switching to ethics. Yejin: to study fake news detection, we need to study fake news generation.
pretty exciting stuff
Now on with Yejin Choi's talk (@YejinChoinka) on language generation, fake news, large scale models & decoding: The Enigma of Neural Text Degeneration as the First Defense Against Neural Fake News Live tweet by @Tuhin66978276: x.com/tuhin66978276/… #neuralgen2019 #naacl2019
Yejin Choi (@YejinChoinka) about pretraining at the #NeuralGen2019 panel: in Academia we are just waiting around until companies give us the next sesame street character. They should just give us more GPUs and TPUs! #NAACL2019
Hard open challenges in natural language generation Tell... me... about... it...
Trends for United States
You might like
