{"id":111850,"date":"2022-05-04T08:00:16","date_gmt":"2022-05-04T12:00:16","guid":{"rendered":"http:\/\/kendallharmon.net\/?p=111850"},"modified":"2022-05-04T18:08:46","modified_gmt":"2022-05-04T22:08:46","slug":"mit-tech-review-meta-has-built-a-massive-new-language-ai-and-its-giving-it-away-for-free","status":"publish","type":"post","link":"https:\/\/kendallharmon.net\/?p=111850","title":{"rendered":"(MIT Tech Review) Meta has built a massive new language AI\u2014and it\u2019s giving it away for free"},"content":{"rendered":"
\n
\n

Meta\u2019s AI lab has created a massive new language model that shares both the remarkable abilities and the harmful flaws<\/a> of OpenAI\u2019s pioneering neural network GPT-3<\/a>. And in an unprecedented move for Big Tech, it is giving it away to researchers\u2014together with details about how it was built and trained<\/a>.<\/p>\n

\u201cWe strongly believe that the ability for others to scrutinize your work is an important part of research. We really invite that collaboration,\u201d says Joelle Pineau, a longtime advocate for transparency in the development of technology<\/a>, who is now managing director at Meta AI.<\/p>\n<\/div>\n<\/div>\n

\n
\n

Meta\u2019s move is the first time that a fully trained large language model will be made available to any researcher who wants to study it. The news has been welcomed by many concerned about the way this powerful technology is being built by small teams behind closed doors.<\/p>\n

\u201cI applaud the transparency here,\u201d says Emily M. Bender, a computational linguist at the University of Washington and a frequent critic of the way language models are developed and deployed.<\/p>\n<\/div>\n<\/div>\n

Read it all<\/a>.<\/p>\n

\n

Heard of advances in AI called Large Language models – e.g. GPT-2\/3? Up till now only researchers at a handful of large companies could actually see what was behind the curtain. Now Meta AI has released a fully trained model for researchers…https:\/\/t.co\/1LdTI2iQuO<\/a><\/p>\n

— Mike Schroepfer (@schrep) May 3, 2022<\/a><\/p><\/blockquote>\n