Sekėjai

Ieškoti šiame dienoraštyje

2023 m. birželio 19 d., pirmadienis

Zuckerberg Takes More Control of AI Efforts --- A more academic approach put Meta behind.

"Meta is doing something Mark Zuckerberg doesn't like: playing catch up.

A decade ago, the company founder and CEO saw the promise for artificial intelligence and invested large sums of money into its advancement. He hired one of its early visionaries, Yann LeCun, to lead the charge. Now, just months after OpenAI's ChatGPT burst into the consumer marketplace, Meta is falling behind in the very same technology.

Meta is now scrambling to refocus its resources to generate usable AI products and features, including its own chatbots, after spending years prioritizing academic discoveries and sharing them freely while struggling to capitalize on their commercial potential.

That's a tall order as many of Meta's top AI employees have departed and amid the company's own sets of layoffs in what Zuckerberg has called a "year of efficiency." About a third of Meta workers who co-authored published AI research related to large language models -- the complex systems that power AI systems like ChatGPT -- have left in the last year, according to a Wall Street Journal analysis.

Zuckerberg himself and other top executives have taken more control of the company's AI strategy. They created a new generative AI group that reports directly to Chief Product Officer Chris Cox, one of the longest-serving and most trusted executives at Meta. The group is training generative AI models -- which produce content, such as text, images or audio -- intended to be infused into "every single one of our products," Zuckerberg said. 

He has touted Meta's flagship AI language model, called LLaMA, which -- after its code leaked -- spurred the emergence of homegrown tools that could one day compete with the products that Google and OpenAI are trying to sell.

If Meta succeeds in commercializing its AI efforts, it could help boost its user engagement, create a better metaverse and make the company more attractive to the young users who are now proving harder for it to attract. If Meta can't capitalize on this technology fast enough, it runs the risk of losing relevance as competitors, including a fast-growing crop of scrappy AI startups, leap ahead.

In a statement, Joelle Pineau, vice president of AI research at Meta, said the company is not behind in AI and defended its focus on research and structure, saying it will position Meta for success. Meta's AI research unit "is one of the world's leading destinations for AI researchers and open science, and its research output has increased significantly over the last year alone," said Pineau. "Our research breakthroughs have provided a tremendous foundation to build on as we bring a new class of generative AI-powered experiences to our family of apps. We're proud of the contributions that Meta's AI researchers, past and present, are making to help shape the future of advanced state-of-the-art AI."

Zuckerberg on Friday announced an AI model called Voicebox that can read aloud text prompts in a manner of different ways or correct audio recordings with the help of text prompts to remove background noise, like the bark of a dog. Meta didn't say when the research project will become available to the public.

This article is based on interviews with more than a dozen current and former Meta employees, reviews of LinkedIn and social-media profiles and startup news announcements.

Zuckerberg and other executives have called AI a third leg to Meta's stool, believing it essential to the company's long-term growth and relevance, alongside global connectivity and virtual and augmented reality. Lagging behind in AI threatens to make Meta appear stodgy and slow, instead of the nimble, aggressive upstart that coined the phrase "move fast and break things" and set the pace of innovation in Silicon Valley.

In May, the White House didn't invite Meta to a summit of AI leaders, billed as a meeting of "companies at the forefront of AI innovation."

Meta has taken sharp turns before at moments when it has appeared behind, such as when it transitioned Facebook from a desktop to a mobile-first ads business or in 2016, when it launched its Stories feature on Instagram to lure people away from Snapchat, which had introduced a similar feature a decade ago.

Meta faces other strategic, political and financial challenges. Its longtime heavy focus on original research in Meta's AI division disincentivized work on generative AI, the systems like ChatGPT that produce human like text and media. Executives misstepped in designing the hardware required to run such AI programs, which it is now trying to correct. Years of scrutiny into the company's handling of user data and human-rights violations has made some executives indecisive and wary of launching new AI products for consumers.

Meta began investing in AI in 2013. Zuckerberg and then-CTO Mike Schroepfer personally sought to recruit one of the leading minds in AI to lead a new research division to advance the technology. They found their lieutenant in LeCun, a New York University professor whose breakthrough work in the field was renowned.

LeCun, rooted in academia and fundamental research, was instrumental in creating a culture that reflected his priorities: hiring scientists over engineers and emphasizing academic outputs, such as research papers, over product development for the company's end users. The strategy made Meta's fundamental AI research lab highly attractive to top talent over the years, but challenged the company's ability to commercialize its advancements, people familiar with the matter said.

It also encouraged a diffuse, bottoms-up approach to research direction and resource allocation. Researchers drove their own agendas, pursuing independent projects in different directions rather than toward a cohesive companywide strategy, the people said. Meta divvied up hardware into small pools across each project: Some researchers, given more computer chips than they needed, would tie them up in unnecessary tasks to avoid relinquishing them, some of the people said.

Meanwhile, Meta was slow to equip its data centers with the most powerful computer chips needed for AI development. Even as the company acquired more of these chips, it didn't have a good system for getting them into the hands of engineers and researchers. At times thousands of pieces of coveted and expensive hardware sat around unused, some of the people said.

Meta is in the process of overhauling its data centers, which could have contributed to the logjams. As of May, Meta's latest supercomputer for AI projects has 16,000 such chips, a company blog post said.

As large language models began to show increasingly impressive capabilities in 2020, tension mounted within Meta's AI research division between those who urged the company to invest seriously in the industry's new direction, and those, including LeCun, who believed such models are fads that lack scientific value, people familiar with the matter said. LeCun's strong opposition toward large language models (he believes they don't get AI closer to human-level intelligence), both internally and publicly, made it difficult for researchers with opposing views to amass the support and vast resources needed for those kinds of projects, some of the people said.

Some Meta researchers pressed forward anyway with fewer resources, using around 1,000 chips to produce a large language model in 2022 known as OPT, or Open Pretrained Transformer, and around 2,000 chips to produce Meta's flagship model called LLaMA in 2023. The industry standard, by contrast, is 5,000 to 10,000 chips. Meta initially allowed a limited group of outside researchers access to LLaMA before it leaked online, sparking a burst of innovation that executives cite as a prime example of Meta's goal to share its AI technology.

Meta has since lost numerous AI researchers who worked on these and other key generative AI projects in the last year, many citing burnout or a lack of confidence in Meta to keep up with competitors. Six of the 14 authors listed on the research paper for LLaMA, have left or announced they will be departing, according to their LinkedIn profiles and people familiar with the matter. Eight of the 19 co-authors on the paper for OPT have left as well.

The departures have accelerated following OpenAI's release of ChatGPT in November of last year. Some have been lured by AI startup fever, which has fueled staffing changes at Silicon Valley companies across the board, including at Google. As of March, the number of job listings on LinkedIn mentioning GPT is up 79% year-over-year, the professional social network told The Wall Street Journal.

A Meta spokesman said the company has continued to recruit and brought in new AI talent.

After ChatGPT's debut, Zuckerberg and Cox joined Chief Technology Officer Andrew Bosworth in overseeing all of the company's AI-related efforts. The three executives are now spending hours a week on AI, participating in meetings and approving AI projects.

The new generative AI group is focused exclusively on building usable products and tools instead of on scientific research. It received over 2,000 internal applications and has rapidly amassed hundreds of people from different teams. Hardware resources have shifted over from the AI research division and are being used to train new generative AI models, people familiar with the work said.

In March, Zuckerberg said that "advancing AI and building it into every one of our products" was the company's single largest investment. Speaking at Meta's annual shareholder meeting in May, Zuckerberg said the company also hopes to extend the technology to the metaverse as well.

At a town hall meeting with employees earlier this month, Zuckerberg announced a number of generative AI products that the company is currently working on, the Meta spokesman said. The initiatives include AI agents for Messenger and WhatsApp, AI stickers that users can generate from text prompts and share in their chats and a photo generation feature that will allow Instagram users to modify their own photos using text prompts and then share them in Instagram Stories.

Zuckerberg also shared some internal-only generative AI tools geared toward employees, including one called Metamate, a productivity assistant that pulls information from internal sources to perform tasks at employees' request. Metamate was recently rolled out to a large group of employees as part of a trial run, the Meta spokesman said.

"In the last year, we've seen some really incredible breakthroughs -- qualitative breakthroughs -- on generative AI," Zuckerberg said at the town hall.

Meta still faces broad challenges. The company's increasingly low tolerance for risk following seven years of intense government and media scrutiny for its user-privacy practices has created friction about how and when to introduce AI products, people familiar with the matter said.

In the past, Meta has had to consider its public reputation when developing and releasing large language models, which can be prone to churning out incorrect answers or offensive remarks.

Several years ago, AI researchers were working on a chatbot code-named Tamagobot, based on an early version of a large-language-model system, according to people familiar with the matter. The team was impressed by its performance, but concluded that it wasn't worth launching while the company was facing intense criticism for allowing misinformation to flourish on its platform during the 2016 presidential election, one of the people said.

The concern around public scrutiny was also on display when Meta released its BlenderBot 3 chatbot in August 2022. Within a week of launching, BlenderBot 3 was panned for making false statements, offensive remarks and racist comments. The system also called Zuckerberg "creepy and manipulative."

The Meta spokesman said the project was still left up for over a year until the conclusion of the research, and the company maintained an open and transparent approach through its life cycle. Meta has released and seen through many other projects that demonstrate the company's willingness to take risks, he added.

But the scenario played out again in November 2022 when the company released Galactica, a science-focused large language model. The system was shut down by Meta within three days of its release after it was hit with a wave of criticism by scientists due to its incorrect and biased answers.

Two weeks later, OpenAI released ChatGPT." [1]

1. EXCHANGE --- Zuckerberg Takes More Control of AI Efforts --- A more academic approach put Meta behind. Hao, Karen; Rodriguez, Salvador; Seetharaman, Deepa. 
Wall Street Journal, Eastern edition; New York, N.Y. [New York, N.Y]. 17 June 2023: B.1.

Kai 2023 m. klasė patenka į darbo jėgą, darbdaviai mato, kad trūksta įgūdžių, reikalingų, norint naršyti biure

  „Neseniai baigę, absolventai gali puikiai mokėti apskaitą ar koduoti, tačiau jiems reikia šiek tiek pagalbos, kai kalbama apie vakarienę ir aprangos kodus.

 

     Daugelis „2023 metų klasės“ narių buvo kolegijos pirmakursiai 2020 m. pavasarį, kai dėl Covid-19 pandemijos buvo uždaryti universitetai. Likusius koledžo metus jie iš dalies praleido virtualiu režimu, atlikdami hibridines stažuotes ir virtualias pamokas. Studentai neišmoko kai kurių vadinamųjų minkštųjų įgūdžių, kuriuos jie galėjo turėti praeityje, naudodami osmosą darbe, iš mentorių ir praktikuodami miestelyje.

 

     Siekdamos pašalinti visus trūkumus, pradedant pokalbiais lifte ir baigiant pristatymo įgūdžiais, įmonės, universitetai ir įdarbintojai sugalvoja būdų, kaip apmokyti naujus samdomus darbuotojus ir suteikti jiems aiškių patarimų. Jie tai valgo.

 

     Neseniai absolventė Joslynn Odom atliko savo pirmąją hibridinę stažuotę po jaunesniojo kurso ir pastebėjo, kad darbas asmeniškai buvo išsekinantis, nes ji dėvėjo profesionalią aprangą ir nuolat išliko energinga. Tai privertė ją suprasti, kad jai reikia patobulinti bendravimo ir tinklų kūrimo įgūdžius.

 

     Nuo to laiko padėjo programa, kurią surengė jos koledžas, Majamio universitetas Ohajo valstijoje.

 

     Prieš baigdama studijas, ji dalyvavo etiketo vakarienėje, kurios metu per vakarienę išmoko sekti vyresnių lyderių pavyzdžiu: valgyti jų tempu, diskutuoti neutraliomis temomis ir vengti asmeninių klausimų.

 

     Tepant duoną sviestu, prieš dedant ant vyniotinio geriausia ant savo duonos lėkštės pasidėti plokštę, o pjaustant maistą geriausia šakutę laikyti kupra į viršų, – sakė ji.

 

     „Tai žinodama, jaučiuosi labiau pasitikinti savimi“, – sakė ji.

 

     23 metų Williamas Lopezas-Gudielis praėjusiais metais stažavosi Warner Bros. Discovery ir jam pasirodė ypač naudingas pranešimas apie biuro dinamiką. Jis sakė, kad jis apėmė aprangos kodus, tarpasmeninių santykių valdymą ir tai, kas yra darbas asmeniškai.

 

     Bendrovė teigė, kad panašias gaires siūlė ir anksčiau. Kai kurie iš jų atrodė paremti sveiku protu Lopez-Gudiel, kuris gruodį baigė George'o Masono universitetą ir yra save apibūdinantis ekstravertas.

 

     Tačiau Lopez-Gudiel galiausiai įvertino šią informaciją, nes suprato, kad pandemija galėjo apriboti tuos minkštuosius įgūdžius, kuriuos jis galėjo išmokti iš ankstesnės darbo patirties. Įmonėje jis visą darbo dieną dirbs programinės įrangos kūrėju.

 

     Daugelis, netrukus baigsiančių studijas, nori atsikratyti „Zoom“ ir dirbti akis į akį su bendradarbiais, kur bus greitai patikrinti jų bendravimo įgūdžiai. Balandžio mėnesio apklausoje, kurioje dalyvavo apie 700 2023 m. klasės absolventų iš virtualios studentų sveikatos įmonės „TimelyCare“, 53 % teigė norintys visiškai asmeninės darbo aplinkos, o 21 % teigė norintys būti visiškai nutolę.

 

     Sutrikusi absolventų patirtis kolegijoje gali reikšti, kad jiems sunku skaityti kolegų užuominas ar naršyti posėdyje, sakė Heidi Brooks, Jeilio universiteto Vadybos mokyklos organizacinės elgsenos vyresnioji dėstytoja. Klasėje, kai mokiniai neturėjo kamerų, tai buvo sunkiau nustatyti.

 

     Nauji samdomi darbuotojai turės išmokti „tų niuansų, kaip iš tikrųjų sukurti pakankamai ryšio, matomumo, gebėjimo manevruoti“, – sakė ji.

 

     Darbuotojų teigimu, trūkstamas turinys būdingas jauniems specialistams, tęsusiems mokslus nuo 2020 m., tiesą sakant, jiems nėra artimas mentorystės ir vadovavimo reikalas.

 

     „Šiandien tai daug svarbiau“, – sakė Sandy Torchia, KPMG talentų ir kultūros skyriaus pirmininko pavaduotoja, kurios visą darbo dieną darbuotojai šią vasarą ir rudenį vyks į firmos mokymo centrą Floridoje, kur bus rengiami nauji pristatymo mokymai.

 

     Jie praktikuoja scenarijus, apimančius konfliktus komandose, taip pat bendravimo asmeniškai pagrindus – taip paprasta, kaip prisistatyti klientui ar kolegai. Pagrindiniai patarimai: palaikyti akių kontaktą, daryti pauzes ir vengti žargono. Taip pat geriausia atidžiai klausytis kitų ir pakoreguoti savo įžangą taip, kad paryškintumėte jums įdomiausius jūsų patirties elementus.

 

     Bendrovė nustatė, kad kai kurie jauni specialistai yra nelankstūs, kalba per greitai arba per daug pasikliauja tokiais papildančiais žodžiais kaip „um“, kai daro pranešimą.

 

     21 metų Allanas Rubio 2020 m. pavasarį buvo Dartmuto koledžo pirmakursis. Internetiniai užsiėmimai tęsėsi visus antrus metus, kuriuos Rubio baigė savo šeimos namuose Bankoke. Kursų seansai nusitęsė iki 23 val. arba kartais 2 valandą nakties vietos laiku, sakė jis.

 

     Jo teigimu, dėstytojai pandemijos metu buvo daug lankstesni, nustatydami terminus ir galėdavo pratęsti, jei studentai paprašytų. Kai Rubio praeitą vasarą stažavosi asmeniškai, jis suprato, kad jo vadovas, komanda ar klientas priklauso nuo jo terminų laikymosi.

 

     Pristatymo įgūdžiai taip pat yra tai, ką Rubio turi išmokti geriau, sakė jis. Jis praktiškai prisistatydavo akademinėse pamokose ir dažnai laikydavo kelias mintis bei scenarijų kalbą užrašų faile ekrane arba kitame netoliese esančiame įrenginyje. Kartą vaizdo įrašo pokalbyje, pasak jo, kaltino interneto vėlavimu, kol nustojo kalbėti sakinio viduryje ir surinko mintis.

 

     Nuo tada, šį mėnesį studijas baigęs, Rubio daug repetavo prieš gyvus pristatymus. Prieš įsimindamas pagrindines sritis, jis išdėsto pagrindinius punktus ir sutrumpina ilgesnį scenarijų.

 

     Nors nauji darbuotojai yra skaitmeniniai vietiniai gyventojai, šiandienos absolventų profesinius el. pašto įgūdžius reikia tobulinti, sakė Jialan Wang, Ilinojaus universiteto Urbana-Champaign finansų profesorius.

 

     Daugelis nepripažins svarbių pranešimų, bet tikisi iš profesorių atsakymo nedelsiant, net per šventes, sakė ji.

 

     Mičigano valstijos universiteto verslo mokyklos karjeros centras paragino įmones aiškiai pasakyti, ko studentai turėtų tikėtis darbe, smulkiai pranešti apie tai, kaip praeis pirmoji diena, ką dėvėti ir ką žmonės paprastai daro, kai pietauja.

 

     Praėjusiais metais mokykla pradėjo reikalauti, kad daugelis verslo studentų lankytų minkštųjų įgūdžių pamokas darbo vietoje, nes pastebėjo, kad studentai jaučiasi nepatogiai ir nelabai gerai susigaudo, kai bendradarbiauja, nei tai būdavo anksčiau, sakė karjeros valdymo direktorė Marla McGraw.

 

     Vienoje dalomojoje medžiagoje centras mokiniams nurodo prisistatyti vardu ir pavarde. „STOP! Leisk jiems pasakyti jų vardą“, – rašoma.

 

     Vėliau studentai raginami pasidalyti, kad jiems įdomu išgirsti apie galimybes įmonėje ir pasidalyti, kad jie atidžiai seka įmonę, yra susipažinę su jos produktais ar paslaugomis arba žino ką nors, kas joje stažavosi, be kitų galimybių.

 

     McGraw pridūrė, kad studentai turėtų stebėti, ar nėra požymių, kad asmuo bando baigti pokalbį. Kas nors gali pradėti rinkti savo daiktus arba apsižvalgyti po kambarį, parodydamas, kad reikia pasikalbėti su kitu asmeniu. Dažnai galima palengvinti sklandų išėjimą sakydamas: "Na, labai ačiū. Buvo malonu."

 

     Profesionalių paslaugų įmonės „PricewaterhouseCoopers“ ir „Protiviti“ turėjo kai kuriems jauniems darbuotojams pasakyti, kokių tipų drabužiai yra tinkami, įskaitant apsilankymą klientų vietoje.

 

     Daugelis žmonių rengiasi ne taip formaliai, sakė Scottas Redfearnas, „Protiviti“ pasaulinių žmogiškųjų išteklių vykdomasis viceprezidentas.

 

     Dabar „Protiviti“ apibrėžia, ką reiškia verslo laisvalaikio apranga – įskaitant kelnes, pritaikytus džinsus, sportines striukes, sukneles, sijonus, marškinius su apykakle, palaidines, megztinius ir profesionalią avalynę – ir paaiškina, kodėl svarbu išlaikyti rimtą profesionalų įvaizdį. Bendrovė taip pat praneša, kad kai tikslinga dėvėti mėlynus džinsus, geriausiai tinka tamsesni atspalviai be plyšimų, sakė jis.

 

     Bendrovė stengėsi būti aktyvi, kai dalijasi plačiomis gairėmis apie aprangą, tačiau kai darbuotojas pasirodo su sportbačiais ar šlepetėmis, tai geriausia išspręsti pokalbyje vienas su vienu.

 

     „Darbo hibridas kiekvienam darbuotojui suteikia daug daugiau sprendimų“, - sakė Redfearnas.

 

     Pandemijos metu įmonė išplėtė savo prisijungimo procesą į keletą mažų grupių virtualių susitikimų, kurie vyko visus metus.

 

     „Protiviti“ rengia socialinius susibūrimus per asmeninius susitikimus, kad darbuotojai galėtų treniruotis.

 

     Redfearn sakė, kad jis nuodugniai pasikalba su naujais absolventais, ragindamas juos prisistatyti biure, ištiesti ranką ir nusišypsoti. Kitas patarimas: turėkite paruoštą klausimą, kurį galite užduoti, jei reikia." [1]  

 

1. EXCHANGE --- Training New Hires to Be Grown-Ups --- As the Class of 2023 enters the workforce, employers are seeing a lack of the skills needed to navigate the office. The solution: classes in how to send an email, the right way to buttonhole the boss and what not to wear. Ellis, Lindsay. 
Wall Street Journal, Eastern edition; New York, N.Y. [New York, N.Y]. 17 June 2023: B.1.