@melvinjohnsonp Profile picture

Melvin Johnson

@melvinjohnsonp

Researcher @ Google Research. Multilingual NLP and MT. Previously, Stanford CS.

Similar User
Mikel Artetxe photo

@artetxem

Shruti Rijhwani photo

@shrutirij

Kai-Wei Chang photo

@kaiwei_chang

Shayne Longpre photo

@ShayneRedford

Sabrina J. Mielke @ EMNLP2024 photo

@sjmielke

Mohit Bansal photo

@mohitban47

Patrick Lewis photo

@PSH_Lewis

Maarten Bosma photo

@MaartenBosma

Lucy Li photo

@lucy3_li

Daniel Fried photo

@dan_fried

Machel Reid photo

@machelreid

Marjan Ghazvininejad photo

@gh_marjan

Julia Kreutzer photo

@KreutzerJulia

Andre Martins photo

@andre_t_martins

Nikita Moghe photo

@nikita_moghe

Melvin Johnson Reposted

Gemini-exp-1114 is now available via the Gemini API, happy building / testing! Will follow up Monday with more 🚢 ai.google.dev/gemini-api/docs


Say hello to our latest Gemini model Exp 1114 with improvements across the board 🚀🚀 Now available on Google AI Studio! Try it and enjoy.

Massive News from Chatbot Arena🔥 @GoogleDeepMind's latest Gemini (Exp 1114), tested with 6K+ community votes over the past week, now ranks joint #1 overall with an impressive 40+ score leap — matching 4o-latest in and surpassing o1-preview! It also claims #1 on Vision…

Tweet Image 1


Melvin Johnson Reposted

Massive News from Chatbot Arena🔥 @GoogleDeepMind's latest Gemini (Exp 1114), tested with 6K+ community votes over the past week, now ranks joint #1 overall with an impressive 40+ score leap — matching 4o-latest in and surpassing o1-preview! It also claims #1 on Vision…

Tweet Image 1

gemini-exp-1114…. available in Google AI Studio right now, enjoy : ) aistudio.google.com



Melvin Johnson Reposted

gemini-exp-1114…. available in Google AI Studio right now, enjoy : ) aistudio.google.com


Tune into this one for sure. Emanuel is one of the most hardcore Googlers out there and just ships!! As a colleague, he’s such a pleasure to work and hustle with. There’s a lot to share about Flash-8B.

Next week, I am sitting down with Emanuel Taropa (Google Fellow) to record and share the behind the scenes story of Gemini 1.5 Flash-8B. Ema is one of the people who loves shipping the most at Google. What do you want to know about this model and the story? 🧵👇



Melvin Johnson Reposted

Say hello to Gemini 1.5 Flash-8B ⚡️, now available for production usage with: - 50% lower price (vs 1.5 Flash) - 2x higher rate limits (vs 1.5 Flash) - lower latency on small prompts (vs 1.5 Flash) developers.googleblog.com/en/gemini-15-f…


Our latest Gemini updates: - Huge improvements for 1.5 Flash matching some of the best models on the arena - Improvements on Math and Coding for 1.5 Pro - An updated Flash 8B model Enjoy!

Chatbot Arena update⚡! The latest Gemini (Pro/Flash/Flash-9b) results are now live, with over 20K community votes! Highlights: - New Gemini-1.5-Flash (0827) makes a huge leap, climbing from #23 to #6 overall! - New Gemini-1.5-Pro (0827) shows strong gains in coding, math over…

Tweet Image 1


Welcome back @NoamShazeer!

It was always great fun to discuss ideas and results with @NoamShazeer and @dan_defr Welcome back & let's go! ♊️♊️🚀🚀 techcrunch.com/2024/08/02/cha…



Our latest version of Gemini 1.5 Pro in AI Studio is #1 on the LMSys leaderboard. 🚀 This is the result of various advances in post-training and we have more lined up. Congrats to the Gemini team.

Exciting News from Chatbot Arena! @GoogleDeepMind's new Gemini 1.5 Pro (Experimental 0801) has been tested in Arena for the past week, gathering over 12K community votes. For the first time, Google Gemini has claimed the #1 spot, surpassing GPT-4o/Claude-3.5 with an impressive…

Tweet Image 1


Melvin Johnson Reposted

Today, we are making an experimental version (0801) of Gemini 1.5 Pro available for early testing and feedback in Google AI Studio and the Gemini API. Try it out and let us know what you think! aistudio.google.com


Excited to see Gemma 2 out there. It's a great size and is very competitive on LMSys.

Gemma 2 is out! As with our first model, we're super focused on creating models at useful, practical sizes, so that they can be easily deployable... all the while being amazing in quality. We upgraded our 9B so that it's truly awesome and best in class across many benchmarks.…

Tweet Image 1


Flash strikes again! 🚀

Gemini Flash beating Claude 3 Opus for LLM as a judge is NUTS.

Tweet Image 1


Amazing to see Gemini 1.5 Flash punch above its weight yet again 🚀

Updated results: Gemini 1.5 Flash is rocking, outperforming GPT-4o as well! 🤘

Tweet Image 1


Great to see Gemini 1.5 doing well on this new video understanding benchmark!

Gemini 1.5 for video understanding 🚀🚀

Tweet Image 1


Melvin Johnson Reposted

Good news for @Google Developers: - Gemini 1.5 Flash and 1.5 Pro are now GA - Gemini 1.5 Flash now has a 1,000 RPM limit - Gemini 1.5 Flash tuning announced - JSON Schema mode is now available in the API - AI Studio Mobile support + light mode are live developers.googleblog.com/en/gemini-15-p…


Great to see this set of comprehensive and private leaderboard from Scale. Trustworthy, leak proof evals are critical to progress as LLMs get better. Looking forward to seeing how various models perform on this suite and also how the suite evolves as models do.

1/ We are launching SEAL Leaderboards—private, expert evaluations of leading frontier models. Our design principles: 🔒Private + Unexploitable. No overfitting on evals! 🎓Domain Expert Evals 🏆Continuously Updated w/new Data and Models Read more in 🧵 scale.com/leaderboard

Tweet Image 1
Tweet Image 2
Tweet Image 3


Great to see our updated Gemini 1.5 Pro/Advanced on the leaderboard. Gemini 1.5 Flash is doing amazing well too. It's been an amazing journey improving these models over time with an awesome team. And we're just getting started. 🚀🚀

Big news – Gemini 1.5 Flash, Pro and Advanced results are out!🔥 - Gemini 1.5 Pro/Advanced at #2, closing in on GPT-4o - Gemini 1.5 Flash at #9, outperforming Llama-3-70b and nearly reaching GPT-4-0125 (!) Pro is significantly stronger than its April version. Flash’s cost,…

Tweet Image 1


Loading...

Something went wrong.


Something went wrong.