Hillza ✪

Staff Software Engineer @google
#NeuromorphicComputing #Engineering

[Hillza ✪ @hiillza]

@ThePrimeagen Thought this was the new Borat movie at first...

[Hillza ✪ @hiillza]

@AtlantaFalcons @NFL These are fire!

[Google Research @GoogleResearch]

Introducing TurboQuant: Our new compression algorithm that reduces LLM key-value cache memory by at least 6x and delivers up to 8x speedup, all with zero accuracy loss, redefining AI efficiency. Read the blog to learn how it achieves these results: https://t.co/CDSQ8HpZoc

[Hillza ✪ @hiillza]

@NFL @TomPelissero Great pick up, Welcome back!

[Mark Cuban @mcuban]

There are generally 2 types of LLM users, those that use it to learn everything , and those that use it so they don’t have to learn anything.

[Hillza ✪ @hiillza]

@Bijan5Robinson Brother, don't worry about it. gg!

[Google DeepMind @GoogleDeepMind]

🔘 Long-horizon consistency

Environments created remain largely consistent over several minutes, with visual memory extending as far as 1️⃣ minute in the past.

This ability is critical to enable AI agents to learn about the world, and provides humans with an immersive experience.

[Hillza ✪ @hiillza]

Apple just removed Advanced Data Protection (ADP) in the UK, leaving iCloud backups, messages, and files vulnerable under the Investigatory Powers Act 2016.

This means:
✅ Apple can access your data
✅ Gov can demand it without your knowledge
✅Privacy is no longer guaranteed

[Hillza ✪ @hiillza]

@BTRowland We need a better front office. This is just horrible!😂

[Google Cloud @googlecloud]

Our AI Hypercomputer boosts efficiency and productivity for #AI training, tuning, and serving workloads.

Learn more about AI Hypercomputer with a look inside one of our data centers, and explore the latest innovations and launches from #GoogleCloudNext → https://t.co/JWOILfKxLl

[Jeff Dean @JeffDean]

Gemini 1.5 Pro - A highly capable multimodal model with a 10M token context length

Today we are releasing the first demonstrations of the capabilities of the Gemini 1.5 series, with the Gemini 1.5 Pro model. One of the key differentiators of this model is its incredibly long context capabilities, supporting millions of tokens of multimodal input. The multimodal capabilities of the model means you can interact in sophisticated ways with entire books, very long document collections, codebases of hundreds of thousands of lines across hundreds of files, full movies, entire podcast series, and more.

Gemini 1.5 was built by an amazing team of people from @GoogleDeepMind, @GoogleResearch, and elsewhere at @Google. @OriolVinyals (my co-technical lead for the project) and I are incredibly proud of the whole team, and we’re so excited to be sharing this work and what long context and in-context learning can mean for you today!

There’s lots of material about this, some of which are linked to below.

Main blog post:
https://t.co/QAsDKXBdao

Technical report:
“Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context”
https://t.co/CTzTHNDCdo

Videos of interactions with the model that highlight its long context abilities:
Understanding the three.js codebase: https://t.co/yq7d6OSD6c
Analyzing a 45 minute Buster Keaton movie: https://t.co/adyMgDYHoK
Apollo 11 transcript interaction: https://t.co/Pqvq3Eac1R

Starting today, we’re offering a limited preview of 1.5 Pro to developers and enterprise customers via AI Studio and Vertex AI. Read more about this on these blogs:
Google for Developers blog:
https://t.co/x73Vun0kVS
Google Cloud blog:
https://t.co/OlaTW6PYGn

We’ll also introduce 1.5 Pro with a standard 128,000 token context window when the model is ready for a wider release. Coming soon, we plan to introduce pricing tiers that start at the standard 128,000 context window and scale up to 1 million tokens, as we improve the model.

Early testers can try the 1 million token context window at no cost during the testing period. We’re excited to see what developer’s creativity unlocks with a very long context window.

Let me walk you through the capabilities of the model and what I’m excited about!

[Hillza ✪ @hiillza]

@ashtonforbes There are cameras all around that area. I’m sure we can get better footage. lol

[Google @Google]

Introducing Gemini, Google’s largest and most capable AI model. 🧵 #GeminiAI https://t.co/T0tIw9HQyO

[Hillza ✪ @hiillza]

@realGeorgeHotz 😂

[Hillza ✪ @hiillza]

@dwarkesh_sp @realGeorgeHotz @ESYudkowsky Should be a good debate

[Hillza ✪ @hiillza]

@EdKrassen People love to fake outrage 🤦🏽‍♂️

[Hillza ✪ @hiillza]

@EdKrassen Nah I like it. @elonmusk

[Hillza ✪ @hiillza]

@DArmstrong44 I love it

[DJ Akademiks @Akademiks]

My reaction to 🗑

[Hillza ✪ @hiillza]

Goggle-based technology will remain unappealing.

Hardware: A+
Goggles: F+

It all materialize into vaporware regardless .

#WWDC23