HTTP Archive 💾

Public dataset that tracks how the web is built. Maintained by @patmeenan @paulcalvano @tunetheweb @themax_o and @nrllah

[HTTP Archive 💾 @HTTPArchive]

The 2025 Web Almanac by HTTP Archive has been officially released! 🚀

We would like to thank all of our contributors from around the globe who made this extensive report possible!

Check out the full report here: https://t.co/jbjjl77RYF

#thewebalmanac

[Paul Calvano @paulcalvano]

If you tell a browser to cache something for 60s, but also serve an Age header >60s, it's stale on arrival and revalidated before it can be reused. 13.7% of the 15.3M sites measured in the @HTTPArchive do this! https://t.co/ctYn76JvUm

[Alon Kochba @alonkochba]

Check out the new geo-breakdown in the @HTTPArchive CWV Tech Report! https://t.co/r3nXz8BSfU

Geography heavily impacts CWVs.
Recent Wix mobile data shows 🇨🇦(93%), 🇯🇵(92%), 🇺🇸🇬🇧🇩🇪(90%) with high pass rates, while 🇧🇷(69%) & 🇮🇳(51%) face tougher real-world conditions #WebPerf @Wix

[Paul Calvano @paulcalvano]

@HTTPArchive analysis about sites adding AI Bots and Crawlers to their robots.txt files. While robots.txt doesn't "block" bots by itself, it's a clear demonstration of the preferences of site owners and the sentiment towards AI crawlers on today's web. https://t.co/eBPhVzTSgM

[HTTP Archive 💾 @HTTPArchive]

We're please to welcome @nrllah as the newest maintainer of the HTTP Archive project!

Nurullah has helped lead the Web Almanac over the last two years and we look forward to seeing what this year's edition comes up with!

Welcome to the team Nurullah!

[HTTP Archive 💾 @HTTPArchive]

🚨 Calling all web experts! 🚨

The 2025 Web Almanac is still open for contributors!

Know someone perfect for it? Mention them here and help us reach the right folks. 🙌

📢 Please help us spread the word!

🔗 Learn more: https://t.co/pAW6q9nQVX

[HTTP Archive 💾 @HTTPArchive]

What do you think? Shall we do another Web Almanac this year? Diving deep into all the data we collect to see what’s changing in web trends?

Check out this post if interested in getting involved:
https://t.co/pAW6q9nj6p

Or nominate your favorite expert to author the chapters!

[HTTP Archive 💾 @HTTPArchive]

@haddiamjad @TheNishuGoel An enormous thanks to all 88 contributors who made the 2024 edition possible.

We've already started talking about the next edition. Check out our GitHub repo where there's an interest form if you want to help build the 2025 edition:
https://t.co/aZG7K30idL

[HTTP Archive 💾 @HTTPArchive]

We've just published the 19th and final chapter of the 2024 Web Almanac on JavaScript by @haddiamjad and @TheNishuGoel

https://t.co/4J4zG4yVWq

[HTTP Archive 💾 @HTTPArchive]

@haddiamjad @TheNishuGoel That marks the end of the 2024 Web Almanac. A little later than usual but worth it in the end.

And also means the ebook is now available: https://t.co/LXkXxc2PcM

754 pages jam packed with all sorts of nerdy goodness!!!

[HTTP Archive 💾 @HTTPArchive]

Just about to start...

[Henri Helvetica 🇭🇹 👨🏾‍🚀 🚀 @HenriHelvetica]

We're not in Kansas anymore. The web is... complicated. Let's talk about some of the parts.
✨ The Web Almanac LIVE STREAM II ✨ featuring Chapters :
🔸 SEO
🔸 Privacy
🔸 HTTP
🔸 Cookies
🔸 3rd Parties
📆 Thursday, January 16th
⏰ 14h EST, https://t.co/TQvGVEDYqf
🔗 https://t.co/MM7Wbmievg
This is all per the Web Almanac's gathered data. Join us, and slack a friend. We'll have a fun chat. RT? ✨🙏🏾✨

[Henri Helvetica 🇭🇹 👨🏾‍🚀 🚀 @HenriHelvetica]

Speaking of the Web Almanac, during the holidays, a few more chapters were published:
🔸 Media: https://t.co/Yb1FnN7JPp
🔸 Page Weight: https://t.co/Zn8mnxF7vb
Both are ready to be read now, so enjoy!

[Henri Helvetica 🇭🇹 👨🏾‍🚀 🚀 @HenriHelvetica]

🎙️ New year, more new content. We are continuing to explore data + content w/ the next stream:
✨ The Web Almanac LIVE STREAM II ✨
📆 Thursday, January 16th
⏰ 14h EST, https://t.co/R5x3eXQn53
🔗: https://t.co/J5tsjtuVB7
@HTTPArchive's Web Almanac discussions will include this time around:
SEO, Privacy, HTTP, Cookies + 3rd Parties.
Join us for this discussion + Q&A!

[Snyk @snyksec]

The #WebAlmanac 2024 from @HTTPArchive is here! 🔍 Discover the latest trends shaping the ever-evolving world of #WebDevelopment. Watch @_clarkio's recent video to learn more about the most important asset for developers. https://t.co/pwTSlN2ERc

[HTTP Archive 💾 @HTTPArchive]

The Page Weight chapter authored by @davewsmart and @Jammer_Volts becomes the 18th and penultimate chapter in the 2024 Web Almanac:
https://t.co/akoL6wV3ae

What do you think—are websites getting bigger or smaller as time goes on?

[HTTP Archive 💾 @HTTPArchive]

@stefanjudis @etportis We've two more chapters to come (Page Weight and JavaScript) before we'll be closing out the 2024 Web Almanac and start deciding if there's interest in doing it all again next year!

[HTTP Archive 💾 @HTTPArchive]

Just launched the Media chapter of the 2024 Web Almanac written by @stefanjudis and @etportis

https://t.co/66yfCkuzLo

Check it out to see the state of images and video on the web today!!

[Nurullah Demir @nrllah]

1️⃣5️⃣ SEO in 2024

🔍 Key insights into web content and AI-driven indexing:

📊 70% of pages have <h1> elements, but 6% are empty.
🤖 2.7% of pages include GPTBot directives in robots.txt—the most common AI crawler.
❌ 28% of desktop pages have invalid <head> elements due to <img> issues.

By @jammer_Volts, @davewsmart, @miknaraujo, @MichaelLewittes, @tunetheweb, @henryprice1

Full report: https://t.co/xocUpbuk22

#SEO #WebSeo #SearchEngines

[Nurullah Demir @nrllah]

1️⃣4️⃣ Privacy in 2024

🛡️ Privacy practices are shifting: Facebook is moving from third-party to first-party cookies

📊 63% of pages adopt the Protected Audience API.
🍪 14.3% of pages include Facebook’s first-party cookie.
🔍 The most common number of trackers per page is 3.

by @vekariayash, Benjamin Standaert, @themax_o, @haddiamjad, Yana Dimova, @shaoor_munir, Chris Böttger, @umaarr6, Alberto Fernandez-de-Retana

Full report: https://t.co/62Ag7RfM6o

#Privacy #WebPrivacy #Tracking #Trackers #Fignerprinting #GoogleSandbox

[Nurullah Demir @nrllah]

1️⃣3️⃣ Cookies in 2024

🍪 Tracking is still common :/

📊 61% of cookies are third-party.
🔒 11% of first-party cookies use SameSite=None.

By Yohan Beugin, @SW12, Yana Dimova, @rowan_m, @tunetheweb

Full report: https://t.co/wkow1XPdaL

#Cookies #WebCookies #Tracking #Trackers