ChartedSea.com

[ChartedSea.com @ChartedSea]

We finally deobfuscated the Shopee antibot script that generates the x-sap-sec header!

The screenshot corresponds to the version 2.43.x, deployed 2 weeks ago. Before that, the last version we were able to deobfuscate was from April, so we are very interested in its content!

[ChartedSea.com @ChartedSea]

We just released our AliExpress scraper!

It was relatively easy to add, as it shares the same codebase as our Lazada, Daraz, and Miravia scrapers (all 4 platforms use very similar underlying technologies).

https://t.co/l7tkwrgPfI

[ChartedSea.com @ChartedSea]

Interesting, Shopee updated two antibot scripts again today:
- the one behind the `x-sap-*` headers (second release this week)
- the one that collects fingerprint signals and send them to `/v2/shpsec/web/report`

[ChartedSea.com @ChartedSea]

Shopee just released the version 2.42 of their anti-bot script that generates `x-sap-*` headers. It's time for us to update our Shopee Deobfuscator tool!

[ChartedSea.com @ChartedSea]

We just reconstructed sfu-stable.fe80b66925e8923e.2023.js. It's almost the same as the one from last week. The only significant difference is that Shopee now restore the original DEPTH_RANGE after probing WebGL.

[ChartedSea.com @ChartedSea]

Shopee just released a new version of their anti-bot script sfu-stable.fe80b66925e8923e.2023.js yesterday, 8 days after the previous version!

[ChartedSea.com @ChartedSea]

We just reconstructed Shopee's sfu-stable anti-bot script! The changes are mainly about consistency checks: they read the same signal through multiple independent channels and flag disagreements (WebRTC IP harvested 5 ways, Navigator props cross-checked against claimed UA, ...)

[ChartedSea.com @ChartedSea]

Two new scrapers are now available: Daraz and Miravia!

Both platforms are part of Alibaba's e-commerce ecosystem, so we were able to adapt our existing Lazada scraper to support them.

This expands our coverage into South Asia and Spain!

[ChartedSea.com @ChartedSea]

Today Shopee released a new version of their sfu-stable anti-bot script. It's the one that collects fingerprint signals and send them to https://t.co/lrzxUvQhuJ. We are reverse engineering it.

[ChartedSea.com @ChartedSea]

Shopee's x-sap-sec header now checks deviceorientation. We replaced our event simulator with AI models that generate human-like mouse/touch/keyboard trajectories + correlated sensor readings. +3.3% success rate.

[ChartedSea.com @ChartedSea]

Our Apify offering is growing! A new Shopee Android Scraper is now available, joining our existing Shopee Web and Lazada scrapers.

It provides access to Shopee's Android APIs, including endpoints and data not available through the Web APIs.

https://t.co/Inntuf9BN0

[ChartedSea.com @ChartedSea]

@NguyenT67540156 Strange, it's working at the moment. Send me an email at [email protected] with your exact request, and I will investigate

[ChartedSea.com @ChartedSea]

Almost all of our Shopee Android APIs are now available again for Shopee Indonesia!
This includes /api/v4/item/get_list, which returns exact (non-rounded) sold counts for up to 20 products in a single request.

[ChartedSea.com @ChartedSea]

@WebWeaver212 It would be very risky to open this code, because it's part of our company moat.

[ChartedSea.com @ChartedSea]

We have finally reconstructed Shopee's anti-bot script that generates the x-sap-ri and x-sap-sec headers! This is the version 2.40.x (current is 2.41.x), and we are currently refactoring our bytecode decompiler so we can reverse engineer next versions faster.

[ChartedSea.com @ChartedSea]

Added support for Shopee's pdp/get_lite API!

This endpoint (currently available in Indonesia) exposes sold count and stock levels at both the product and variant levels.

Documentation: https://t.co/YFgFTtB0aO

[ChartedSea.com @ChartedSea]

A small milestone for Charted Sea!

The Shopee scraper that helped launch the company is now back on Apify, joined by a brand new Lazada scraper. Both are powered by the same backend as our platform.

Shopee: https://t.co/dzRrx3JiyK
Lazada: https://t.co/4GkfTTzTb9

[ChartedSea.com @ChartedSea]

We have added two new providers to our managed proxies after finding that our existing provider's HTTP/3-capable residential pool was too limited in some countries.
HTTP/3 noticeably improves our Shopee scraping "score", especially during major promotion periods.

[ChartedSea.com @ChartedSea]

Two days ago we restored an optimization in our Shopee Web scraper for CDN resources.

As a result, proxy traffic per scraping task dropped by around 70%, reducing proxy costs while keeping the same scraping quality.

[ChartedSea.com @ChartedSea]

We recently increased the success rate of our Shopee Web scraper by measuring the performance of each desktop browser fingerprint and disabling the worst-performing ones.