gaurav

building real world egocentric data for robotics + physical ai
[email protected]

[gaurav @gauravsunil_]

@paigeinsf agreed. when i say commoditized, i mean generic egocentric footage, not robotics data as a whole. "we can collect more video" and "we have the data needed for a robot to generalize" are very different claims

[gaurav @gauravsunil_]

your slack, crm, email data is worth real money rn.

if you're a broker or an aggregator and already have data, dms are open. we have live buyers

[Nazneen Rajani @nazneenrajani]

we have been inundated by inbound from data brokers and folks selling their private data

I am stoked to say that we have been able to triage, evaluate, make offers, and pay them all in 24 hours

goal is to get to < 4 hours in next few weeks

Is there a benchmark for this? can we claim SOTA?

[gaurav @gauravsunil_]

?
anyway
looking for leads on company email, slack/teams and crm data available for licensing. english, ideally from companies with 100+ employees asap.

if you can supply this or know someone who can, please reach out. intros appreciated.

[bellicose_bestie @BellicoseBestie]

POV: You're vibe coding while she's bouncing on it and you go non-verbal

[gaurav @gauravsunil_]

@lukas_m_ziegler ong. but if you are, we have something you might need.

[gaurav @gauravsunil_]

223 ahead of him are data brokers

[Liz @verstappenhq]

Max Verstappen ranks 224th on the Quote 500 list of the wealthiest Dutch people, with an estimated net worth of €310 million ($345 million).

Last year, he ranked 264th with an estimated net worth of €260 million. He is also the youngest person on the list and the only athlete included.

[Source: RTL Boulevard]

[gaurav @gauravsunil_]

@j_olschwang hi julian. we'd like to know more. hit us up

[gaurav @gauravsunil_]

@LatentsExplored lowk we can help. we have better data (tactile data in electronics, manufacturing etc) not js raw egocentric footage.

[gaurav @gauravsunil_]

ouu shi

[Avi Patel @avipat_]

Brother “grepped” isn’t a real company, the guy who owns it claims to be the founder of https://t.co/yZN23OZXE9 has no prior history past September of even existing on Twitter every single post he makes is botted to oblivion and his literal only business is reselling other people’s data for a referral fee. I mean if you just read his posts and aren’t retarded you can easily defer he’s a larp. Everything else I’ll give the pass on.

[gaurav @gauravsunil_]

@tejessrivalsan we were made for this

[gaurav @gauravsunil_]

@avipat_ agreed. there's a real business in egocentric data, without pretending a referral fee is recurring revenue. buyer intros still have value, connect us to a buyer and earn up to $60k per closed deal, not quite a $73mn run rate tho.

[gaurav @gauravsunil_]

@GotDataa i think they underestimated how hard it is to find data labs actually want

[gaurav @gauravsunil_]

the bottleneck is data.
physical ai doesn't just need more data. it needs the right data for the job.
that's what we're solving: quality egocentric data at scale.
frontier physical models are coming. the data has to keep up.
ps: know a buyer? you could earn up to $60k per referral on closed deals.

[Joe Harris @_joe_harris_]

there is no ChatGPT moment for robotics

capability can skyrocket “overnight” but adoption is the long horizon

all the opportunity belongs to those who can make adoption work. its a game of march of 9s (reliability), the last mile (deployment), and keeping it running (support).

[gaurav @gauravsunil_]

@paigeinsf what's saturated is generic footage sold non-exclusively to everyone. what's not even started is exclusive,
task-specitic data with the sensors to match. saturation is just everyone selling the same hours and calling it a market

[gaurav @gauravsunil_]

@_sophiatatar is it a supply problem, or a "knowing what to supply" problem?

[gaurav @gauravsunil_]

@irrvrntVC what's the first thing you tell a seller who has good data but no workflow documentation?

[gaurav @gauravsunil_]

@TrentKrupp generic ego IS commoditised, agreed. the gap is specialized workplace tasks with frontier rigs, where supply is genuinely scarce. what would change your mind?

[gaurav @gauravsunil_]

@hugoleprince the next gold mine in egocentric data is access. specialised workplaces with complex tasks. nobody wants more repeatable everyday tasks shot on phone rigs

[gaurav @gauravsunil_]

@hugoleprince what i keep seeing in egocentric data: buyers want calibrated cameras, imu synced to video, visible hands, varied real scenes (not staged), and clean consent. most sample sets i've looked at fail on calibration and sync, so check that first.

[gaurav @gauravsunil_]

general data brokering is crowded. egocentric human data is still early and specialised. i'm documenting the collection, QC and buyer process in public as we figure it out. is this the next gold rush? curious who's buying

[Erik Newsham @eriknewsha]

it is obvious that the data broker space is overcrowded. I would not recommend becoming a general data broker nowadays. with that said, here are ACTUAL more niche ways to earn money in the data space now:

1. de-identification. we spend a stupefying amount on on it. around 35k/TB on non-edge cases! this is at least a 7 figure monthly cost for brokers like us. it is a pricey tax that must be paid. there’s relatively few companies that do de-id well. run Presidio and GLiNER and maybe a 32b Qwen model for hard cases. then run and fine-tune based off of results. even that simple pilot could show signs of pareto!

it is crucial your de-id system needs to:

a) rigorously sanitise to industry standards (obviously)

b) map multiple variables to a single entity (e.g erik newsham, E.N, erok gets translated into a de-id representation of me)

2. devote yourself to the buy side. since everyone and their grandma has become a broker, there is now a glut of brokers with company data to sell, yet they have no one to sell it to! devote yourself to finding data buyers. a few efficient ways to increase surface area of buyers is to: go to SF and get face to face with researchers, mass cold email outbound or fill out our grepped partners application as we are actively buying. once you have found data acquirers, tell brokers you can help them offload for 20% commission.

3. build a financial market for corpora. the current data market is unlit. often two labs bidding for the same corpus have given us vastly different prices (which is not automatically bad as there isn’t one fixed value for data). we have been asked directly by several labs for historical transaction data. as data is so fuzzy and context-dependent it would obviously be hard to standardize, so maybe the form this market would take is a marketplace. a safe air-gapped agentic system could scour an entire corpus, verify, note and map everything needed for a buyer to make an informed decision. solving data's Arrow Information Paradox. a corpus could be sectioned and sold as parts. overtime, transactional data is produced and “data class indexes” could emerge and efficiency in this currently inefficient market would flourish. companies could list data as an asset and “IPO” their corpora. there are obviously many variables (license time and exclusivity for example) but through a streamlined process that irons out rights, QC, de-id and other commonplace wrinkles. this would be more like art indexes than crude indexes

4. make autonomous lab machinery. I am super super autonomous lab pilled. ask claude to cure cancer and it will come back with experiments that need to be done to further advancement. we simply have not conducted enough experiments. the (very) simplified loop of an autonomous lab is goal→conduct millions of simulated experiments→select top performers (and a few moonshots) for real world experiment→use successes and failures to update simulation and make progress. periodic labs and anthropics wet lab are really cool examples of this. from what I have heard though, the machinery isn’t super great and is a major bottleneck.

5. broker financing. some companies would rather $400k now than $600k in a month. for an instant deal to happen, a broker needs money and a lot of these new brokers have, uhh, interestingly sized liquidity pools (they are broke). by lending them money to buy corpora upfront, they close a deal that would never have happened and you make a nice slice of the spread for providing them cash short term.