Built a financial API with cache layer that holds data for ~12,400 companies with lookups return in under a millisecond. The full dataset is ~242GB / 853.8M+ records:
- Prices (46+ years of daily history, split-adjusted)
- Valuation ratios (22 types, daily)
- Financial statements (everything)
- Business segments and KPIs
- Insider and institutional ownership
- Analyst estimates and earnings calendar
- ETFs
- Computes itself: returns, risk, heatmap,FG
All 328 public methods work the same way: pick a cache, pick a method, pass the parameters.
But, not accounting for
1. Answered correctly by accident
2. Answered incorrectly by accident
3. Answered incorrectly because test was flawed (grey box around one text, not even, can impact decisions)
4. Guessed at all responses (all A)
5. Gamed responses (perfect score)
6. And the list goes on
7. Every person tested is different, grandfather, father, son, child, and this is just basic
64% but heavily skewed
@marclou Truth, now just imagine how many boring businesses are flying under the radar, not listed, don't care to be listed, and printing. < More to be said here, way more.
@dejanseo The moment I realized human evaluations and labels were fundamentally flawed changed how I train models forever.
Original
data β human grading β silver/gold set
Observed
data β synthetic grading β silver/gold set
Mix in expert/spot evaluations as needed
@jackfriks Man, the moment you leave your house, look around, it's unreal how many businesses around you are doing millions/month, even hundreds of millions.
As for earning more, you can and it starts with perspective.
@jackfriks Wait until you have 5+ m invested. As for those grinding start small, build, sell, invest, and repeat. After you've done it once it gets easier and easier.
Ordering $50,000 in server hardware today and reflecting on a post I read earlier that asked, "Why is it so difficult to build a genuinely good X, Y, or Z, and why do so many products remain 'good enough' for half a decade without ever becoming great?"
The answer, in most cases, is not capability.
It is priorities.
One company pushes X, another pushes Y, and another pushes Z, all because each benefits the seller. I see shit like this every day, it's not what's best for the owner, but rather what's best for the seller.
In my experience, greed and ego explain a large percentage of mediocre products and services.
Companies CAN build something better, take starlink, starship, building quality is a decision.
Most prioritize profit first, investors second, and customers last.
Take hosting.
I do not need to:
> Invest in quality servers
> Pay 40k per month for Cloudflare Enterprise
> License LiteSpeed Enterprise
> Include real WordPress management
> Promise zero technical debt
> Maintain 90 days of redundant backups
I could operate with a fraction of that investment and significantly increase my companies profit.
I choose not to because I know exactly how this industry operates. I know companies still running production servers from 2013 on outdated kernels.
Can they upgrade? Absolutely.
Will they? No.
Most people are not aware that Cloudflare Enterprise is modular. Contracts are assembled like Lego blocks.
One company may technically offer "Cloudflare Enterprise" with a single component, another may have a handful, and others may have more than 100 enterprise features and configurations enabled.
All of them advertise the same label, yet they are not remotely the same product.
Now consider the customer's side.
Within 48 hours, I can move a business owner into what is effectively a top 1% WordPress hosting environment, complete with real WordPress management, for $1,490 per year or about $124 per month.
Consider for a moment that some companies charge $200/mo or more for WordPress management alone, and let that sink in for a minute.
No technical burden.
No infrastructure management.
All existing technical debt resolved.
Full WordPress management.
No worrying about backups, performance, security, updates. etc.
Owners focus on business, and for $124/mo, this is a joke to the vast majority making money, every day, 365 days a year.
Circling back to mindset, I believe the people who fail to see it are often operating from the same greed-and-ego framework. They have to sell X, so they recommend it to everyone relentlessly, whether it's right or not.
And the why is simple!
It comes down to what you choose to prioritize, the decisions you make, and whether you are willing to put quality ahead of profit.
More importantly, it is whether you are willing to put the customer ahead of yourself and your business, and prioritize a genuine win-win relationship.
At which point, I believe there is no limit in business.