Arek

notes to self

[Arek @arekhalpern]

elucide updates

✔️ backend crawler

to enrich the knowledge that elucide chat will have access to, an internal crawler is table stakes. introducing elucide-crawl.
to make it fun i added a bloomberg terminal style ui

implementation details:

- 100% python
- postgreSQL database with schema-based storage
- real-time metrics with 5s persistence
- depth-aware crawling with configurable limits
- URL deduplication and frontier management
- response compression and header normalization
- user agent rotation for politeness
- error tracking and retry mechanisms
- structured data extraction pipeline
- session-based crawl management
- bloomberg-style terminal UI:
- real-time metrics panel
- active sessions monitor
- live crawl logs
- command interface
- sub-second UI refresh rates
- CPU/memory usage tracking
- response time analytics
- depth-aware progress tracking

[Arek @arekhalpern]

elucide updates

✔️ web search

seems like a simple feature to implement but it complicated because my architecture is optimized for low-latency thread posting/patching.

the demo showcases elucide in action as a cloud-based webapp. its faster then chatgpt at crud.

why would you want your data stored in the cloud? for long term memory which equals personalization.

websearch implementation details:
- Implemented handleToolEvent callback for agent mode state transitions
- Added memoized shouldShowAgentSteps for temporary/permanent thread management
- Enhanced stream processing to parse tool events in content messages
- Optimized setIsWaitingForFirstToken for agent mode operations
- Automated web search command prefixing
- Implemented 1s timeout for tool event cleanup
- Added thread state transition handling
- Implemented temporary thread cleanup with state preservation

[Arek @arekhalpern]

@jxnlco missed an opportunity to put him in the launch vid

[Arek @arekhalpern]

🤯

[1X @1x_tech]

NEO’s Hands
An API to the Physical World

[Arek @arekhalpern]

economies of routing

[MTS @MTSlive]

SITUATION EXPLAINED: 70% of frontier model queries could run locally for free.

@ClementDelangue, co-founder and CEO of @huggingface:

"There was an interesting study from Stanford published last year showing that 70% of the queries that people ask to ChatGPT could be accurately answered locally on your laptop. For free."

"Most of the AI workloads that people do today with frontier models could be done by models that are cheaper, faster, more customizable, more controllable. And they don't do it because frankly it's a pain to pick the right model."

"You're subsidized so you don't have to care because you have your subscription, so you route everything to Einstein. 'Hey Einstein, what's the weather today?'"

"In normal life, he would be like, 'I'm not answering your silly question.' But because it's AI and subsidized by the AI labs, all the questions are getting routed to Einstein versus in an ideal world you have different models that are more specialized and better at answering your questions in different domains."

"It's possible that routing is gonna redistribute a lot of the value capture from frontier models to a more long tail of models. It's like AI maturing... we are in the first phase where it's very simple, everyone using just one giant model. Now we're moving to the second phase."

[Arek @arekhalpern]

My cap

[Hoop Herald @TheHoopHerald]

“My confidence comes from my work ethic…every time I have the ball I’m just thinking of me alone in the gym”

Not a harder worker in the NBA than this man

[Nike Basketball @nikebasketball]

Sleep well, NY.

[Arek @arekhalpern]

@rileybrown 85th st deli Jamaica queens

[Arek @arekhalpern]

ppl dont realize theres feeder schools to the feeder schools as well

[Mercurius @MercuriusFilius]

Elite feeder schools dominate Ivy League admissions and have long served as the primary pipeline for both old money and new money students. These are the institutions where America’s most elite families send their children to prepare for their future roles in society — far beyond mere education.

Roughly 20 high schools consistently send more students to Ivy League colleges than most others combined.

America’s wealthiest families have long funneled their children into these schools, many of which have been reliable Ivy League feeders since the 1600s and 1700s.

[Arek @arekhalpern]

@yacineMTB ppl dont understand how many third world countries are about to prosper at a rapid pace like never before

[Arek @arekhalpern]

LGK!

[NEW YORK KNICKS @nyknicks]

START SPREADING THE NEWS 🗞️

[Arek @arekhalpern]

@pmarca Have you seen the latest commencement speech reactions?

[Arek @arekhalpern]

@netcapgirl 😂😂😂

[sophie @netcapgirl]

this is KD joining the warriors for people who know linear algebra

[Arek @arekhalpern]

@XP_Ehsaan @jackzumwalt my personal dashboard

[Arek @arekhalpern]

@signulll sounds fun

[Arek @arekhalpern]

Main issue with Claude - lack of discernment

[Arek @arekhalpern]

@karpathy funny that human tendency to forget things sometimes is a feature not a bug. unsure how we’ll emulate this in llms

[Arek @arekhalpern]

Finally

[Claude @claudeai]

New in Claude Code: auto mode.

Instead of approving every file write and bash command, or skipping permissions entirely, auto mode lets Claude make permission decisions on your behalf.

Safeguards check each action before it runs.

[Arek @arekhalpern]

Children chase robot in New York City

[Arek @arekhalpern]

@DavidSHolz @bdmarotta @midjourney Couldn’t you just compete directly with fal/replicate. I know you are different companies but adjacent nonetheless