الـ Web Scraping.. فلاحه تقنية ولا انتهاك خصوصية؟ 🌐💻
هلبا منا كـ developers أو مهتمين بالبيانات نعتمدوا على الـ ويب سكراب (Web Scraping) باش نجمعوا داتا، نبنوا نماذج ذكاء اصطناعي، أو حتى نراقبوا السوق وتغيرات الأسعار.
Andrej Karpathy just dropped a project scoring every job in America on how likely an AI will replace it from 0-10
> Scraped all 342 occupations from the Bureau of Labor
> Fed each one to an LLM with a detailed scoring rubric
> Built an interactive treemap where rectangle size = number of jobs and color = how exposed that job is to AI
The key signal in his scoring: if the work product is fundamentally digital and the job can be done entirely from a home office, exposure is inherently high.
The scale:
0-1: Roofers, janitors
4-5: Nurses, retail, physicians
8-9: Software devs, paralegals, data analysts
10: Medical transcriptionists
Average across all 342 occupations: 5.3/10.
The entire pipeline is open source. BLS scraping, LLM scoring, the visualization. All of it. Much respect for the sensei this is scary and awesome
How AI empowered Paul Conyngham to create a custom mRNA vaccine to cure his dog’s cancer when she had only months to live. The first personalized cancer vaccine designed for a dog: