Network Update: Upgrade to protocol 24 has been completed successfully.
Great job to all Nodes! This was one of the most challenging migrations.
Next up will be v25, deadline June 18.
✅ Crawler (CrawlPi) Detailed Analysis
Repo: https://t.co/DjKmIYN0OD
1. General Purpose
CrawlPi is a real-time Node.js crawler that pulls data from the Pi Blockchain (Stellar-based).
Its main goal is to fetch all necessary data (blocks, transactions, operations, effects, balances, claimants/lockups, etc.) and store it in MySQL, while also pushing analytics/statistics to Firebase Firestore for the ExplorePi website.
Unlike the official pi-explorer, it maintains its own indexed database → enabling faster and much richer dashboards and analytics.
2. Technology Stack
Component
Technology Used
Runtime
Node.js
Blockchain
stellar-sdk + Pi Horizon API
Database
MySQL (mysql2)
Analytics DB
Firebase Firestore
Scheduler
node-schedule (in getdata.js)
Config
.env + dotenv
Dependencies (package.json):
stellar-sdk, mysql2, firebase-admin, dotenv, node-schedule
3. Working Logic (index.js)
// Main file
block.block() // Ledger stream
effect.crawl() // Effect stream
operation.operation() // Operation stream
tx.transaction() // Transaction (fee) stream
Uses streaming (server.ledgers().stream(), .transactions().stream(), etc.).
Writes data to MySQL instantly as new ledgers/operations/effects arrive.
Supports seamless continuation using cursor system (stored in .env).
Press q for graceful shutdown — saves latest cursors to last.txt.
4. Modules (lib/ folder) — Detailed
File
Responsibility
Important Notes
block.js
Ledger (block) stream → writes to block table
Block duration (spend), total Pi, fee pool, success/fail tx counts
transaction.js
Saves fees of successful transactions to fee table
Only processes successful txs
operation.js
Operation stream → operation table + special Account creation
Type 0 (create_account) distinguishes Pioneer vs CoreTeam
effect.js
Most critical module. Handles balance updates, trustlines, claimants/lockups
Credit/Debit, trustline create/remove, claimable balance, lock, claimant status
database.js
MySQL connection pool + ex_sql() and query() wrappers
Mix of pool and single connections
firestore.js
Firebase Admin initialization (from env)
Pushes statistics to Firestore
5. Database Schema (database.sql)
6 main tables:
Account → public_key, balance, Role (Pioneer/CoreTeam), lock, created_at
asset → Trustline (non-native asset) tracking
block → Summary of every ledger (including spend time)
claimant → Pi lockup/claim mechanism (lock_time, unlock_time, status 0/1/2, claimed_at)
fee → Transaction fees
operation → All operations (with type_i)
Special Handling (in Effect module):
Native balance credit/debit
Trustline create/remove
Claimable balance (lockup) creation
Claimant claims (status 1 = normal claim, 2 = Core Team clawback)
6. Configuration (.env.example)
HORIZON_URL=https://t.co/knkyx5qMhh
FIRST_ACCOUNT=GDL35MYH4XX2KH4T5AILQQC2FN4NIOQF2QNKXKX74R2B2XHWWWQ4SFU4
# Cursors (ready for first run)
LEDGER_CURSOR=8589934592
TX_CURSOR=60129546240
OP_CURSOR=60129546240
EFFECT_CURSOR=1
pre_time=2020-12-31T22:47:31Z
# MySQL
DB_HOST=127.0.0.1
DB_PORT=3306
DB_DATABASE=explorepi
DB_USERNAME=...
DB_PASSWORD=...
# Firebase (Firestore)
FIRESTOREID=...
FIRESTORE_EMAIL=...
FIRESTORE_KEY=...
7. Analytics Engine (getdata.js)
Separate scheduled script (using node-schedule):
Runs specific queries every hour/day.
Pushes results to Firestore document statistic/data.
Calculates rich metrics:
Top 10 richest accounts (after fees)
Block time (daily/monthly)
Top payment senders
Top fee payers
Operation distribution
Claimant/lockup statistics (claimed, clawed back, lock periods, etc.)
Daily active users, daily payments, daily fees
Total Pi, Total Locked, Total Pioneers, etc.
The website reads this data directly from Firestore → very fast dashboards.
A very valuable reference project for anyone who wants to do data analysis in the Pi ecosystem.
@nkokkalis@inanjaccuse@Gerek_yokkikiki@mehmetozal@erdincdincer13@incegorbaskan@tekin63081@Chengdiao@DrChengdiaoFan@PiCoreTeam@krakenfx
#PiNetwork #CiDiGames #Web3Gaming
This is the most complete Claude Code setup that exists right now.
27 agents. 64 skills. 33 commands. All open source.
The Anthropic hackathon winner open-sourced his entire system, refined over 10 months of building real products.
What's inside:
→ 27 agents (plan, review, fix builds, security audits)
→ 64 skills (TDD, token optimization, memory persistence)
→ 33 commands (/plan, /tdd, /security-scan, /refactor-clean)
→ AgentShield: 1,282 security tests, 98% coverage
60% documented cost reduction.
Works on Claude Code, Cursor, OpenCode, Codex CLI. 100% open source.
A newly discovered fossil ape from northern Egypt is reshaping the understanding of early hominoid evolution, researchers report in Science.
The fossil finding suggests that the closest ancestors to modern apes may have emerged in northern Africa, outside the traditionally studied regions of East Africa. https://t.co/n3wo0iBuLb
Since Pi Day 2026, Pi Network has continued its gradual rollout of second migrations and referral mining bonuses.
This opens the door for Pioneers to bring additional Pi to Mainnet and further participate in the ecosystem. Note that first migrations still take priority for the network to complete, and second migrations do not impact the rate of first migrations.
Read more about second migrations https://t.co/FybNaW61kT
The initial version of the Pi Launchpad has been released as a Pi App on the Testnet with a test token! Because the Launchpad introduces new concepts for many Pioneers and uses mechanisms that differ from typical token launches in Web3, it is being introduced on Testnet first so the community can become familiar with how the process works before the Mainnet launch.
The Launchpad implements the mechanism in Design 1 of the PiRC (https://t.co/TRJcKD4dwS) released on the Open Network anniversary. Read more about the Launchpad in the Pi Day 2026 blog https://t.co/6cUmVcjOos
Cina luar biasa. Produksi bahan tekstil dari gedebong pisang. Pisang jenis abaka. Banyak ditanam di Philipina. Kabarnya bibitnya sulit didapat kalau mau nanam di Indonesia. Regulasi pemerintah Philipina ketat tidak membolehkan jual beli bibit pisang abaka!
@alghali ايضا صحه البيانات المقدمه عليها عامل كبير من صحه مخرجات النموذج
كل ما كانت البيانات صحيحه وموثقه المصدر بتكون النتائج افضل خصوصا في بيانات السوشيال والادعايا