@yoemsri They built the machines, got briefly replaced by people writing glue code for 15 years, and now the machines are giving the field back to them.
Poetic justice.
@warpstream_labs@redpandadata@0xeed@OlenaKutsenko Jio Cinema's Kafka at Scale by @kushal124
-Started with one cluster and then later split into multiple clusters based on workload, criticality
-Auditing all producers, consumers & assigning criticality to their https://t.co/oYMkqmBD1z
-Tracking noisy neighbour & throttling them
@marckohlbrugge I just wanted to take notes without leaving my terminal. So, when COVID started, and i had free time on my hands, i made this CLI
https://t.co/eTu8sIh27a
#TIL@engineering built snowflake to generate tweet IDs. these tweet IDs are 64bits.
their first 41 bits are of timestamp. The next 10 bits represent a machine/worker ID, preventing clashes. Rest of the bits are to generate multiple IDs in same ms on the worker
https://t.co/t72oaVF7CX
ULID(https://t.co/9M3V6dG64m) is the new cool kid in the town.
Unique, lexicographically sortable and improving database performance - better index scans, can use in partitioning
https://t.co/FymNsdy6iS
Shopify’s idempotency token is time based ULID, because these are unique which provide the idempotency) and also ordered by time requests can be quickly looked up in index and guess what! chances that you are querying requests that are next to each other temporally