Here at @AgileDataIO we LOVE #BigQuery !!! It really is a magical service to underpin our magical platform. I accidentally dropped a dozen tables this morning π€¦ββοΈ Not a problem though ...I just used the time travel feature to restore them from a snapshot an hour priorπ
Whoot ! when a customer backfills data by dropping 749 json files into your inbound bucket ... all appended beautifully into a BigQuery table, 300 million records later @AgileDataIO and @GoogleBigQuery .. simply magical !
Thanks #google , here at @AgileDataIO we're loving the new #cloud_spanner Query Insights feature !! seeing the Top N query patterns over the last 30 days is really useful π
Thanks #google ! loving that the #cloud_spanner console now displays views. Here at @AgileDataIO cloud spanner is our 'do everything' database, and being able to see our views in the console is awesome π
@shagility @AgileDataIO Loving the ease of use of Googles #CloudDQ framework... it worked 'out of the box' with @AgileDataIO 's validation rules pattern
A "modern data stack" is one that you don't spend your xmas holidays performing "maintenance". I had a beer with a friend last week. He is "moving disks" over the holidays ... Wouldn't you rather spend your summer (or winter) at the beach or on the slopes ?! @AgileDataIO
@KiwibankNZ Managed to log in briefly just after 7am, then it stopped again ... "upstream connect error or disconnect/reset before headers. reset reason: connection failure" ... π¦
@shagility @AgiledataIO And the best thing about that ... not a Data Engineer in sight π ... business rules as config, backed by a server-less architecture, boom ! data arrives ready to consume
Two more BigQuery features rolling out for the holidays that make me unreasonably happy: Comma at the end of a list now works (putting an end to the comma-first vs comma-last debates), and small queries just got twice as fast.