@GergelyOrosz@EngGuidebook I'd probably add something about embracing technical debt.... done is better than perfect.. similar to staged delivery but applies to technical decisions
@GergelyOrosz@EngGuidebook Am super glad to see the safe testing in production there... a very efficient practice when done right but commonly labelled as wrong
When comparing row counts against historical counts, I find it unnecessary to use window function. It computes difference between every two subsequent days while only one comparison is really needed for the last day.
It's subjective, but I find using a self-join easier to read
@jamesdensmore Enjoying your book on data pipelines. Thanks! Particularly interested in chapter 8 on data validation, so providing a couple of ideas/comments here
we implemented a similar framework for validation based on SQL. We opted to use one SQL script that returns True/False instead of two scripts. I don't think this makes it less/more expressive but allows using more built-in SQL comparisons operators
@TheLal In practice, discovery aspects were more for analysts and product people (saw low adoption), while lineage aspects were more for data operations people (saw good adoption)
Good morning all! Here is a little reminder that we have:
📖Thousands of books cheaper than Amazon
📖Free delivery in Ireland
📖We ship overseas
📖New & secondhand books
📖All the latest bestsellers
📖Books start at less than €5
📖An independent bookshop
https://t.co/TbMwnWYMI4
If we can only have 6 people in our houses, how can we have 30 children in a classroom? It’s a reasonable question. But it’s not a contradiction; in fact, these measures are connected and coherent. The following explanation is a simplification, but illustrates the principle. 1/8
If #OpenRefine team could introduce only 1 of these which would you want? Better Automation for transformation workflows to re-apply workflow sequences or parts of them. Allow Online Collaboration by having private hosted online multi-user instances of OpenRefine.
Different people have different strengths. So requiring everyone to respond in the same way to a problem means that you care more about orthodoxy than fixing the problem.
As Ireland begins to open up tomorrow after many months, let’s remember that many independent retailers are facing uncertain futures.
They haven’t done this before, it’s all new territory. Plastering their ‘mistakes’ on social media to garner likes isn’t helpful.
Be sound 💚