skippr

Automated schema discovery, evolution and data ingestion.

[skippr @skipprdata]

Everything is Bon.
Universal data format converter tests ✅

Docs and Quick Start: https://t.co/gyTKJOgmt4

#parquet #avro #orc #apachearrow #dataops

[skippr @skipprdata]

@JohnKutay Real world:

""
0
-
<empty>
test

FML 🤦‍♂️

[skippr @skipprdata]

Ahem...🙋

[Jasmine Hughes @Jas_Hughes]

Me building a thing: Haha fuck yeah!! lets store it in JSON!!!

Me analyzing data on a thing: Well this fucking sucks. Why is it stored in JSON?!!

[Wes McKinney @wesmckinn]

I've been keeping an eye out for this project (Tuplex, formerly TupleWare) since the first paper was published in 2014. Excited to see that it's finally been open sourced with an Apache 2.0 license:

https://t.co/RchsLKIe6s

New paper with context here: https://t.co/lxnip0zPBL

[skippr @skipprdata]

...and thanks for helping us! 😊

[skippr @skipprdata]

Which Skippr EL(T) differentiator is most valuable? 🙋‍♀️
#dataops #elt #moderndatastack

[Wes McKinney @wesmckinn]

5 years later, it seems to be really catching up with everyone

[skippr @skipprdata]

Suspect a primary use for Skippr will be to migrate data to @ApacheArrow

[skippr @skipprdata]

Avro ✅, Parquet ✅, Json ✅, CSV ✅, XML ✅

Docs: https://t.co/gyTKJOgmt4

#parquet #avro #orc #apachearrow #dataops

Which data format next?

[skippr @skipprdata]

Skippr is in "stealth mode"... that's why no one asked fyi

[dbt @getdbt]

So much cool & exciting stuff happening in the data processing / storage space

What do you have your eyes on? 👀

[skippr @skipprdata]

#aws #athena engine version 2 supports schema evolution. You can now enjoy the full power of https://t.co/5fsR2jzjQZ + #Parquet.

[skippr @skipprdata]

Spending more time reading the @getdbt Slack channel than working on our internal Slack. #Friday

[dbt @getdbt]

CEO: "We are a data-driven organization."

Data Team: 👀

[skippr @skipprdata]

@sethrosen If you know, you know :)

[Seth Rosen @sethrosen]

Have you seen the one where they make a string into a float?

It’s an amazing cast.

[skippr @skipprdata]

@eineBanaleFrage @wesmckinn https://t.co/RyDKlgg7bm auto-detects the separator ';,\t|' and column data types. Would be very interested in hearing what mileage you get... and testing detection of any separator char.

[Seth Rosen @sethrosen]

why is it called a data lake and not a parquet lot?

[skippr @skipprdata]

Interesting results! So tools like #fivetran are great at normalized data, but how are the nested data folks loading raw data currently?

You can test drive https://t.co/5fsR2jzjQZ nested schema discovery and evolution here: https://t.co/2DdreaJwnK

[skippr @skipprdata]

What data model do you prefer for Datalake analytics?

#snowflake #getdbt #dataform #datalakes #moderndatastack #dataops #parquet #orc

[skippr @skipprdata]

Learn how to get started with the free online Skippr Beta.

https://t.co/2DdreaJwnK

#data #datapiplines #snowflake