Tathagata Das

All things streaming in @ApacheSpark | @DeltaLakeOSS | software engineer at @Databricks

[Delta Lake @DeltaLakeOSS]

😎 Delta Lake community is excited to announce the release Version 1.2.0.

📈 Check out the release notes: https://t.co/LBl3sXQKkE

#deltalake #dataengineering

[Databricks @databricks]

Kick back with a coffee and your laptop — episode 6 of #DataBrew is here ☕️

@2twitme + @tathadas discuss their big data journey and the evolution + upcoming trends of data architecture. Check it out! https://t.co/EpJPj2OW1F

[Tathagata Das @tathadas]

@SubbuBanerjee @databricks @DataCouncilAI @ApacheSpark I have feeling my beard is being mocked here 😂

[Delta Lake @DeltaLakeOSS]

We’re excited to announce the availability of #DeltaLake 0.3.0 including Scala/Java APIs for DML commands, query commit history, and vacuuming old files. https://t.co/u1XhBcpbHm

[Tathagata Das @tathadas]

@jaceklaskowski @GawedaTomasz Naah, I didn't talk about CP at all. There was a tiny bit more support added for streaming aggs in CP but still pretty experimental.

[Tathagata Das @tathadas]

Not every day do you see @ApacheSpark @databricks @Azure and green renewable energy in the same story. This is awesome. https://t.co/NMW0UkFKER

[Tathagata Das @tathadas]

@jaceklaskowski Lol.

[Scott Guthrie @scottgu]

Awesome to see Azure DataBricks is now Generally Available.
Spark as a Service + so much more: https://t.co/ksSzAIQaPB

[Tathagata Das @tathadas]

In case you missed, we build super low latency mode in #StructuredStreaming in @ApacheSpark. Now get sub-ms latencies reading and writing to @apachekafka. Read more in our blog - https://t.co/VjtxRN7RS3

[Tathagata Das @tathadas]

@GawedaTomasz Indeed. Not sure whether to feel happy that I am not more idiot than others, or to feel sad at the world we live in. :/

[Tathagata Das @tathadas]

**Second attempt** at posting the correct blog link for #ApacheSpark #StructuredStreaming stream-stream joins :/ #iamanidiot

Here it is - https://t.co/jDaoY8Jg4N

[Tathagata Das @tathadas]

@dawrutowicz There's going to be a more detailed blog post on that soon. Stay tuned.

[Tathagata Das @tathadas]

I wrote a blog post about Stream-stream joins in #StructuredStreaming in @ApacheSpark 2.3.0. Feedback welcome!! https://t.co/Je9dIO8lQN

[{Jules Damji}=💻📚📝 @2twitme]

.@databricks @michaelarmbrust delves into concepts behind #StructuredStreaming #StrataConf

[Databricks @databricks]

Introducing Apache Spark 2.3: Now Available on Databricks Runtime 4.0 Beta
https://t.co/vL3nkS1pTK

[Tathagata Das @tathadas]

@2twitme lol. you make my words sound more poetic than they really were. https://t.co/18jGzW1swT

[{Jules Damji}=💻📚📝 @2twitme]

.@ChiefScientist asks what does it mean for people to do streaming? @tathadas responds “it’s like teenage sex. Everyone wants to do it, but no one knows how.” But we are making it easier to understand requirements & a range of latencies & modes of streaming. ##SMACK2.0 #indexConf

[{Jules Damji}=💻📚📝 @2twitme]

.@databricks @tathadas will be on the #SMACK2.0 panel with @ChiefScientist & others https://t.co/lnLUSaf9Ix

[Tathagata Das @tathadas]

@ChiefScientist @indexconf @ApacheSpark @databricks Thank you very much for having me! I am super excited!

[Tathagata Das @tathadas]

@GawedaTomasz Yes, 2.3.

[Tathagata Das @tathadas]

@kdmaile @ApacheSpark Thank you!