Scalding

Scalding is a scala DSL for Cascading, running on Hadoop. It's concise and functional, and it's just good, clean fun.

[JP @JP_smasher]

Today's @scalding job looks like ... a vacuum tube.

It even has a cathode/anode (with a gap between)!

[Scalding @scalding]

@debpriyaSeal @enriquebrgn @bawejakunal @3_stan

[Scalding @scalding]

@enriquebrgn @bawejakunal @3_stan

[Scalding @scalding]

@realredramen 😢

[Adam Laiacano @adamlaiacano]

For me personally it was @scalding for sure.

[Sayan Sanyal @shaayohn]

That awkward moment when you’re at a Spark talk and the main takeaway is that Scalding is much better at doing this, just read the Scalding source code and implement it. 😅

[Jeffrey Davis @penland365]

. @scalding 's first line of the README is a classic of the genre:

"Hadoop is a distributed system for counting words."

[Luca (also on the other platforms) @__lucab]

When you forget how @scalding Executions work...

[Mateusz Fedoryszak @mfedoryszak]

I thought @google had learnt what I mean when I look for @scalding I guess adding 'execution' made it more challenging

[Scalding @scalding]

😬 https://t.co/2yLEWAaQjI

[Mateusz Fedoryszak @mfedoryszak]

I thought @google had learnt what I mean when I look for @scalding I guess adding 'execution' made it more challenging

[Alexander Huras @athuras]

My attempt at rendering the @scalding logo in DAG.

[Scalding @scalding]

@vitalygordon Here are the tests: https://t.co/7tlMyZ9ddp we will prepare some release notes when 0.18 goes out which explains all the new features.

[Scalding @scalding]

@rwhitcomb They won’t. But we should just add a serialization test. Using JobTest with runHadoop will find serialization errors, but people don’t always do that.

[Scalding @scalding]

@vitalygordon An Apache beam backend would be similarly easy now. We are also contemplating a Hadoop mapreduce or Tez backend (without cascading).

[Scalding @scalding]

@vitalygordon The in memory mode has no dependencies but scala concurrent. You choose to run a job in scalding memory mode OR cascading (Hadoop or memory) OR spark. You can’t (currently) change the mode as the job proceeds.

[Scalding @scalding]

Scalding 0.18 is nearly here, the biggest release in years. This features a new optimizer backend which allows much more powerful job simplifications. It also enables a scala-only in-memory backend. The long awaited Spark backend will be in alpha: https://t.co/LamBPQdQiN

[Alexy 🤍💙🤍 @ChiefScientist]

The one and only @posco will speak at @sfscala on March 29. We need a big venue! Also, great FP+ML questions are always in order. We also hope to hear about @bazelbuild for #Scala. Perhaps folks might be able to ask questions on @scalding of Algebird too!
https://t.co/sa1QpDfwgk

[Scalding @scalding]

@c_chep @alxarchambault @jvican @heathercmiller I *think* Args is serializable no?

[Scalding @scalding]

@justsovanilla Was great to work with you on the same code if not the same company.