@scalding

Scalding is a scala DSL for Cascading, running on Hadoop. It's concise and functional, and it's just good, clean fun.

 The Interwebs (San Francisco)
github.com/twitter/scalding
Joined December 2011
  • Tweets742
  • Following77
  • Followers4.5K
20Media
Scalding retweeted
JP
@JP_smasher10 Mar 2021
Today's @scalding job looks like ... a vacuum tube. It even has a cathode/anode (with a gap between)!
1
1
14
For me personally it was @scalding for sure.
Cindy Sridharan@copyconstruct20 Dec 2019
As the decade almost comes to a close, I wanted to ask the developer community: what has been the most transformative tool/process/workflow that originated in this decade (2010-2019)? The one that has had an outsized impact on your development process or your organization?
2
1
10
That awkward moment when you’re at a Spark talk and the main takeaway is that Scalding is much better at doing this, just read the Scalding source code and implement it. 😅
4
3
1
31
. @scalding 's first line of the README is a classic of the genre: "Hadoop is a distributed system for counting words."
3
1
9
When you forget how @scalding Executions work...
3
3
2
73
I thought @google had learnt what I mean when I look for @scalding I guess adding 'execution' made it more challenging
1
1
8
😬 xitter.cf/mfedoryszak/status/994…
Mateusz Fedoryszak@mfedoryszak9 May 2018
I thought @google had learnt what I mean when I look for @scalding I guess adding 'execution' made it more challenging
4
My attempt at rendering the @scalding logo in DAG.
1
17
Scalding 0.18 is nearly here, the biggest release in years. This features a new optimizer backend which allows much more powerful job simplifications. It also enables a scala-only in-memory backend. The long awaited Spark backend will be in alpha: github.com/twitter/scalding/…

Spark backend by johnynek · Pull Request #1832 · twitter/scalding

This is a very basic beginning to a spark backend. It is not complete, but does support map-only operations. There is one big question: can we really just lie to spark and say we have AnyRef everyw...

github.com
3
14
37
The one and only @posco will speak at @sfscala on March 29. We need a big venue! Also, great FP+ML questions are always in order. We also hope to hear about @bazelbuild for #Scala. Perhaps folks might be able to ask questions on @scalding of Algebird too! meetup.com/SF-Scala/events/2…
2
6
12
Guide To High Performance Distributed Computing: Case Studies With Hadoop, Scalding A here zpy.io/62f48481 #hadoop @machinelearnbot
6
10
Featran, aka feature transformer, featran77 or f77, a #scala lib for feature eng on #Scio @Scalding #Spark #Flink bit.ly/2rSQ4M6
1
13
1
20
Scalding 0.17 released with support for scala 2.12. Thanks to @justsovanilla for shepherding this release: github.com/twitter/scalding/…

Release Scalding 0.17.0 with 2.12 support! · twitter/scalding

This is the first Scalding release that publishes artifacts for Scala 2.12! Here are some of the changes that are part of this release: 2.12 releated updates: #1663, #1646 Use reflection over Jobs...

github.com
8
10
Help us build the next-gen data platform at Twitter (using Scalding, Spark, Summingbird, Hadoop, Heron) - careers.twitter.com/en/work-…
1
28
1
32
Algebird 0.13.0 is out: github.com/twitter/algebird/… scala 2.12 and typelevel cats/algebra compatibility!

Release Scala 2.12 goodness! · twitter/algebird

This is the first Algebird release to publish Scala 2.12 artifacts! Apart from that, here are some of the changes since the last release: Various BloomFilter improvements: Remove seed variable in B...

github.com
9
1
23
With @jack at the #hackweek demos @gerashegalov @krishnansriram @justsovanilla #SlimScalding
3
8
1
28
Load more