Chungers

tweets are mostly my own

[Chungers @dchungsf]

“First Principles: Elon Musk on the Power of Thinking for Yourself” by @james_clear https://t.co/AZty1bQCAd

[Chungers @dchungsf]

https://t.co/SpA99sFglW

[Chungers @dchungsf]

[1912.01412] Deep Learning for Symbolic Mathematics https://t.co/FbWiMq2FNM

[Andrew Beam @AndrewLBeam]

A few nuggets from @geoffreyhinton's talk from earlier today at the #ml4h unconference. First up, the distinction between statistics and AI (and presumably ML by implication). Overall, I think these are pretty clean contrasts:

[Andrew Beam @AndrewLBeam]

On the (unexpected) connection between neural nets and decision trees. Decision trees are inefficient because the leaf nodes operate on a very small fraction of the full data. DNNS with ReLU can be thought of as a kind of decision tree with massive amounts of parameter sharing.

[Apache TVM @ApacheTVM]

Introducing @PyTorch 's TVM-based backend by Bram Wasti (Facebook). seamless integration and great speedups. 🔥🚀🚀https://t.co/bKhLLmK0Ze

[Chungers @dchungsf]

https://t.co/jSivRlFkUz

[PyTorch @PyTorch]

[v1.0] : JIT Compiler, Faster Distributed, C++ Frontend, CUDA10
Read more about the changes at https://t.co/Xfrad06NZO

As always, get the install commands on https://t.co/DeaBDSRxs8

[Jaana Dogan ヤナ ドガン @rakyll]

We are running this huge experiment globally with Kubernetes but there is already a decade-run experiment from Google. No one understands borg config at this company. No one likes to engage with this abstraction layer.

[Chungers @dchungsf]

Predictive test selection to ensure reliable code changes - Facebook Code https://t.co/ZMMdMDS7gk

[Derek Collison @derekcollison]

Interesting debates with OSS business models. We all know they are broke, glad to see more movement to see what can be done. I believe there are only 3 models that will work long term.

1. Bundle OSS w/ Hardware
2. Run it as a Service
3. Augment it with a Service.

[Andrew Ng @AndrewYNg]

Just read this cool paper: Neural net pretraining keeps improving when you train on an unprecedented 3.5 billion (that's really big) labeled images and transfer to new task. IMO we're still nowhere near the limits of pretraining/transfer learning. https://t.co/n92buesXph

[Charity Majors @mipsytipsy]

Doing is the engineering superpower. In the absence of doing, nothing gets done. We don't always have to convince and cajole and coerce others into building on our behalf, we can just *build^.

This may seem basic, but it matters.

[Bryan Liles @bryanl]

I hate circling around this, but I hate seeing and participating diversity in tech discussions.

I’m taking a new approach. If you are a person of color who enjoys this whole Kubernetes thing and wants to work with me, reach out. I have some ideas. Please RT for reach.

[Reza Zadeh @Reza_Zadeh]

Software Engineering is evolving for Machine Learning. New forthcoming tools:

- Version control for ML models & pipelines
- IDEs for neural network architectures
- Compilers & Hardware Instruction sets for AI chips
- Programming languages with stochastic functions that learn

[Will Larson @Lethain]

Organizations have a lot of state, which means they change slowly. I think the hardest cycle of org leadership is (a) diagnosing problem, (b) placing a bet, (c) keeping the faith and creating the space to see if you picked right.

https://t.co/wCse5eZmiD

[Bryan Liles @bryanl]

Think about it. You've always been told you are smart. You've interpreted that as you are always right.

Reality: you aren't as smart as you think you are, and you are also an ass. https://t.co/3nluOXv01P

[Reza Zadeh @Reza_Zadeh]

Twitter is moving its Deep Learning infrastructure (DeepBird) to TensorFlow, and seeing the benefits. https://t.co/BVbycBzred

[Adrian Colyer @adriancolyer]

"Medea: scheduling of long-running applications applications in shared production clusters" Garefalakis et al., EuroSys'18. https://t.co/VPapM5KG9L #themorningpaper

If you run clusters with a mix of batch and long-running (e.g., web) containers, then check out Medea...