Brian Hulette

I like to make things. Software engineer @Google, @ApacheArrow JS committer

[Brian Hulette @BrianHulette]

@flightaware @algoriffic Also made this gif showing one day of MD-11s and DC-10s, used by FedEx (and some UPS). FedEx flights are in/out of Memphis. UPS - Louisville

[Brian Hulette @BrianHulette]

This morning a 🐝 was happily buzzing along, searching for flowers to pollinate, when suddenly it found itself IN MY NOSTRIL. Neither one of us is happy with the outcome.

[Brian Hulette @BrianHulette]

@lak_luster @ApacheBeam Thanks for live-tweeting my talk @lak_luster! I missed this completely until @svetaksundhar told me about it :)

[Brian Hulette @BrianHulette]

@paul_rietschka @lak_luster @ApacheBeam Yes! The slides are at https://t.co/QBGuJd9Vsc and the recording is now available at https://t.co/P9TalmpruX

[lak lakshmanan @lak_luster]

Used to be that you had to read in Beam, add a schema, and then convert to a Dataframe. But now, super-familiar pandas-like read_csv etc just works

[Brian Hulette @BrianHulette]

Most notably, we now have support for pandas' groupby.apply() method. It's an incredibly flexible operation for performing aggregations, but just like in standard pandas there's a performance penalty. In Beam's case it's because we can't do combiner lifting.

[Brian Hulette @BrianHulette]

@ApacheBeam 2.29.0 was released last week! It has several bugfixes and improvements for the Beam DataFrame API as we march towards exiting experimental.

https://t.co/bhcjq5C7u0

[Dominik Moritz @domoritz]

Today, @ApacheArrow JS 4.0 dropped. I implemented an improvement that speeds up iterating over Tables and Vectors by ~2X. https://t.co/tGvZEmmFoG

[Brian Hulette @BrianHulette]

Really excited to see this @ApacheArrow work out of @uwdata!

[Jeffrey Heer @jeffrey_heer]

For example, here are benchmark results (in ms) for sequentially parsing, counting, and filtering 5M row Arrow tables (node v14, 2017 MacBook Pro). In many cases, Arquero matches or exceeds the performance of the reference Arrow JS implementation!

[Jeffrey Heer @jeffrey_heer]

For example, here are benchmark results (in ms) for sequentially parsing, counting, and filtering 5M row Arrow tables (node v14, 2017 MacBook Pro). In many cases, Arquero matches or exceeds the performance of the reference Arrow JS implementation!

[Brian Hulette @BrianHulette]

@KennKnowles It'll be harder to keep track of the depressingly large number of House Republicans - 127

[Serhii Sokolenko 🇺🇦 @datancoffee]

Spark has Koalas, and Beam has ... well, Pandas. Pandas DataFrame API is now supported in @ApacheBeam. Develop pipelines using DataFrame, and run them on top of highly-scalable distributed infrastructure. I will let you decide which mascot is cuter. https://t.co/6t8MLGqbw9

[Brian Hulette @BrianHulette]

Really exciting to show off these new features with Robert :)

[Aizhamal Nurmamat kyzy @iamaijamal]

Check out all of these new, nifty utilities to develop nicer @ApacheBeam Python pipelines with #schemas!
If you are not watching this talk by @BrianHulette and Robert Bradshaw at @BeamSummit, here are their slides and video will be uploaded soon💥
https://t.co/gJHq2Bf9Ua

[Brian Hulette @BrianHulette]

Someone is running around my neighborhood putting googly eyes on everything. @MrTrashWheel would be proud.

[Brian Hulette @BrianHulette]

My wife is in healthcare so I'm alone in the apartment all day working from home. At least I have this joker to keep me company. I call him bumpy.

[Brian Hulette @BrianHulette]

Saw the Christmas Ship Festival in Seattle for the first time last night, what a great tradition! This incredible shot brought to you by my wife and Google (night sight + photos panorama stitching)

[Brian Hulette @BrianHulette]

Finally hit my goal of running 1000 miles in 2019 today! When I set the goal early this year I thought it would be a cakewalk, but after a few weeks of slacking off I found myself playing catch-up here at the end.

[Brian Hulette @BrianHulette]

I love this criteria, it's what makes contributing to open source so rewarding.

[Brian Hulette @BrianHulette]

@wesmckinn @ApacheParquet @ApacheArrow @intel Great news! Excited to use this in @ApacheBeam's ParquetIO

[Brian Hulette @BrianHulette]

The slides from my talk at the first Seattle @ApacheBeam meetup are available at https://t.co/28vdbx0k5J. Thanks to all who attended and I look forward to seeing you again at the next one :)

[Brian Hulette @BrianHulette]

Got my laptop all done up with @TheASF stickers thanks to @ApacheCon and @BeamSummit :)