Darryl Barnhart

Software engineer with emphasis on machine learning, backend, GPU programming, real time computer graphics

[Latent Space @LatentSpaceAI]

Catch @DarrylBarnhart speak @NVIDIAGTC today about our exciting work @LatentSpaceAI on scaling LLM with retrieval! 📚

There’ll be an open QA in 30 mins: https://t.co/C42yjpjEi1

[Darryl Barnhart @DarrylBarnhart]

@wightmanr Reminds me a lot of the equalized learning rate ideas from Tero Kerras et al in the StyleGan lineage. Also by using std norm init, the variance scaling in optimizers like ADAM is better defined. The grad has the same expected var as the weights (one).

[sarah hong ✨ @latentcodes]

We’ll be presenting our paper “Low Distortion Block-Resampling with Spatially Stochastic Networks” today at 9pm PST🧩🏰🎨

Joint work w/ @martinarjovsky @darrylbarnhart @iantbd @LatentSpaceAI!

➡️ paper: https://t.co/ZIUpj4iKNt
➡️ poster: https://t.co/SNbOCs9xqk

#NeurIPS2020

[Yuxuan Zhang @YuxuanZ84175540]

Excited to share our @nvidiaai work on reconstructing high-quality 3D models from monocular photographs and making StyleGAN a controllable neural renderer.
@ChenWenzheng @HuanLing6 @JunGao33210520 Yinan Zhang, Antonio Torralba @FidlerSanja
paper: https://t.co/EkcppBDzyT

[Google AI @GoogleAI]

Check out Performer, a generalized attention framework based on the Transformer architecture, which implements the novel FAVOR+ algorithm to provide linearly scalable, low-variance and unbiased estimation of attention mechanisms. Read more at https://t.co/lLzhXJRIbh

[Darryl Barnhart @DarrylBarnhart]

@SebAaltonen I'd be curious to trade notes on this, as I implemented something very similar about a year ago. Rust + vulkan using atlased mipmaps. I also had a raster pipeline to generate SDF tiles for real time streaming of analytic surfaces.

[Alec Jacobson @_AlecJacobson]

Purposefully overfit neural networks are an efficient surface representation for solid 3D shapes

In https://t.co/m4heg8orD7 with Thomas Davies, @DerekRenderling, we make a few observations:

[PyTorch @PyTorch]

v1.6: native mixed-precision support from NVIDIA (~2x perf improvement), distributed perf improvements, new profiling tool for memory consumption, Microsoft commits to developing and maintaining Windows PyTorch.

Release Notes: https://t.co/7LMXQYlaAd
Blog:https://t.co/0cwKG82iOB

[Lavanya @lavanyaai]

See how ML teams, like @LatentSpaceAI, working on cutting edge deep learning research use W&B Reports to collaborate remotely, debug models iteratively and to showcase results as mini research papers.

#machinelearning #deeplearning #100daysofmlcode
https://t.co/OkAbp5MEwz

[Darryl Barnhart @DarrylBarnhart]

@ProgrammerLin I've done something similar but with sparse textures and lods as well. Let's you do 65k render distance with similar performance numbers. But pretty complicated to implement! Your materials are way nicer too.

[Ross Wightman @wightmanr]

Promising improvements coming in cuDNN v8. Excited to see how they pan out, especially with #PyTorch.

[Darryl Barnhart @DarrylBarnhart]

@wightmanr We're using your repo to do finetuning with some of these models. Noticed that using the Adam optimizer instead of SGD+Momentum (default) yields a much higher test accuracy on our datasets (e.g. 95% vs 89%). Is this expected?

[Darryl Barnhart @DarrylBarnhart]

@wightmanr Hey Ross, do you have more complete training hyperparameters somewhere? e.g. for the skresnext family https://t.co/RoxzjQPKjk

[Darryl Barnhart @DarrylBarnhart]

@wightmanr Awesome! Thanks!

[Darryl Barnhart @DarrylBarnhart]

@holdenkarau Congrats!

[Latent Space @LatentSpaceAI]

We're at #NeurIPS2019 — Come chat with us about scaling generative models for real-time, applied ML use cases (hint: a game! 👾👾👾)

Reach out to @latentcodes and @iantbd who will be onsite!

[Towards Data Science @TDataScience]

ML Best Practices: Test Driven Development at Latent Space. https://t.co/GcYsBaNMid 🖊by @wandb #DataScience #MachineLearning #TDSPick 🚀

[William Chyr @WilliamChyr]

After 7 years, Manifold Garden has finally launched! It is available now on @AppleArcade & @EpicGames.

Trailer: https://t.co/b5kzDk2aGO

Apple Arcade (iOS, tvOS, macOS) - https://t.co/SsQmNMTmfV

Epic Games Store (Windows) - https://t.co/J324hWiQSV

Thank you for your support.

[William Falcon ⚡️ @williamfalcon]

Haven’t made the switch to @PyTorchLightnin yet? check out @LatentSpaceAI’s reason for switching.

Latent space is building the first fully AI-rendered 3D game engine.

https://t.co/o9DlA25mZ0

@iantbd @PyTorch #NeurIPS2019 #ICLR2020 #icml #cvpr #AAAI2020

[Dario Seyb @daseyb]

Our #siggraphasia paper "Non-linear sphere tracing for rendering deformed signed distance fields" is online now!

Sphere trace deformed SDFs without inverting your deformation function!

https://t.co/yF7V9lmg2C

@wkjarosz @_AlecJacobson @DerekRenderling