홍정훈 Chung Hoon Hong

applied scientist @alexa99,⚡️ @reboot_hq | prev @Umich #AlexaPrize

[홍정훈 Chung Hoon Hong @hoony]

@DandanShan_ @Meta congrats!!!

[홍정훈 Chung Hoon Hong @hoony]

Really cool. nvidia based open model coalition

Nvidia offers DGX Cloud to AI foundation model labs for new Nemotron Coalition - DCD https://t.co/NX9VC5YBqD

[홍정훈 Chung Hoon Hong @hoony]

@mbodhisattwa Hi Bodhi, is this available only through the UI?

[홍정훈 Chung Hoon Hong @hoony]

@natolambert thank you !! It is really difficult to use nvidia dgx spark without docker

[홍정훈 Chung Hoon Hong @hoony]

@eqhylxx @vllm_project @nvidia Hi @eqhylxx thank you for sharing, is the nvidia vLLM tutorial sufficient to rerun your experiments on dgx spark? I was going to try this on mine. thank you.

[홍정훈 Chung Hoon Hong @hoony]

I was able to try @yutori_ai as a beta user. collecting latest financial trends to gathering neurips after events from an online agent. I suggest folks to try!

[Yutori @yutori_ai]

https://t.co/I1lJ5E0nIl

[홍정훈 Chung Hoon Hong @hoony]

@DavidSHolz hi 👋

[홍정훈 Chung Hoon Hong @hoony]

Waymo scientists found scaling laws in autonomous driving! https://t.co/I9AR0TriQx

[홍정훈 Chung Hoon Hong @hoony]

https://t.co/Jj8CL81u27

[홍정훈 Chung Hoon Hong @hoony]

Interesting take on q-learning - on-poliy RL algorithms. thank you for simplifying the research into a narrative @seohong_park

[홍정훈 Chung Hoon Hong @hoony]

@sm_park 축하드립니다 :)

[박상민 / Sang-Min Park @sm_park]

https://t.co/uxVefx35RG
Drone 으로 찍어서 3D Gaussian Splat 으로 렌더링.

[홍정훈 Chung Hoon Hong @hoony]

@sm_park 구글맵이나 애플맵과 비교했을 때 NERF로 렌더링한 것이 큰 차이를 보이네요. 거기에 사운드까지 더해지니 더욱 웅장해 보입니다

[Peng Qi @qi2peng2]

A few months ago, I started a series of blog posts to explain what it is like to work as a researcher in the industry in the hope of documenting some useful information for those facing this potential transition (especially junior folks). Today, I've published the last part

🧵

[Abigail See @abigail_e_see]

Last week our paper on SynthID-text, a method from @GoogleDeepMind for watermarking LLM-generated text, was published in @Nature. 🧵

https://t.co/5IUKXkPjs7

[jasmine sun @jasminewsun]

AI companies are constructing private highways on public land—commercializing closed products built on public data, public resources, open research, and the open web.

We can’t rely on companies to build everything we need from AI, and we can’t afford the risk that they won’t.

[Andrew Ng @AndrewYNg]

New short course on Pretraining LLMs! Developed with @UpstageAI and taught by their CEO @hunkims and CSO @echojuliett.

While prompting or fine-tuning existing models works well for many general language tasks, pretraining is valuable for specialized domains or languages with limited representation in current models.

This course walks you through the LLM pretraining pipeline:
1. Data preparation: Learn to source, clean, and prepare training data using HuggingFace.
2. Model architecture: Configure transformer networks, including modifying existing models.
3. Training: Set up and run training using open-source libraries.
4. Evaluation: Benchmark performance using popular evaluation strategies.

As an example use case, you'll also compare the output of a base model with its fine-tuned and further pretrained variants, to see the impact of pretraining on a model's ability to write Python.

The course also explores an innovative technique called depth up-scaling, which Upstage used to train their Solar model family, reducing pretraining compute costs by up to 70%. This technique works by first duplicating layers of a smaller pretrained model to form a larger model, and then further pretraining the result.

Sign up here! https://t.co/IjYmNPR7sd

[Peng Qi @qi2peng2]

Just published the second part of my blog post to reflect on my journey as an early-career industry researcher, where I talk about how I would approach choosing a team today and what I'd factor into my consideration.
Post: https://t.co/SCGeYkV1D9

[홍정훈 Chung Hoon Hong @hoony]

@jiaxin_pei @david__jurgens @MishaTeplitskiy Congrats Jiaxin!

[홍정훈 Chung Hoon Hong @hoony]

@michigan_AI @nikola_banovic @nikola_banovic congratulations !!