Stanford Research Computing

Advancing science, one batch job at a time

[Stanford Research Computing @StanfordCompute]

Stanford Research Computing is now on BlueSky!
https://t.co/kpsovO71yF

[Stanford Research Computing @StanfordCompute]

The wait is over: Sherlock 4.0, the latest generation of the #Stanford #HPC cluster is finally here!
https://t.co/xoVLcVuT6c

[Stanford Research Computing @StanfordCompute]

Sherlock is moving from TB to TiB, so everybody can enjoy more #storage. For free!
https://t.co/8BuXxntnmc

[Stanford Research Computing @StanfordCompute]

A little teaser: Sherlock 4.0, the next generation of the Sherlock #HPC cluster, is coming next week!
https://t.co/gGQdalqbfG

[Stéphane Thiell @s_thiell]

Our @StanfordCompute branch of robinhood-lustre-3.1.7 on Rocky Linux 9.3 with our own branch of Lustre 2.15.4 and MariaDB 10.11 can ingest more than 35K Lustre changelogs/sec. Those gauges seem appropriate for Pi Day, no?
https://t.co/DewirkKhml
https://t.co/PPHsPJPFam

[Stanford Research Computing @StanfordCompute]

We are hiring! Stanford Research Computing is recruiting a #GPU cluster sysadmin, for an incoming @nvidia #DGX SuperPOD.
If you're interested in operating large-scale GPU systems to support the amazing @Stanford research community, feel free to apply at
https://t.co/zR1KmJ5bjX

[Stanford Research Computing @StanfordCompute]

@baym @gsherloc We definitely can't claim anteriority here!
But we're happy to count Prof. Sherlock and his team as Sherlock users. 😁

[Stanford Research Computing @StanfordCompute]

#Sherlock goes full flash!
The cluster scratch file system has been revamped to provide 10 PB of fast flash storage on #Lustre
https://t.co/oXVWoRsZRP
#HPC #Stanford

[Stanford Research Computing @StanfordCompute]

@XYHan_ @s_thiell Dual-port NVMe drives are still quite rare, and chassis that support them even more so, while SAS provides reliable and proven dual-path redundancy which is essential for high-availability systems.

[Stanford Research Computing @StanfordCompute]

@b4mb0u @s_thiell 2.15.almost4 😁

[Stanford Research Computing @StanfordCompute]

@XYHan_ @s_thiell The massive performance bump comes from replacing 6 PB of rotating HDDs with 768 SAS SSDs.

[Stéphane Thiell @s_thiell]

Filesystem upgrade complete! @StanfordCompute cares about HPC I/O! The Sherlock cluster has now ~10PB of full flash Lustre scratch storage at 400 GB/s, to support a wide range of research jobs on large datasets! Fully built in-house!

[HPC Guru @HPC_Guru]

@intel .@intel Lifetime achievement award in 2023 goes to @Stanford's Dr. Fei-Fei Li (@drfeifei)

End of Pat's Keynote

#AI #HPC #IntelInnovation

[Ruth Marinshaw @rmarinshaw]

Final day of the annual HPC Leadership Institute. Group exercises led to fun results, including this gem (yes, there are lots of squirrels at Stanford; yes, it IS sunny). Led by @hpcnotes & @ItsHarveyTime

Microsoft + MITRE + @TACC + @hpcnotes + @StanfordCompute

#HPC

[Andrew Jones @hpcnotes]

Nice walk across Stanford campus yesterday evening

[Andrew Jones @hpcnotes]

Nearly at lunchtime on day 1 of the annual HPC Leadership Training Institute

https://t.co/FXIWYnzgRO

Brought to you by Microsoft + MITRE + @TACC + @StanfordRCC

Led by co-tutors @ItsHarveyTime & @hpcnotes

#HPC

[Stanford Research Computing @StanfordCompute]

@s_thiell @SThiell More details in this presentation from LAD'22 https://t.co/GcySDuCRXN
@HPC_Guru @lustre_one

[Stanford Research Computing @StanfordCompute]

@s_thiell And hardware is not even the best part!
Thanks to the flexibility of #Lustre (and @sthiell's mad skillz😎), we've started replacing spinning disks with SAS SSDs... while the system is running! No downtime, no data to transfer, just a faster #HPC #filesystem for our users.

[Stéphane Thiell @s_thiell]

Today we reached a total of 4.9 PB of flash storage at 200 GB/s for @StanfordCompute’s Sherlock to support a wide range of research workloads. Lustre 2.15. #HPC #AI