@marchoeffl yup. maybe i should talk about this more but content deduping allows us to drastically cut down the total reads to s3 from a node. plus it’s much faster
same idea for TRIM.
a guess trim records two things (a) the hole in the disks own logs which the guest ack waits on and liveliness note in the host's gc logs.
space accounting should never sit in the write path.
the 'fun' part of content addressing is that dead names can come back, i.e. a new write can hash to an object you were about to delete.
so anything that reuses a key resets the time to retirement.
really fun blogpost from the Halluminate research team: https://t.co/n4DPOwtrJB
we had frontier open and closed source models choose between yes or no on all the California state propositions from last week's election
the results will surprise you 👀
great work team