Went down a rabbithole of looking at what MLPerf Storage Training benchmarks do; turns out they're not very meaningful IMO. Alarming how many practitioners (mostly storage vendors) run them and don't understand what the results do/don't represent.
Went down a rabbithole of looking at what MLPerf Storage Training benchmarks do; turns out they're not very meaningful IMO. Alarming how many practitioners (mostly storage vendors) run them and don't understand what the results do/don't represent.