Lausunnot
-
On compute economics: in a year the inference cost of the best models fell by an order of magnitude.
«In the past year, the inference cost of the best models has dropped by an order of magnitude.»
-
On choosing MoE for compute efficiency: a dense model couldn't produce this many tokens daily.
«With a dense model, we couldn't produce this many tokens every day.»