The quoted numbers are the interesting part. 380 GB just for weights plus several GB of context per user means this only pays off at Revolut’s scale. What stood out to me is that the article credits the biggest gains to NVFP4 quantization, splitting prefill and decode, and context tuning rather than adding GPUs. Those tricks carry over to much smaller setups too.
The quoted numbers are the interesting part. 380 GB just for weights plus several GB of context per user means this only pays off at Revolut’s scale. What stood out to me is that the article credits the biggest gains to NVFP4 quantization, splitting prefill and decode, and context tuning rather than adding GPUs. Those tricks carry over to much smaller setups too.