Yeah, video streaming can’t really be run on donations like Lemmy, that’s true.
I think the presentation discusses it, but basically, if you have 20+ ssds in your server, trying to read them all and process the file system will mean you’re copying around too much data at once in your ram. A 1gb file might require like 5-10gb of data traffic in ram while the CPU is processing it due to copies and checks, etc. Ram can’t handle the resulting 10tbps of ram bandwidth needed. The optimization that Netflix is doing is to use pcie to send files directly over the pcie bus from the ssd to the network cards, skipping the cpu and ram altogether.
Yeah, video streaming can’t really be run on donations like Lemmy, that’s true.
I think the presentation discusses it, but basically, if you have 20+ ssds in your server, trying to read them all and process the file system will mean you’re copying around too much data at once in your ram. A 1gb file might require like 5-10gb of data traffic in ram while the CPU is processing it due to copies and checks, etc. Ram can’t handle the resulting 10tbps of ram bandwidth needed. The optimization that Netflix is doing is to use pcie to send files directly over the pcie bus from the ssd to the network cards, skipping the cpu and ram altogether.