Network speed question
Posted: Tue Aug 02, 2016 7:55 pm
Long time lurker, first time poster. First of all, thank you for making this program! It has been a real life saver for me. I've been using it for a couple years now and have gotten excellent results with it. This forum has helped me with a lot of the growing pains in the beginning.
My question concerns my new setup of a bunch of old editing machines that I've converted into a transcode farm. I have 3 of them as nodes, all networked together through a 5 port home unmanaged gigabit switch (pretty low quality, I admit). Due to the network set up we have there is a managed fibre switch running the editing system and a decent unmanaged gigabit switch connected to a few other systems. I have a NAS straddling both networks so both groups (designers and editors) can see the same shared storage. FFAStrans is not running off that shared storage, only off the 3 nodes with a shared striped pair of drives in one. I have another program, DropIt, grabbing files from the NAS and moving them to the transcode main node and then grabbing the finished files and moving them back to the NAS.
The issue is that when I had each node set to process up to 5 files at once the processing speed/fps of each file was nearly nothing, maybe 2 fps. When it was running on a single computer we could get about 3 jobs going at once at more or less equivalent fps to the file, so for our purposes around 30fps. After I had the system doing a few files at once we were doing okay, we lost a bit of individual transcode speed but were able to transcode 3-4 files at once instead of waiting. Once I put it in a stress situation ~20 files, XDCAM 50 mxf transcoding to a broadcast MPEG-TS (custom ffmpeg) all nodes dropped to that terrible processing speed I mentioned, with almost no CPU use. About 20% of the files didn't fail in transcode but produced an AVS file instead of the expected mpeg.
This is, other than the new set up, a tried and true workflow.
Once I changed each node from 5 jobs to 1 there was a significant increase in speed across the board, but still not what it was before, around 20fps.
Is this because of my not great network set up? I know each individual machine can handle what I was throwing at it. The shared drive is a striped pair of drives, lots of speed. I don't have the budget for transceivers to partake of the very nice fibre switch, but perhaps I can cut that low quality switch out of the equation. I had thought that any information the 3 nodes need to share would be shared within their little environment and not out into the larger system due to the location of the main node, but I must be wrong about that.
Sorry for the wall of text, any suggestions you have would be great.
My question concerns my new setup of a bunch of old editing machines that I've converted into a transcode farm. I have 3 of them as nodes, all networked together through a 5 port home unmanaged gigabit switch (pretty low quality, I admit). Due to the network set up we have there is a managed fibre switch running the editing system and a decent unmanaged gigabit switch connected to a few other systems. I have a NAS straddling both networks so both groups (designers and editors) can see the same shared storage. FFAStrans is not running off that shared storage, only off the 3 nodes with a shared striped pair of drives in one. I have another program, DropIt, grabbing files from the NAS and moving them to the transcode main node and then grabbing the finished files and moving them back to the NAS.
The issue is that when I had each node set to process up to 5 files at once the processing speed/fps of each file was nearly nothing, maybe 2 fps. When it was running on a single computer we could get about 3 jobs going at once at more or less equivalent fps to the file, so for our purposes around 30fps. After I had the system doing a few files at once we were doing okay, we lost a bit of individual transcode speed but were able to transcode 3-4 files at once instead of waiting. Once I put it in a stress situation ~20 files, XDCAM 50 mxf transcoding to a broadcast MPEG-TS (custom ffmpeg) all nodes dropped to that terrible processing speed I mentioned, with almost no CPU use. About 20% of the files didn't fail in transcode but produced an AVS file instead of the expected mpeg.
This is, other than the new set up, a tried and true workflow.
Once I changed each node from 5 jobs to 1 there was a significant increase in speed across the board, but still not what it was before, around 20fps.
Is this because of my not great network set up? I know each individual machine can handle what I was throwing at it. The shared drive is a striped pair of drives, lots of speed. I don't have the budget for transceivers to partake of the very nice fibre switch, but perhaps I can cut that low quality switch out of the equation. I had thought that any information the 3 nodes need to share would be shared within their little environment and not out into the larger system due to the location of the main node, but I must be wrong about that.
Sorry for the wall of text, any suggestions you have would be great.
