Page 1 of 2
Folder monitor fails to pickup a file
Posted: Thu Sep 01, 2016 11:00 pm
by dougatbuck
HI! first thankyou for this amazing tool! already having alot of fun. I looked thru the forum to see if i could find this issue but i didn't see anything...
The issue i'm having is that i've made a simple folder Monitor --> mp4 --> folder delivery. The folder being watched has 3 mov files:
Code: Select all
Oreo_Swing_Edit_v001.mov
Oreo_Swing_Edit_v002.mov
oreo_swing_3d_animatic_v001_BH.mov
No matter what i do, Oreo_Swing_edit_v002.mov will not be picked up. if i look in the folder, "Processors\.cache\wfs\20160901130448\mons\20160901-131141-526-43A156ED4703", I can see the .txt files for the two that were correctly transcoded, and then a subfolder "i" that has a .txt file for the one thats not being picked up. No matter what i do i cant seem to get the folder monitor to pick up all 3 files. The contents of the .txt file in the "i" folder ends with retries=61 and that seems to be climbing...
if i manually submit the file to the workflow its processed without any trouble. Not sure what this could be. any thoughts?
thankyou kindly,
doug
Re: Folder monitor fails to pickup a file
Posted: Fri Sep 02, 2016 2:36 am
by dougatbuck
the mov file in question was open by artists using quicktime player....
once they all closed out then the folder monitor picked up the file. if its possible to work around this issue within FFAStrans somehow that would be very very helpful.
Re: Folder monitor fails to pickup a file
Posted: Fri Sep 02, 2016 8:57 pm
by admin
Hi doug, thank you for using FFAStrans and welcome to the forum!
I have tried to recreate the issue by opening a QuickTime file using both PC and Mac, and with different kinds of network share. You might have a different network setup than I have available cause the monitor picks up the file no matter what. The monitor tries to figure out if the file is available for reading but maybe the method used to check this is too strict. I will have a close look at it but it's a bit difficult when I'm not able to recreate the issue.
-steinar
Re: Folder monitor fails to pickup a file
Posted: Wed Sep 07, 2016 10:51 pm
by dougatbuck
hi!
we are using windows server 2012 R2
the machines are windows 7
and the users are viewing with quicklime 7 pro.
i'd love to help out solving this any way possible. just let me know
Re: Folder monitor fails to pickup a file
Posted: Thu Sep 08, 2016 9:20 pm
by admin
The main reason for this issue is because I want to make sure FFAStrans does not pick up files that are being written. If it does, it might cause an incomplete transcoding, and we don't want that. But as I wrote, the method might be to strict and I want to find out what's actually going on. But because I'm not able to recreate the issue myself, I will send you a private patch that logs this particular issue. This will have no impact on your day-to-day transcoding but you will need to recreate the issue and send me log-files. I'll be back at you when I have the patch ready.
-steinar
Re: Folder monitor fails to pickup a file
Posted: Thu Sep 22, 2016 10:07 am
by kibi
May I have the same debug version for the same reason?
Sometimes new files are not picked up, and it's necessary to manually clear history, to fix it.
Re: Folder monitor fails to pickup a file
Posted: Thu Sep 22, 2016 11:56 am
by admin
Just to be clear; some files are not picked up BEACUSE they are open in another program like QuickTime? Or are they not picked up at all even though the files are free? If it's the latter, then I have found a new bug that has been addressed in the upcoming 0.7.7 version. It sometimes caused FFAStrans to stop picking up files, and in some cases it simply would not start properly. Now, I'm not sure if this particular bug is what you have but I hope it's related.
There has been a lot of changes in 0.7.5 and 0.7.6 to how FFAStrans detects and picks up new files, so some issues was sort of expected. But the next release seem pretty reliable at this point.
-steinar
Re: Folder monitor fails to pickup a file
Posted: Fri Sep 23, 2016 10:05 am
by kibi
At my site the files are not opened by any programs. The files are moved to the input directory very fast (AVS scripts are very light weght video files) and they shouldn't be blocked at any time. I have wrote batch script - a workaround for clearing FFASTrans directory:
Code: Select all
echo ************** Clear jobs directory...
del F:\FFASTrans\Processors\.cache\monitor\jobs\*.ini 1>nul 2>nul
echo ************** Clear work media cache directory...
rmdir F:\FFASTrans\.work_media_cache /q /s
mkdir F:\FFASTrans\.work_media_cache
echo ************** Clear tickets directory...
del F:\FFASTrans\Processors\.cache\tickets\*.ini 1>nul 2>nul
echo ************** Clear workflow status directory...
rmdir F:\FFASTrans\Processors\.cache\wfs /q /s
mkdir F:\FFASTrans\Processors\.cache\wfs
The batch should be executed when there are no jobs under processing.
Disk F is not a local drive - it's mapped network drive. I suppose, sometimes it can be unavailable for a moment. And it could lead to mismatch in tickets/workflows ini files, for example orphan links.
Re: Folder monitor fails to pickup a file
Posted: Fri Sep 23, 2016 10:33 am
by admin
Is this script manually executed? Also, does it help resolving your issue?
-steinar
Re: Folder monitor fails to pickup a file
Posted: Tue Nov 29, 2016 6:17 pm
by KalenXII
I appear to be having the same issue with one of my folder monitors. It will work fine for 2 weeks then just stop picking up new files. It does detect the files as it creates a new .txt file for them in the C:\FFAStrans0.7.7_Win32\Processors\.cache\wfs\20160929172310\mons\20161129-131247-461-1F205F02F1C0\i folder but it never starts the workflow running on the file. Currently running 0.7.7 and had the same issue in 0.7.6.