Page 1 of 1
A little help with my workflow.
Posted: Thu Jul 20, 2017 2:09 pm
by rdubo
Hello guys.
It's good to be back again. Well, I was wondering if someone can help me in this new adventure. From a single MXF OP1A XDCAM-HD 35Mbits file, I need to create 2 Transport Streams (SD + HD separately) and deliver that package in a folder with both files using FTP. With the TS files, I have no problems using 2 command executors, but here's the issue: The workflow.
MXF enters to the watch folder -> A new folder must be created locally with the "filename"_package name -> 2 command exe's creates both TS files at the same time -> put both files on the previously created "filename"_package local folder -> send that "filename"_package folder with both TS files inside using FTP to a NAS.
Seems simple, but I just can't accomplish what I need. Maybe I'm reaching the wrong road with this. Can someone help me please ?.
Again, thank you guys for everything you have done with this platform.
Big hugs !!!.
R.A.D.V.
Re: A little help with my workflow.
Posted: Tue Jul 25, 2017 9:02 pm
by admin
Hi rdubo,
It's easier if you can give some insight on WHERE it goes wrong. Is it the encoding, the FTP delivery? Also, if you can export the workflow and post it it's easier to investigate.
-steinar
Re: A little help with my workflow.
Posted: Tue Jul 25, 2017 11:11 pm
by rdubo
Hello Steinar.
Hope you'll be fine and thank you 4 yr quick answer. Well, I kinda solved my problem in some way, but I know that is not the way I wanted. The main issue was to deliver both TS files to a NAS in a certian folder and this time I ended up putting a 2nd instance for a Watch Folder node and then a FTP delivery to the NAS. It's working, but also ends with multiple entries in the outcome log and I'm afraid that this can be a little confusing for the users of the system. My issue now is to see if there's a way to develop this workflow in a more sophisticated way in order to accomplish the tasks. One workflow, one log entry.
The workflow:
[General]
Watcher="VOD"
Folder=""
Watcher_ID=20170627211333
description=VOD Transforming and backup
Sleep=30
Default folder=1
Priority=2 (normal)
Last_mod_by=Administrator@CODEXMOVER
Abberation=4
[Variable]
wf_size=69.0392044053588
Start_proc=mon_folder 20170627-211344-311-0A402C6E5F4A|cmd_run 20170707-101950-188-792C0D3C05A2|cmd_run 20170717-081722-168-0054CA96B40B|mon_folder 20170720-145309-388-8212880EEE4A
[Maintainance]
Delete_cachefile=1
keep_all_workdir=4
keep_failed_workdir=4
Cleanup=04:00
.flist_age=5
Run=2345671
[Special]
File_debug=1
Debug_file=C:\FFAStrans0.8.0.3\Processors\.cache\wfs\20170627211333\logs
force_32bit=4
Abberation=4
Protected=1
Password=0xD5686596B3577A1E062F
read_timecode=4
[mon_folder 20170627-211344-311-0A402C6E5F4A]
execute_on=3800889
Folder=D:\Input
Accept_Types=*.m2t; *.mxf; *.mpg, *.mp4; *.mts; *.avi; *.mov; *.qt; *.doc
Deny_Types=*.exe; *.lck
Deny_Paths=
ATTRIB_READ=4
ATTRIB_ARCH=4
ATTRIB_SYS=4
ATTRIB_HIDDEN=4
Recurse=4
Localize=4
Create_Folder=4
growing_files=4
DirSize=0
FileLimit=None
proc_x=113.600352724338
proc_y=247.643769268304
Outbound=cmd_run 20170719-131322-282-41D4E2F82946|dest_ftp 20170719-122601-080-CF86DED2968E|op_hold 20170720-152539-111-723DAB1B9BCF
custom_node_name=Watchman 1
description=Supervisor 1
[cmd_run 20170627-211457-880-C1E1F01EFE7E]
execute_on=3800889
proc_x=320.685271165973
proc_y=306.440322312276
Outbound=cmd_run 20170628-152530-009-24061EB11726
Command=%comspec% /c "C:\FFAStrans0.8.1\Processors\ffmpeg\x64\ffmpeg -y -vsync 0 -i "%s_source%" -vf yadif -s hd1080 -sws_flags bilinear -sws_dither auto -c:v h264 -x264opts opencl -x264-params "nal-hrd=cbr:force-cfr=1" -pix_fmt yuv420p -flags +cgop -vb 7070k -minrate 7070k -maxrate 7070k -bufsize 1768k -profile:v main -level:v 4.0 -threads 0 -trellis 2 -acodec ac3_fixed -ab 192k -ar 48k -ac 2 -f mpegts -muxrate 7500k "D:\Output\%s_original_name%_package\%s_original_name%_vod_hd.ts""
Out_source=%s_source%
omit_exit_code=4
Console=4
custom_node_name=Transformer HD
description=h264 / ac3 / HD1080 / Transport Stream / New local media delivery
enabled=68
[cmd_run 20170628-152530-009-24061EB11726]
execute_on=3800889
Command=%comspec% /c "move /y "%original_full%" "D:\Original""
Out_source=%s_source%
omit_exit_code=4
Console=4
proc_x=424.443894184747
proc_y=306.440322312276
Outbound=
custom_node_name=Move
description=Original media in local storage
[CODEXMOVER]
Work folder=D:\.ffastrans_work_root\20170627211333
[farming]
list=
include=1
[cmd_run 20170707-101950-188-792C0D3C05A2]
execute_on=3800889
proc_x=320.685271165973
proc_y=362.642909780778
Outbound=
custom_node_name=Transformer SD
description=mpeg2 / ac3 / Center crop NTSC / Transport Stream / New local media delivery
Command=%comspec% /c "C:\FFAStrans0.8.1Processors\ffmpeg\x64\ffmpeg -y -vsync 0 -i "%s_source%" -vf yadif2 -sws_flags bilinear -sws_dither auto -c:v mpeg2video -pix_fmt yuv420p -flags -cgop -vb 3060k -minrate 3060k -maxrate 3060k -vf "scale=480*16/9:480, crop=640:480" -trellis 2 -acodec ac3_fixed -ab 192k -ar 48k -ac 2 -f mpegts -muxrate 3750k "D:\Output\%s_original_name%_package\%s_original_name%_vod_sd.ts""
Out_source=
omit_exit_code=4
Console=4
[cmd_run 20170717-081722-168-0054CA96B40B]
execute_on=3800889
Command=%comspec% /c "C:\FFAStrans0.8.1\Processors\ffmpeg\x64\ffmpeg -y -vsync 0 -i "%s_source%" -vf yadif -sws_flags bilinear -sws_dither auto -c:v h264 -x264opts opencl -x264-params "nal-hrd=cbr:force-cfr=1" -pix_fmt yuv420p -flags +cgop -vb 1220k -minrate 1220k -maxrate 1220k -bufsize 305k -profile:v main -level:v 4.0 -threads 0 -vf "scale=480*16/9:480, crop=640:480" -trellis 2 -acodec ac3_fixed -ab 192k -ar 48k -ac 2 -f mpegts -muxrate 1875k "D:\Output\%s_original_name%_package\%s_original_name%_vod_sd.ts""
Out_source=%s_source%
omit_exit_code=4
Console=4
description=h264 / ac3 / Center Crop NTSC / Transport Stream / New local media delivery
custom_node_name=Transformer SD
proc_x=320.685271165973
proc_y=421.43946282475
Outbound=
[dest_ftp 20170719-122601-080-CF86DED2968E]
execute_on=3800889
coding=4
Server=archivenas
Port=780
Username=mxfmover
Password=MXFmov2017.
Path=/MXF_Files
Suffix=
Prefix=
Overwrite=1
Unique=1
Case=lower
Drop_name=4
Drop_ext=4
passive=1
custom_node_name=FTP Copy 1
description=Copy original media from local storage -> NAS
proc_x=320.685271165973
proc_y=247.643769268304
Outbound=
[cmd_run 20170719-131322-282-41D4E2F82946]
execute_on=3800889
Command=%comspec% /c "mkdir "D:\Output\%s_original_name%_package""
Out_source=%s_source%
omit_exit_code=4
Console=4
proc_x=320.685271165973
proc_y=191.008854203891
Outbound=
custom_node_name=Create delivery folder
description=Local storage / Package folder
enabled=68
[dest_ftp 20170720-144732-755-8BE89E1426E1]
execute_on=3800889
Server=archivenas
Port=780
Username=tsmover
Password=TSmov2017.
Path=/TS_Files/%original_path~1%
Suffix=
Prefix=
Overwrite=1
Unique=1
Case=lower
Drop_name=4
Drop_ext=4
passive=1
proc_x=527.770189607609
proc_y=362.642909780778
Outbound=
custom_node_name=FTP Copy 2
description=Copy resulting media from local storage -> NAS
[mon_folder 20170720-145309-388-8212880EEE4A]
execute_on=3800889
Folder=D:\Output\
Accept_Types=*.ts; *.png
Deny_Types=*.cmd; *.lck; *.exe
Deny_Paths=
ATTRIB_READ=4
ATTRIB_ARCH=4
ATTRIB_SYS=4
ATTRIB_HIDDEN=4
Recurse=1
Localize=4
Create_Folder=4
growing_files=1
DirSize=0
FileLimit=None
proc_x=424.443894184747
proc_y=362.642909780778
Outbound=dest_ftp 20170720-144732-755-8BE89E1426E1
custom_node_name=Watchman 2
description=Supervisor 2
[op_hold 20170720-152539-111-723DAB1B9BCF]
execute_on=3800889
syncronize=4
sync_time=3600
sleep=1
sleep_time=5
file_wait=4
files_list=
proc_x=217.358975743111
proc_y=306.440322312276
Outbound=cmd_run 20170627-211457-880-C1E1F01EFE7E|cmd_run 20170720-170724-213-6FFDA56A46D4|cmd_run 20170724-131842-169-947526F63806
custom_node_name=Hold
description=The 5 second delay
[cmd_run 20170720-170724-213-6FFDA56A46D4]
execute_on=3800889
custom_node_name=Photographer
description=One PNG shot at mark 300 secons
Command=%comspec% /c "C:\FFAStrans0.8.1\Processors\ffmpeg\x64\ffmpeg -y -vsync 0 -ss 00:02:30 -t 1 -i "%s_source%" -vf "scale=480*16/9:480, crop=640:480" -f mjpeg "D:\Output\%s_original_name%_package\%s_original_name%_vod_poster.png""
Out_source=%s_source%
omit_exit_code=4
Console=4
proc_x=320.685271165973
proc_y=535.573948145401
Outbound=
[cmd_run 20170724-131842-169-947526F63806]
execute_on=3800889
custom_node_name=Transformer SD
description=h264 / ac3 / Anamorphic NTSC / Transport Stream / New local media delivery
Command=%comspec% /c "C:\FFAStrans0.8.1\Processors\ffmpeg\x64\ffmpeg -y -vsync 0 -i "%s_source%" -vf yadif -sws_flags bilinear -sws_dither auto -c:v h264 -x264opts opencl -x264-params "nal-hrd=cbr:force-cfr=1" -pix_fmt yuv420p -flags +cgop -vb 1220k -minrate 1220k -maxrate 1220k -bufsize 305k -profile:v main -level:v 4.0 -threads 0 -vf "scale=704:480" -trellis 2 -acodec ac3_fixed -ab 192k -ar 48k -ac 2 -f mpegts -muxrate 1875k "D:\Output\%s_original_name%_package\%s_original_name%_vod_sd.ts""
Out_source=%s_source%
omit_exit_code=4
Console=4
proc_x=320.685271165973
proc_y=478.074377889164
Outbound=
Wow, that is endless like some Nick Cave lyrics. Hope you can give a hand in order to polish this tool.
Agian, thank you very much sir.
Big hugs.
rdubo.
Re: A little help with my workflow.
Posted: Wed Jul 26, 2017 10:48 am
by admin
Normally when you fork a workflow (creating multiple paths) you get multiple outcomes. The reason is that you actually create several jobs from one job that may have different outcomes. Anyway, I've looked at your workflow and modified it a bit. I THINK this is what you want. If not, I hope it helps in some way.
PS: Just unpack the VOD_copy.7z and import it into FFAStrans.
PS2: I have not tested the modified workflow.
-steinar
Re: A little help with my workflow.
Posted: Wed Jul 26, 2017 4:10 pm
by rdubo
Thank you very much Steinar for all of your help. I will test it today and you will know about the results.
More hugs !!!.
rdubo.
Re: A little help with my workflow.
Posted: Fri Jul 28, 2017 2:30 pm
by rdubo
Hello Steinar. The mods didn't work at first but they help me a lot to improve my understanding of the concepts behind this tool and that's awesome. Thank you very much. I'm working into an idea of an script in order to move the output files (A couple of transport streams and a thumbnail) at the end of the process. That's the only thing by far. I'll let you know.
Have a nice weekend.
rdubo.