YOUTUBE

Questions and answers on how to get the most out of FFAStrans
backlight
Posts: 44
Joined: Wed Dec 12, 2018 8:33 am

YOUTUBE

Post by backlight »

Hi guys,
adding more workflows i'm trying to configure the YT Decoder....
I don't knwo what i'm doing wrong...
now is...
whatchfolder --> YT Decoder (config file + account information) --> X264 Encoder --> folder delivery

I "submit" the url (ex: https://youtu.be/nSxzsviTpSc) in the File filed... it gaves me the error (no audio/video) found!

.....

Thank you for all your support and for this incredible GUI!

L
admin
Site Admin
Posts: 1681
Joined: Sat Feb 08, 2014 10:39 pm

Re: YOUTUBE

Post by admin »

Hi backlight,

Could you export and share the workflow?

-steinar
backlight
Posts: 44
Joined: Wed Dec 12, 2018 8:33 am

Re: YOUTUBE

Post by backlight »

Thank you for your support Steinar...
here my WF
Attachments
YOUTUBE_DONWLOAD.xml
(4.38 KiB) Downloaded 597 times
jozxyqk80
Posts: 3
Joined: Tue Jun 11, 2019 6:04 am

Re: YOUTUBE

Post by jozxyqk80 »

Does the machine have an FFAStrans internet connection? It told me the same message if I had to have a proxy set up.
Ideally try downloading directly through the youtube-dl.exe file in the directory (e.g. C:\Program Files\FFAStrans\Processors\ffmpeg) using the bat file: "C:\Program Files\FFAStrans\Processors\ffmpeg\youtube-dl.exe" -f bestvideo+bestaudio filename"
or with proxy
"C:\Program Files\FFAStrans\Processors\ffmpeg\youtube-dl.exe" --proxy "http://IP_adress:port" -f bestvideo+bestaudio filename"



I have another problem and I will not create a new thread for it, it is also useful here:

video source https://www.youtube.com/watch?v=8uYG3dQt-RQ
if i testing in BAT file:
"C:\Program Files\FFAStrans\Processors\ffmpeg\youtube-dl.exe" --proxy "http://myproxy:port" --restrict-filenames -f bestvideo+bestaudio https://www_youtube_com/watch?v=8uYG3dQt-RQ

then output from youtube-dl:
PO_KRADE_I_KABELKY_VLA_EL_PRODAVA_KU_PO_ZEMI-8uYG3dQt-RQ.f135.mp4
PO_KRADE_I_KABELKY_VLA_EL_PRODAVA_KU_PO_ZEMI-8uYG3dQt-RQ.f140.m4a

OR
"C:\Program Files\FFAStrans\Processors\ffmpeg\youtube-dl.exe" --proxy "http://myproxy:port" --merge-output-format mp4 --ffmpeg-location "C:\Program Files\FFAStrans\Processors\ffmpeg\x64\ffmpeg.exe" --restrict-filenames -f bestvideo+bestaudio https://www_youtube_com/watch?v=8uYG3dQt-RQ

then output is: PO_KRADE_I_KABELKY_VLA_EL_PRODAVA_KU_PO_ZEMI-8uYG3dQt-RQ.mp4

if I set the url address to a shortcut (.url) and process it in FFAStrans -> Folder (url file) -> Youtube Decoder (in config file is):

# Restrict filenames to only ASCII characters, and avoid "&" and spaces in filenames
--restrict-filenames

# Use this proxy
--proxy "http://myproxy:port"

output from youtube-dl (Youtube decoder) is file "PO KRÁDEŽI KABELKY VLÁEL PRODAVAKU PO ZEMI.mp4" -> there is a problem with non-standard ASCII characters in the next process (e.g. ě š č ř ž ý á í é ú ů)

the settings in the configuration file do not work --restrict-filename, the output file name is fixed according to --get-title ???
emcodem
Posts: 1754
Joined: Wed Sep 19, 2018 8:11 am

Re: YOUTUBE

Post by emcodem »

Hi jozxyqk80,
welchome to the forum!
It is always good to open an new thread about new problems as your problem might be completely different than the other ones.
I tried to reproduce your issue and initially i got an error message from the Youtube Processor like

Code: Select all

 "token" parameter not in video info for unknown reason;
After updating the youtube-dl.exe (by just jusing youtube-dl.exe -U), i am not able to reproduce any problem, not the one from @backlight and not the one from @jozxyqk80

You can check the and play around with the generated youtube-dl command in a log file named *extract.txt in the work_root directory. Please check the option "keep jobs work folders on completion" in your workflow settings.
A log file name containing the full youtube-dl command on my system for example here:

Code: Select all

C:\.ffastrans_work_root\20190614110502\20190614-122637-191-47DCE164D402\~20190614-122638-806-F61058FDEF52.extract.txt
emcodem, wrapping since 2009 you got the rhyme?
jozxyqk80
Posts: 3
Joined: Tue Jun 11, 2019 6:04 am

Re: YOUTUBE

Post by jozxyqk80 »

Hello,
thank you for answer

This is from the log:

Code: Select all

=PROC=> 2019-06-17 11:05:38.532 on Folder@PC, PID: 14132 -> Ticketfile is "C:\Program Files\FFAStrans\Processors\.cache\tickets\x20190617-110538-161-BA6F7794C77D_20180707181815~loc~PC~20190617-110536-551-6EC54956B90E.ini"
=PROC=> 2019-06-17 11:05:38.535 on Folder@PC, PID: 14132 -> Getting top storage...
=PROC=> 2019-06-17 11:05:38.536 on Folder@PC, PID: 14132 -> Creating work dir: d:\.ffastrans_work_root\20180707181815\20190617-110536-551-6EC54956B90E
=PROC=> 2019-06-17 11:05:38.542 on Folder@PC, PID: 14132 -> Registering abort check...
=PROC=> 2019-06-17 11:05:38.544 on Folder@PC, PID: 14132 -> Executing ini: "mon_folder 20180713-152221-912-f835defc268c"
=PROC=> 2019-06-17 11:05:38.546 on Folder@PC, PID: 14132 -> Executing sys: "mon_folder 20180713-152221-912-f835defc268c"
=PROC=> 2019-06-17 11:05:38.550 on Folder@PC, PID: 14132 -> New file picked up by: "PC"
=PROC=> 2019-06-17 11:05:38.551 on Folder@PC, PID: 14132 -> ProcessorEnd_Routine(mon_folder 20180713-152221-912-f835defc268c)
=PROC=> 2019-06-17 11:05:38.553 on Folder@PC, PID: 14132 -> Ending process...
=PROC=> 2019-06-17 11:05:38.553 on Folder@PC, PID: 14132 -> =================================================================================================================================================================================
=PROC=> 2019-06-17 11:05:39.007 on YouTube@PC, PID: 14880 -> Ticketfile is "C:\Program Files\FFAStrans\Processors\.cache\tickets\x20190617-110538-680-A169B5CE5C4E_20180707181815~loc~POST-TRANSFER-1~20190617-110536-551-6EC54956B90E.ini"
=PROC=> 2019-06-17 11:05:39.007 on YouTube@PC, PID: 14880 -> Source is X:\Users\youtube43.url
=PROC=> 2019-06-17 11:05:39.009 on YouTube@PC, PID: 14880 -> Creating work dir: d:\.ffastrans_work_root\20180707181815\20190617-110536-551-6EC54956B90E
=PROC=> 2019-06-17 11:05:39.010 on YouTube@PC, PID: 14880 -> Registering abort check...
=PROC=> 2019-06-17 11:05:39.012 on YouTube@PC, PID: 14880 -> Executing ini: "dec_youtube 20190610-200913-310-f3dd8b8bc5b0"
=PROC=> 2019-06-17 11:05:39.013 on YouTube@PC, PID: 14880 -> Executing sys: "dec_youtube 20190610-200913-310-f3dd8b8bc5b0"
=PROC=> 2019-06-17 11:06:03.548 on YouTube@PC, PID: 14880 -> ProcessorEnd_Routine(dec_youtube 20190610-200913-310-f3dd8b8bc5b0)
=PROC=> 2019-06-17 11:06:03.550 on YouTube@PC, PID: 14880 -> Ending process...
=PROC=> 2019-06-17 11:06:03.550 on YouTube@PC, PID: 14880 -> =================================================================================================================================================================================
=PROC=> 2019-06-17 11:06:04.105 on Folder@PC, PID: 36 -> Ticketfile is "C:\Program Files\FFAStrans\Processors\.cache\tickets\x20190617-110603-736-D764526B992A_20180707181815~loc~PC~20190617-110536-551-6EC54956B90E.ini"
=PROC=> 2019-06-17 11:06:04.106 on Folder@PC, PID: 36 -> Source is d:\.ffastrans_work_root\20180707181815\20190617-110536-551-6EC54956B90E\yt\8uYG3dQt-RQ.mp4
=PROC=> 2019-06-17 11:06:04.108 on Folder@PC, PID: 36 -> Creating work dir: d:\.ffastrans_work_root\20180707181815\20190617-110536-551-6EC54956B90E
=PROC=> 2019-06-17 11:06:04.109 on Folder@PC, PID: 36 -> Registering abort check...
=PROC=> 2019-06-17 11:06:04.111 on Folder@PC, PID: 36 -> Executing ini: "dest_folder 20190610-192125-719-a3a9e3594dde"
=PROC=> 2019-06-17 11:06:04.113 on Folder@PC, PID: 36 -> Executing sys: "dest_folder 20190610-192125-719-a3a9e3594dde"
=PROC=> 2019-06-17 11:06:04.242 on Folder@PC, PID: 36 -> ProcessorEnd_Routine(dest_folder 20190610-192125-719-a3a9e3594dde)
=PROC=> 2019-06-17 11:06:04.243 on Folder@PC, PID: 36 -> Job completed without errors.
=PROC=> 2019-06-17 11:06:04.244 on Folder@PC, PID: 36 -> _EnumIfNewJob() with current queue:0
=PROC=> 2019-06-17 11:06:04.261 on Folder@PC, PID: 36 -> Ending process...
=PROC=> 2019-06-17 11:06:04.262 on Folder@PC, PID: 36 -> =================================================================================================================================================================================
Youtube-dl download file corectly -> 8uYG3dQt-RQ.mp4, but the file name is "PO KRÁDEŽI KABELKY VLÁEL PRODAVAKU PO ZEMI.mp4" even if I have in config.txt --restrict-filenames and it should be "PO_KRADE_I_KABELKY_VLA_EL_PRODAVA_KU_PO_ZEMI-8uYG3dQt-RQ.mp4"

The problem is with further processing with characters - ě š č ř ž ý á í é ú ů

Youtube-dl is updated at 14.6.2019 11:15
jozxyqk80
Posts: 3
Joined: Tue Jun 11, 2019 6:04 am

Re: YOUTUBE

Post by jozxyqk80 »

in ~20190617-112722-275-91A1480015C7.extract.txt

Code: Select all

C:\Windows\system32\cmd.exe /U /C ""C:\Program Files\FFAStrans\Processors\FFmpeg\youtube-dl.exe"  --config-location "C:\Program Files\FFAStrans\Processors\ffmpeg\config.txt" -s -F -a "d:\.ffastrans_work_root\20180707181815\20190617-112719-872-5B6EF6431F6B\~20190617-112722-275-E5C462FEC4DE.url.txt" >> "d:\.ffastrans_work_root\20180707181815\20190617-112719-872-5B6EF6431F6B\~20190617-112722-275-91A1480015C7.extract.txt" 2>&1"
[youtube] 8uYG3dQt-RQ: Downloading webpage
[youtube] 8uYG3dQt-RQ: Downloading video info webpage
[youtube] 8uYG3dQt-RQ: Downloading MPD manifest
[info] Available formats for 8uYG3dQt-RQ:
format code  extension  resolution note
139          m4a        audio only DASH audio   52k , m4a_dash container, mp4a.40.5@ 48k (22050Hz)
251          webm       audio only DASH audio  130k , webm_dash container, opus @160k (48000Hz)
140          m4a        audio only DASH audio  134k , m4a_dash container, mp4a.40.2@128k (44100Hz)
278          webm       256x140    DASH video   95k , webm_dash container, vp9, 30fps, video only
160          mp4        256x140    DASH video  108k , mp4_dash container, avc1.4d400b, 30fps, video only
242          webm       426x234    DASH video  220k , webm_dash container, vp9, 30fps, video only
133          mp4        426x234    DASH video  242k , mp4_dash container, avc1.4d400c, 30fps, video only
243          webm       640x352    DASH video  405k , webm_dash container, vp9, 30fps, video only
134          mp4        640x352    DASH video  586k , mp4_dash container, avc1.4d401e, 30fps, video only
244          webm       854x470    DASH video  752k , webm_dash container, vp9, 30fps, video only
135          mp4        854x470    DASH video 1160k , mp4_dash container, avc1.4d401f, 30fps, video only
18           mp4        640x352    medium , avc1.42001E, mp4a.40.2@ 96k, 5.68MiB
43           webm       640x360    medium , vp8.0, vorbis@128k, 6.94MiB (best)
in ~20190617-112736-989-2AE0CA89566D.media.txt

Code: Select all

C:\Windows\system32\cmd.exe /U /C ""C:\Program Files\FFAStrans\Processors\FFmpeg\youtube-dl.exe"  --config-location "C:\Program Files\FFAStrans\Processors\ffmpeg\config.txt" -e -a "d:\.ffastrans_work_root\20180707181815\20190617-112719-872-5B6EF6431F6B\~20190617-112722-275-E5C462FEC4DE.url.txt" >> "d:\.ffastrans_work_root\20180707181815\20190617-112719-872-5B6EF6431F6B\~20190617-112736-989-2AE0CA89566D.media.txt" 2>&1"
PO KRÁDEŽI KABELKY VLÁEL PRODAVAKU PO ZEMI
if I pause the download and change it in the media name to PO_KRADE_I_KABELKY_VLA_EL_PRODAVA_KU_PO_ZEMI-8uYG3dQt-RQ (it should create --restrict-filenames) it's alright
emcodem
Posts: 1754
Joined: Wed Sep 19, 2018 8:11 am

Re: YOUTUBE

Post by emcodem »

So i had a deep look now into the internals of ffastrans. --restrict-filenames parameter from your config is applied to youtube-dl, but ffastrans is instructing it to download to a temporary filename. The temporary filename equals the youtube ID therefore it does not contain any special chars, this is why youtube-dl --restrict-filenames function is not doing what you expect it to do.

Internal steps for the youtube-dl processor:
-) parse formats using youtube-dl.exe
-) parse title using youtube-dl.exe, store in a variable (%s_display%)
-) download video using youtube-dl.exe, store to temporary location using temporary filename

So the actual filename is being parsed from the youtube title and applied later on by e.g. a deliver node.
Unfortunately the actual filename is only stored internally in a variable called %s_display%. You can use this variable to calculate your filename without special chars e.g. in a populate variables processor like that:
$alrep("%s_display%","_")
Actually i am more interested in whats your issue with the "special characters", you should not have any issues within ffastrans as far as i can see.
Anyway, @jozxyqk80 i am not very happy that we use this thread for it as the problem is a completely different one than the original was. Please open another thread if you need more infos about coping with special characters.
emcodem, wrapping since 2009 you got the rhyme?
backlight
Posts: 44
Joined: Wed Dec 12, 2018 8:33 am

Re: YOUTUBE

Post by backlight »

Hi guys,
my problem is a little bit easier (I hope).
I can't understand how to setup my nodes and the conf file to use it into the workflow.

HELP

L
admin
Site Admin
Posts: 1681
Joined: Sat Feb 08, 2014 10:39 pm

Re: YOUTUBE

Post by admin »

Hi backlight,

I'm not sure I quite catch your problem. Is it creating and configuring the youtube conf. file or is generally how to use the youtube-decoder?

-steinar
Post Reply