Transcode after import fails

imc67

When importing a video (according to your settings) it will transcode into one or more resolutions. All of the 3 resolutions failed with this error:

Job: 5
Type: video-transcoding
Processed on Oct 14, 2020, 10:52:52 AM
Finished on Oct 14, 2020, 10:52:53 AM

{
  "type": "hls",
  "videoUUID": "db21c654-6ca3-470e-b6a0-0f31bbcb3c37",
  "resolution": 360,
  "isPortraitMode": false,
  "copyCodecs": false
}

Error: ffmpeg exited with code 1: Conversion failed!

    at ChildProcess.<anonymous> (/app/code/server/node_modules/fluent-ffmpeg/lib/processor.js:182:22)
    at ChildProcess.emit (events.js:310:20)
    at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12)

girish

@imc67 Do you see these even with the latest package? I would like to get this sorted out, how can I reproduce this? Looks like this is the main bug pending before we can move the package to stable.

girish

Maybe related: https://forum.cloudron.io/topic/3204/transcoding-failed

imc67

@girish yes 0.7 version

imc67

@girish looks similar?

girish

@imc67 So this happens for all videos? How can I reproduce this?

imc67

@girish said in Transcode after import fails:

@imc67 Do you see these even with the latest package? I would like to get this sorted out, how can I reproduce this? Looks like this is the main bug pending before we can move the package to stable.

Very easy to reproduce, after setup/install, choose in settings HLS (no WebTorrent) and choose 1 or more resolutions for transcoding. Upload (I did by YouTube URL) a video.

imc67

@imc67 said in Transcode after import fails:

@girish said in Transcode after import fails:

@imc67 Do you see these even with the latest package? I would like to get this sorted out, how can I reproduce this? Looks like this is the main bug pending before we can move the package to stable.

Very easy to reproduce, after setup/install, choose in settings HLS (no WebRTC) and choose 1 or more resolutions for transcoding. Upload (I did by YouTube URL) a video.

Account settings - TV Valkenburg - Uitzending Gemist.png

girish

I can reproduce the error but calling the CLI directly works for me, hmmm.

root@eee2a741-ce16-4261-b533-52377a576bc6:/app/code# ffmpeg -i /app/data/storage/videos/ec6763a1-539b-4088-ab31-b593475d10ba-360.mp4 /app/data/storage/streaming-playlists/hls/ec6763a1-539b-4088-ab31-b593475d10ba/ec6763a1-539b-4088-ab31-b593475d10ba-360-fragmented.mp4 -x264opts "cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=1 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=16 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=60 keyint_min=6 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 vbv_maxrate=320 vbv_bufsize=640 crf_max=0.0 nal_hrd=none filler=0 ip_ratio=1.40 aq=1:1.00"

ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared
  libavutil      55. 78.100 / 55. 78.100
  libavcodec     57.107.100 / 57.107.100
  libavformat    57. 83.100 / 57. 83.100
  libavdevice    57. 10.100 / 57. 10.100
  libavfilter     6.107.100 /  6.107.100
  libavresample   3.  7.  0 /  3.  7.  0
  libswscale      4.  8.100 /  4.  8.100
  libswresample   2.  9.100 /  2.  9.100
  libpostproc    54.  7.100 / 54.  7.100
Trailing options were found on the commandline.
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/app/data/storage/videos/ec6763a1-539b-4088-ab31-b593475d10ba-360.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf57.83.100
  Duration: 00:00:07.02, start: 0.000000, bitrate: 1137 kb/s
    Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 640x360 [SAR 1:1 DAR 16:9], 802 kb/s, 30 fps, 30 tbr, 15360 tbn, 60 tbc (default)
    Metadata:
      handler_name    : VideoHandler
    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 327 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
  Stream #0:1 -> #0:1 (aac (native) -> aac (native))
Press [q] to stop, [?] for help
[libx264 @ 0x5622dfcecf80] using SAR=1/1
[libx264 @ 0x5622dfcecf80] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x5622dfcecf80] profile High, level 3.0
[libx264 @ 0x5622dfcecf80] 264 - core 152 r2854 e9a5903 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=1 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to '/app/data/storage/streaming-playlists/hls/ec6763a1-539b-4088-ab31-b593475d10ba/ec6763a1-539b-4088-ab31-b593475d10ba-360-fragmented.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf57.83.100
    Stream #0:0(und): Video: h264 (libx264) (avc1 / 0x31637661), yuv420p(progressive), 640x360 [SAR 1:1 DAR 16:9], q=-1--1, 30 fps, 15360 tbn, 30 tbc (default)
    Metadata:
      handler_name    : VideoHandler
      encoder         : Lavc57.107.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      encoder         : Lavc57.107.100 aac
frame=  210 fps= 72 q=29.0 Lsize=     776kB time=00:00:07.01 bitrate= 906.0kbits/s speed=2.42x    
video:656kB audio:111kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 1.156339%
[libx264 @ 0x5622dfcecf80] frame I:1     Avg QP:19.51  size:  2238
[libx264 @ 0x5622dfcecf80] frame P:55    Avg QP:21.29  size:  5233
[libx264 @ 0x5622dfcecf80] frame B:154   Avg QP:25.42  size:  2477
[libx264 @ 0x5622dfcecf80] consecutive B-frames:  0.5%  4.8%  1.4% 93.3%
[libx264 @ 0x5622dfcecf80] mb I  I16..4: 50.4% 49.6%  0.0%
[libx264 @ 0x5622dfcecf80] mb P  I16..4:  5.5%  6.2%  4.4%  P16..4: 38.4%  8.2%  3.6%  0.0%  0.0%    skip:33.7%
[libx264 @ 0x5622dfcecf80] mb B  I16..4:  0.3%  0.4%  1.0%  B16..8: 26.0%  4.3%  1.5%  direct: 1.6%  skip:65.0%  L0:39.2% L1:53.3% BI: 7.5%
[libx264 @ 0x5622dfcecf80] 8x8 transform intra:36.2% inter:50.8%
[libx264 @ 0x5622dfcecf80] coded y,uvDC,uvAC intra: 44.9% 55.9% 22.5% inter: 7.8% 11.6% 0.8%
[libx264 @ 0x5622dfcecf80] i16 v,h,dc,p: 15% 36%  8% 41%
[libx264 @ 0x5622dfcecf80] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 21% 28% 26%  4%  4%  3%  5%  3%  6%
[libx264 @ 0x5622dfcecf80] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 17% 16% 32%  5%  7%  6%  7%  4%  6%
[libx264 @ 0x5622dfcecf80] i8c dc,h,v,p: 54% 24% 16%  7%
[libx264 @ 0x5622dfcecf80] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0x5622dfcecf80] ref P L0: 60.5% 10.2% 20.1%  9.1%
[libx264 @ 0x5622dfcecf80] ref B L0: 86.5% 10.2%  3.2%
[libx264 @ 0x5622dfcecf80] ref B L1: 96.0%  4.0%
[libx264 @ 0x5622dfcecf80] kb/s:767.48
[aac @ 0x5622dfcb4c60] Qavg: 512.053

girish

@imc67 I have fixed this now in the new package.

imc67

@girish said in Transcode after import fails:

@imc67 I have fixed this now in the new package.

I really hoped it was but after v1.1.0 and importing via URL this is the result:

Job: 7
Type: video-transcoding
Processed on Oct 15, 2020, 9:32:42 AM
Finished on Oct 15, 2020, 9:32:42 AM

{
  "type": "hls",
  "videoUUID": "881f46cb-4afb-4977-9fe2-7fe580d20fc0",
  "resolution": 480,
  "copyCodecs": true
}

Error: ffmpeg exited with code 1: 
    at ChildProcess.<anonymous> (/app/code/server/node_modules/fluent-ffmpeg/lib/processor.js:182:22)
    at ChildProcess.emit (events.js:310:20)
    at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12)

this is the specified error log:

error[15-10-2020 09:32:42] Error in transcoding job.

{
  "stdout": "",
  "stderr": "ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers\n  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)\n  configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared\n  libavutil      55. 78.100 / 55. 78.100\n  libavcodec     57.107.100 / 57.107.100\n  libavformat    57. 83.100 / 57. 83.100\n  libavdevice    57. 10.100 / 57. 10.100\n  libavfilter     6.107.100 /  6.107.100\n  libavresample   3.  7.  0 /  3.  7.  0\n  libswscale      4.  8.100 /  4.  8.100\n  libswresample   2.  9.100 /  2.  9.100\n  libpostproc    54.  7.100 / 54.  7.100\nInput #0, mov,mp4,m4a,3gp,3g2,mj2, from '/app/data/storage/videos/881f46cb-4afb-4977-9fe2-7fe580d20fc0-480.mp4':\n  Metadata:\n    major_brand     : isom\n    minor_version   : 512\n    compatible_brands: isomiso2avc1mp41\n    encoder         : Lavf57.83.100\n  Duration: 00:00:27.05, start: 0.000000, bitrate: 799 kb/s\n    Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt709), 854x480 [SAR 1:1 DAR 427:240], 669 kb/s, 25 fps, 25 tbr, 90k tbn, 50 tbc (default)\n    Metadata:\n      handler_name    : VideoHandler\n    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 125 kb/s (default)\n    Metadata:\n      handler_name    : SoundHandler\n[hls @ 0x55601c225e40] Opening 'init.mp4' for writing\n[hls @ 0x55601c225e40] Failed to open segment '/app/data/storage/streaming-playlists/hls/881f46cb-4afb-4977-9fe2-7fe580d20fc0/881f46cb-4afb-4977-9fe2-7fe580d20fc0-480-fragmented.mp4'\nCould not write header for output file #0 (incorrect codec parameters ?): Read-only file system\nStream mapping:\n  Stream #0:0 -> #0:0 (copy)\n  Stream #0:1 -> #0:1 (copy)\n    Last message repeated 1 times\n"
}

error[15-10-2020 09:32:42] Cannot execute job 7 in queue video-transcoding.

{
  "payload": {
    "type": "hls",
    "videoUUID": "881f46cb-4afb-4977-9fe2-7fe580d20fc0",
    "resolution": 480,
    "copyCodecs": true
  },
  "err": {
    "stack": "Error: ffmpeg exited with code 1: \n    at ChildProcess.<anonymous> (/app/code/server/node_modules/fluent-ffmpeg/lib/processor.js:182:22)\n    at ChildProcess.emit (events.js:310:20)\n    at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12)",
    "message": "ffmpeg exited with code 1: "
  }
}

error[15-10-2020 09:32:43] Error in transcoding job.

{
  "stdout": "",
  "stderr": "ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers\n  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)\n  configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared\n  libavutil      55. 78.100 / 55. 78.100\n  libavcodec     57.107.100 / 57.107.100\n  libavformat    57. 83.100 / 57. 83.100\n  libavdevice    57. 10.100 / 57. 10.100\n  libavfilter     6.107.100 /  6.107.100\n  libavresample   3.  7.  0 /  3.  7.  0\n  libswscale      4.  8.100 /  4.  8.100\n  libswresample   2.  9.100 /  2.  9.100\n  libpostproc    54.  7.100 / 54.  7.100\nInput #0, mov,mp4,m4a,3gp,3g2,mj2, from '/app/data/storage/videos/881f46cb-4afb-4977-9fe2-7fe580d20fc0-480.mp4':\n  Metadata:\n    major_brand     : isom\n    minor_version   : 512\n    compatible_brands: isomiso2avc1mp41\n    encoder         : Lavf57.83.100\n  Duration: 00:00:27.05, start: 0.000000, bitrate: 799 kb/s\n    Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt709), 854x480 [SAR 1:1 DAR 427:240], 669 kb/s, 25 fps, 25 tbr, 90k tbn, 50 tbc (default)\n    Metadata:\n      handler_name    : VideoHandler\n    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 125 kb/s (default)\n    Metadata:\n      handler_name    : SoundHandler\nStream mapping:\n  Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))\n  Stream #0:1 -> #0:1 (aac (native) -> aac (native))\nPress [q] to stop, [?] for help\n[libx264 @ 0x560188acf240] using SAR=1281/1280\n[libx264 @ 0x560188acf240] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2\n[libx264 @ 0x560188acf240] profile High, level 3.1\n[libx264 @ 0x560188acf240] 264 - core 152 r2854 e9a5903 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=4 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=16 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=50 keyint_min=5 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 vbv_maxrate=728 vbv_bufsize=1456 crf_max=0.0 nal_hrd=none filler=0 ip_ratio=1.40 aq=1:1.00\n[hls @ 0x560188aca9a0] Opening 'init.mp4' for writing\n[hls @ 0x560188aca9a0] Failed to open segment '/app/data/storage/streaming-playlists/hls/881f46cb-4afb-4977-9fe2-7fe580d20fc0/881f46cb-4afb-4977-9fe2-7fe580d20fc0-360-fragmented.mp4'\nCould not write header for output file #0 (incorrect codec parameters ?): Read-only file system\nError initializing output stream 0:0 -- \n[aac @ 0x560188af2620] Qavg: 13786.650\n[aac @ 0x560188af2620] 2 frames left in the queue on closing\nConversion failed!\n"
}

error[15-10-2020 09:32:43] Cannot execute job 8 in queue video-transcoding.

{
  "payload": {
    "type": "hls",
    "videoUUID": "881f46cb-4afb-4977-9fe2-7fe580d20fc0",
    "resolution": 360,
    "isPortraitMode": false,
    "copyCodecs": false
  },
  "err": {
    "stack": "Error: ffmpeg exited with code 1: Conversion failed!\n\n    at ChildProcess.<anonymous> (/app/code/server/node_modules/fluent-ffmpeg/lib/processor.js:182:22)\n    at ChildProcess.emit (events.js:310:20)\n    at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12)",
    "message": "ffmpeg exited with code 1: Conversion failed!\n"
  }
}

girish

@imc67 I am unable to reproduce it. I tried importing ~4-5 videos from youtube and they don't fail.

Can you give me a specific video maybe?

girish

@imc67 Nevermind, I reproduced it! Grrr, I thought I fixed the problem.

girish

OK, I have made a PR upstream - https://github.com/Chocobozzz/PeerTube/pull/3198. In the meantime, I have pushed a new package, can you check if transcoding works with that?

I found other sporadic errors:

"Killed" - this means you have to give peertube more memory
"Conversion failed" - not sure why this happens but it happens with some youtube videos.

imc67

@girish again not succesfull (sorry ) :

I gave the app 8GB memory (was already all the time 8GB)
the jobs are successful
the video preview (still) is visible in the PeerTube GUI
playing doesn't work at all in the PeerTube GUI and the 3 resolutions are not in the 'menu'
I can see by processor use and upload speed in Zabbix that "something is happening"
generated files are everywhere (except videos folder, see screenshots)
the HLS mp4 files I can download them via SCP and play them correctly in the correct resolution
import via YT URL or upload via file results in the same situation
I doubt if the error logs are related to this problem, it feels more like that the Peertube GUI "is looking to the wrong place" for the video files?
however, if I download the video via the Peertube GUI, the correct path is there and the download is succesful

Screenshots of the Filemanager folders:

Schermafbeelding 2020-10-16 om 11.38.22.png

Error log:

warn[16-10-2020 10:43:20] Cannot authenticate.

{
  "err": {
    "statusCode": 401,
    "status": 401,
    "code": 401,
    "message": "Invalid token: access token has expired",
    "name": "invalid_token",
    "stack": "invalid_token: Invalid token: access token has expired\n    at new InvalidTokenError (/app/code/server/node_modules/oauth2-server/lib/errors/invalid-token-error.js:25:14)\n    at AuthenticateHandler.validateAccessToken (/app/code/server/node_modules/oauth2-server/lib/handlers/authenticate-handler.js:227:11)\n    at AuthenticateHandler.<anonymous> (/app/code/server/node_modules/oauth2-server/lib/handlers/authenticate-handler.js:77:19)\n    at PassThroughHandlerContext.finallyHandler (/app/code/server/node_modules/bluebird/js/release/finally.js:57:23)\n    at PassThroughHandlerContext.tryCatcher (/app/code/server/node_modules/bluebird/js/release/util.js:16:23)\n    at Promise._settlePromiseFromHandler (/app/code/server/node_modules/bluebird/js/release/promise.js:547:31)\n    at Promise._settlePromise (/app/code/server/node_modules/bluebird/js/release/promise.js:604:18)\n    at Promise._settlePromise0 (/app/code/server/node_modules/bluebird/js/release/promise.js:649:10)\n    at Promise._settlePromises (/app/code/server/node_modules/bluebird/js/release/promise.js:729:18)\n    at _drainQueueStep (/app/code/server/node_modules/bluebird/js/release/async.js:93:12)\n    at _drainQueue (/app/code/server/node_modules/bluebird/js/release/async.js:86:9)\n    at Async._drainQueues (/app/code/server/node_modules/bluebird/js/release/async.js:102:5)\n    at Immediate.Async.drainQueues [as _onImmediate] (/app/code/server/node_modules/bluebird/js/release/async.js:15:14)\n    at processImmediate (internal/timers.js:456:21)"
  }
}

warn[16-10-2020 10:43:20] Cannot authenticate.

{
  "err": {
    "statusCode": 401,
    "status": 401,
    "code": 401,
    "message": "Invalid token: access token has expired",
    "name": "invalid_token",
    "stack": "invalid_token: Invalid token: access token has expired\n    at new InvalidTokenError (/app/code/server/node_modules/oauth2-server/lib/errors/invalid-token-error.js:25:14)\n    at AuthenticateHandler.validateAccessToken (/app/code/server/node_modules/oauth2-server/lib/handlers/authenticate-handler.js:227:11)\n    at AuthenticateHandler.<anonymous> (/app/code/server/node_modules/oauth2-server/lib/handlers/authenticate-handler.js:77:19)\n    at PassThroughHandlerContext.finallyHandler (/app/code/server/node_modules/bluebird/js/release/finally.js:57:23)\n    at PassThroughHandlerContext.tryCatcher (/app/code/server/node_modules/bluebird/js/release/util.js:16:23)\n    at Promise._settlePromiseFromHandler (/app/code/server/node_modules/bluebird/js/release/promise.js:547:31)\n    at Promise._settlePromise (/app/code/server/node_modules/bluebird/js/release/promise.js:604:18)\n    at Promise._settlePromise0 (/app/code/server/node_modules/bluebird/js/release/promise.js:649:10)\n    at Promise._settlePromises (/app/code/server/node_modules/bluebird/js/release/promise.js:729:18)\n    at _drainQueueStep (/app/code/server/node_modules/bluebird/js/release/async.js:93:12)\n    at _drainQueue (/app/code/server/node_modules/bluebird/js/release/async.js:86:9)\n    at Async._drainQueues (/app/code/server/node_modules/bluebird/js/release/async.js:102:5)\n    at Immediate.Async.drainQueues [as _onImmediate] (/app/code/server/node_modules/bluebird/js/release/async.js:15:14)\n    at processImmediate (internal/timers.js:456:21)"
  }
}

warn[16-10-2020 10:45:18] Warning in tracker.

{
  "err": {
    "stack": "Error: Unknown infoHash 00dfd0272f82ae6cdb0061f5af6fb395b06ba4fa requested by ip **.**.**.**\n    at Server.<anonymous> (/app/code/server/dist/server/controllers/tracker.js:54:20)\n    at Generator.next (<anonymous>)\n    at fulfilled (/app/code/server/node_modules/tslib/tslib.js:111:62)",
    "message": "Unknown infoHash 00dfd0272f82ae6cdb0061f5af6fb395b06ba4fa requested by ip **.**.**.**"
  }
}

girish

@imc67 That's fine Good news is I think this is a different transcoding issue and the read only filesystem thing is sorted out, it's atleast converting now. Does this happen for all videos ? I found https://github.com/Chocobozzz/PeerTube/issues/2990 which may be related?

imc67

@girish I give up on this piece of software, it's not worth all the waiting and debugging to get it to work.

On 27th of July I wrote:

Hi @girish , I discovered PeerTube since it was announced here and was very enthusiastic because it fits in our needs. However during the past 6 weeks I'm beginning to loose faith in this project.

The project has a very slow "beat", they write they have only 1 (paid) developer. We had to wait 5 weeks to get an essential bug (not able to config) solved. After your last update it looked fine and I started to setup everything but then discovered a "stupid" bug again: videos don't play on iPad (https://github.com/Chocobozzz/PeerTube/issues/2941)! The developer knows this for at least 3 weeks but there seems no investigation/progress. Most of our viewers use iPad so we can't start (again) ...
There is also a very annoying issue that themes are alternating switching during browsing, so 1 click you're in dark mode and the next one in light mode (https://github.com/Chocobozzz/PeerTube/issues/3007). Beside that there are 350 other open issues ...

We're now 3 months later, you did an awful lot of work but it's still not working but it's not your fault!

It's not your mentioned issue 2990 because the video simply doesn't play, no matter how long you wait.

I will uninstall the app and wait for a better alternative ........

girish

No problem, I understand . We are probably very early adopters of PeerTube at this point.

robi

Would dtube be a viable replacement?

https://github.com/dtube
looks much more actively developed

girish

@imc67 said in Transcode after import fails:

@girish I give up on this piece of software, it's not worth all the waiting and debugging to get it to work.

On a positive note, Debian put in some money to help improve now Peertube - https://bits.debian.org/2020/10/debian-donation-peertube.html

imc67

@girish I really need to use "something" like PeerTube soon and I couldn't believe why it still doesn't work with HLS!

I did some testing and research:

On the Cloudron demo I installed PeerTube (also there I had this issue https://forum.cloudron.io/topic/3642/new-installation-not-able-to-log-in but solved it, I really think you should give it at least 1GB App memory and 1GB Redis memory to start)
I only switched on 2 kind of transcoding options and HLS (no WebTorrents)
Uploaded a mp4
waited for transcoding
Video did not play ....

So same issue with our own PeerTube instance on our own Cloudron.

Searching through their Git I discovered solved issues that might be related to Cloudron?

1.

https://github.com/Chocobozzz/PeerTube/issues/3181

The PeerTube developer asks here "Do you have a reverse proxy in front of docker? Because it's seems the server does not respect the byte range request", that was the case and they solved it.

Could it be a similar issue on Cloudron?

2.
Another issue on the Cloudron version: ffmpeg is not the right version!

Current:

ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers
built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared
libavutil      55. 78.100 / 55. 78.100
libavcodec     57.107.100 / 57.107.100
libavformat    57. 83.100 / 57. 83.100
libavdevice    57. 10.100 / 57. 10.100
libavfilter     6.107.100 /  6.107.100
libavresample   3.  7.  0 /  3.  7.  0
libswscale      4.  8.100 /  4.  8.100
libswresample   2.  9.100 /  2.  9.100
libpostproc    54.  7.100 / 54.  7.100

Needed: You need ffmpeg >= 4.1 if you enable HLS (https://github.com/Chocobozzz/PeerTube/issues/2469#issuecomment-584563107)

girish

@imc67 Thanks for the detailed investigation! I have pushed a new package with ffmpeg 4.3

imc67

@girish thank you very much for your quick response and update! However .....

... it still doesn't work (although now it does show the start of the video!). For the last hour I've checked all of their Git and got inspired to look into my browser consoles (Safari on MacOS and Firefox on MacOS) and discovered in both a similar error that might be Cloudron related (but of course I'm not sure):

Safari:
Schermafbeelding 2020-12-02 om 21.44.28.png

Firefox:
Schermafbeelding 2020-12-02 om 21.47.26.png

It looks like Peertube in the local browser needs a kind of connection to the server but it's forbidden:

GET wss://videos.[domainname].[tld]/tracker/socket | [HTTP/1.1 403 Forbidden 64ms]

girish

@imc67 Can you try to see if the instances at https://joinpeertube.org/instances#instances-list work? Will help me understand if this is a packaging issue or an upstream issue.

I am not an expert on HLS. Can you tell me how I can test this? Does it require a specific kind of video or does it fail with any video ?

imc67

@girish I've found just at random a video and it plays well, I'm pretty sure it's playing in HLS, see screenshot:

https://tube.tardis.world/videos/watch/a56df39d-05d8-4a51-9393-b549ffd7167c

Screenshot of Network usage in browser (Firefox):
here you can see it's playing the 1080.m3u8 file (HLS), as far as I understand HLS this file "contains indexes" of the mp4 so it only retrieves from the browser at the right timing the right "slice" from the mp4 to play locally without retrieving first all the GB's of the mp4.

Schermafbeelding 2020-12-02 om 22.21.09.png

@girish "Does it require a specific kind of video or does it fail with any video ?" In Peertube settings you can choose for (only) HLS and Peertube makes these special files.

This is how it looks like for 1 video:
Schermafbeelding 2020-12-02 om 22.32.40.png

Configuration in Peertube:
Schermafbeelding 2020-12-02 om 22.34.27.png

girish

@imc67 thanks, I will have some time tomorrow to investigate this.

imc67

@girish said in Transcode after import fails:

@imc67 thanks, I will have some time tomorrow to investigate this.

I’m really curious if you could find the wss issue?

girish

@imc67 Too busy this week, has to be next week. FWIW, it's most likely not a wss issue (since we have apps like rocket.chat, cloudron dashboard, mattermost already using wss) but some PeerTube related issue.

girish

@imc67 Been trying this out. I can also see 403 error to wss. There is also some hls.js error with bufferStalledError. But the video plays anyway (in safari). Exact same as https://github.com/Chocobozzz/PeerTube/issues/655 (does safari block these by default maybe?)

Edit: I see same behavior in firefox on linux as well.

imc67

@girish said in Transcode after import fails:

does safari block these by default maybe?)

HLS was invented by Apple so I can't imagine they block it.

This video plays HLS very well: https://tube.tardis.world/videos/watch/a56df39d-05d8-4a51-9393-b549ffd7167c

imc67

@girish said in Transcode after import fails:

video plays anyway (in safari).

Does it play HLS or WebTorrent? Because for testing I also switched WebTorrent ON and then the video does play in Safari but in WebTorrent not HLS.

girish

@imc67 said in Transcode after import fails:

Does it play HLS or WebTorrent?

How can I make out? I actually disabled WebTorrent just like your initial transcoding configuration. Only HLS with P2P is enabled. But I would like to check how it's playing the video.

girish

@imc67 said in Transcode after import fails:

This video plays HLS very well: https://tube.tardis.world/videos/watch/a56df39d-05d8-4a51-9393-b549ffd7167c

Just to double check. This is not a Cloudron installation right? That video is 10GB for download, so I imagine it will take me forever to download and upload it into my test instance.

imc67

@girish some posts above I added a screenshot:

Screenshot of Network usage in browser (Firefox):
here you can see it's playing the 1080.m3u8 file (HLS), as far as I understand HLS this file "contains indexes" of the mp4 so it only retrieves from the browser at the right timing the right "slice" from the mp4 to play locally without retrieving first all the GB's of the mp4.

imc67

@girish haha no indeed it's not on Cloudron, some posts before you asked me if I could find a peertube that does play HLS, accidently I found that one, btw very nice video and music

imc67

@girish said in Transcode after import fails:

I actually disabled WebTorrent

Did you disabled before uploading video or after?

girish

@imc67 said in Transcode after import fails:

Did you disabled before uploading video or after?

I disabled before uploading the video. I see firefox downloading a lot of "fragmented" mp4s.

imc67

@girish said in Transcode after import fails:

I see firefox downloading a lot of "fragmented" mp4s

WebTorrent als has those fragmented files, did you see also in that network-list a *.m3u8 file (see my screenshot earlier)? Then it's HLS.

girish

@imc67 Yes, I see m3u8 downloaded (which is the HLS index file, I guess). Also, AFAICT this tracker/socket thing is something webtorrent related and the 403 is returned because we disabled webtorrent explicitly. I am trying to get peertube to indicate in the logs to confirm this.

imc67

@girish very strange the videos do play HLS in Safari in your environment. Then it must be the video? Our videos are all 720P25 mp4, I could send you one to test?

girish

@imc67 I think I found the issue with the tracker wss. Looks like the package have trust proxy configured incorrectly - https://github.com/Chocobozzz/PeerTube/blob/4e239e3554ba7162c03e939f54133933527a1b74/server/controllers/tracker.ts#L99 .

BTW, I changed the location of my peertube instance and this completely broke the videos. Do you know if you changed the location of your peertube instance by any chance? The peertube docs do say that this won't work, I forgot about it. Otherwise, if you can put the video for download somewhere, I can try it out in my instance.

girish

@imc67 Actually, the tracker is not a problem. Peertube simply returns 403 when info hash (something webtorrent related) is not found and blocks that IP. So, I guess the status now is that it works for me and we can test it out with your video in my instance. Also, confirm that you haven't changed the location of peertube after installing/uploading videos. This seems to break everything.

imc67

@girish I can confirm I haven't changed location. I'll send you an email with a download link for a test video and the URL of our instance.

imc67

@imc67 I just uploaded a video produced in 1080P and that one plays fine!?!

So I guess it are the export settings causing this error in PT.

I created an issue in their Github: https://github.com/Chocobozzz/PeerTube/issues/3502

girish

@imc67 Is there a sample video you can link to the upstream task, so they can test it out?

imc67

@girish it’s probably fixed:

Force HLS transcoding
Fix weird behaviour with some web browsers. Don't really know if it's a ffmpeg bug, a safari bug or a peertube bug, but forcing transcoding seems to fix this playback bug

Now we have to wait for the next release

Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.

Solved Transcode after import fails