Transcode after import fails

[imc67]

@girish said in Transcode after import fails:

@imc67 Do you see these even with the latest package? I would like to get this sorted out, how can I reproduce this? Looks like this is the main bug pending before we can move the package to stable.

Very easy to reproduce, after setup/install, choose in settings HLS (no WebTorrent) and choose 1 or more resolutions for transcoding. Upload (I did by YouTube URL) a video.

[imc67]

@imc67 said in Transcode after import fails:

@girish said in Transcode after import fails:

@imc67 Do you see these even with the latest package? I would like to get this sorted out, how can I reproduce this? Looks like this is the main bug pending before we can move the package to stable.

Very easy to reproduce, after setup/install, choose in settings HLS (no WebRTC) and choose 1 or more resolutions for transcoding. Upload (I did by YouTube URL) a video.

[girish]

I can reproduce the error but calling the CLI directly works for me, hmmm.

root@eee2a741-ce16-4261-b533-52377a576bc6:/app/code# ffmpeg -i /app/data/storage/videos/ec6763a1-539b-4088-ab31-b593475d10ba-360.mp4 /app/data/storage/streaming-playlists/hls/ec6763a1-539b-4088-ab31-b593475d10ba/ec6763a1-539b-4088-ab31-b593475d10ba-360-fragmented.mp4 -x264opts "cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=1 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=16 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=60 keyint_min=6 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 vbv_maxrate=320 vbv_bufsize=640 crf_max=0.0 nal_hrd=none filler=0 ip_ratio=1.40 aq=1:1.00"

ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers
  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
  configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared
  libavutil      55. 78.100 / 55. 78.100
  libavcodec     57.107.100 / 57.107.100
  libavformat    57. 83.100 / 57. 83.100
  libavdevice    57. 10.100 / 57. 10.100
  libavfilter     6.107.100 /  6.107.100
  libavresample   3.  7.  0 /  3.  7.  0
  libswscale      4.  8.100 /  4.  8.100
  libswresample   2.  9.100 /  2.  9.100
  libpostproc    54.  7.100 / 54.  7.100
Trailing options were found on the commandline.
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/app/data/storage/videos/ec6763a1-539b-4088-ab31-b593475d10ba-360.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf57.83.100
  Duration: 00:00:07.02, start: 0.000000, bitrate: 1137 kb/s
    Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 640x360 [SAR 1:1 DAR 16:9], 802 kb/s, 30 fps, 30 tbr, 15360 tbn, 60 tbc (default)
    Metadata:
      handler_name    : VideoHandler
    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 327 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
  Stream #0:1 -> #0:1 (aac (native) -> aac (native))
Press [q] to stop, [?] for help
[libx264 @ 0x5622dfcecf80] using SAR=1/1
[libx264 @ 0x5622dfcecf80] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x5622dfcecf80] profile High, level 3.0
[libx264 @ 0x5622dfcecf80] 264 - core 152 r2854 e9a5903 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=1 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to '/app/data/storage/streaming-playlists/hls/ec6763a1-539b-4088-ab31-b593475d10ba/ec6763a1-539b-4088-ab31-b593475d10ba-360-fragmented.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf57.83.100
    Stream #0:0(und): Video: h264 (libx264) (avc1 / 0x31637661), yuv420p(progressive), 640x360 [SAR 1:1 DAR 16:9], q=-1--1, 30 fps, 15360 tbn, 30 tbc (default)
    Metadata:
      handler_name    : VideoHandler
      encoder         : Lavc57.107.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      encoder         : Lavc57.107.100 aac
frame=  210 fps= 72 q=29.0 Lsize=     776kB time=00:00:07.01 bitrate= 906.0kbits/s speed=2.42x    
video:656kB audio:111kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 1.156339%
[libx264 @ 0x5622dfcecf80] frame I:1     Avg QP:19.51  size:  2238
[libx264 @ 0x5622dfcecf80] frame P:55    Avg QP:21.29  size:  5233
[libx264 @ 0x5622dfcecf80] frame B:154   Avg QP:25.42  size:  2477
[libx264 @ 0x5622dfcecf80] consecutive B-frames:  0.5%  4.8%  1.4% 93.3%
[libx264 @ 0x5622dfcecf80] mb I  I16..4: 50.4% 49.6%  0.0%
[libx264 @ 0x5622dfcecf80] mb P  I16..4:  5.5%  6.2%  4.4%  P16..4: 38.4%  8.2%  3.6%  0.0%  0.0%    skip:33.7%
[libx264 @ 0x5622dfcecf80] mb B  I16..4:  0.3%  0.4%  1.0%  B16..8: 26.0%  4.3%  1.5%  direct: 1.6%  skip:65.0%  L0:39.2% L1:53.3% BI: 7.5%
[libx264 @ 0x5622dfcecf80] 8x8 transform intra:36.2% inter:50.8%
[libx264 @ 0x5622dfcecf80] coded y,uvDC,uvAC intra: 44.9% 55.9% 22.5% inter: 7.8% 11.6% 0.8%
[libx264 @ 0x5622dfcecf80] i16 v,h,dc,p: 15% 36%  8% 41%
[libx264 @ 0x5622dfcecf80] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 21% 28% 26%  4%  4%  3%  5%  3%  6%
[libx264 @ 0x5622dfcecf80] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 17% 16% 32%  5%  7%  6%  7%  4%  6%
[libx264 @ 0x5622dfcecf80] i8c dc,h,v,p: 54% 24% 16%  7%
[libx264 @ 0x5622dfcecf80] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0x5622dfcecf80] ref P L0: 60.5% 10.2% 20.1%  9.1%
[libx264 @ 0x5622dfcecf80] ref B L0: 86.5% 10.2%  3.2%
[libx264 @ 0x5622dfcecf80] ref B L1: 96.0%  4.0%
[libx264 @ 0x5622dfcecf80] kb/s:767.48
[aac @ 0x5622dfcb4c60] Qavg: 512.053

[girish]

@imc67 I have fixed this now in the new package.

[imc67]

@girish said in Transcode after import fails:

@imc67 I have fixed this now in the new package.

I really hoped it was but after v1.1.0 and importing via URL this is the result:

Job: 7
Type: video-transcoding
Processed on Oct 15, 2020, 9:32:42 AM
Finished on Oct 15, 2020, 9:32:42 AM

{
  "type": "hls",
  "videoUUID": "881f46cb-4afb-4977-9fe2-7fe580d20fc0",
  "resolution": 480,
  "copyCodecs": true
}

Error: ffmpeg exited with code 1: 
    at ChildProcess.<anonymous> (/app/code/server/node_modules/fluent-ffmpeg/lib/processor.js:182:22)
    at ChildProcess.emit (events.js:310:20)
    at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12)

this is the specified error log:

error[15-10-2020 09:32:42] Error in transcoding job.

{
  "stdout": "",
  "stderr": "ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers\n  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)\n  configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared\n  libavutil      55. 78.100 / 55. 78.100\n  libavcodec     57.107.100 / 57.107.100\n  libavformat    57. 83.100 / 57. 83.100\n  libavdevice    57. 10.100 / 57. 10.100\n  libavfilter     6.107.100 /  6.107.100\n  libavresample   3.  7.  0 /  3.  7.  0\n  libswscale      4.  8.100 /  4.  8.100\n  libswresample   2.  9.100 /  2.  9.100\n  libpostproc    54.  7.100 / 54.  7.100\nInput #0, mov,mp4,m4a,3gp,3g2,mj2, from '/app/data/storage/videos/881f46cb-4afb-4977-9fe2-7fe580d20fc0-480.mp4':\n  Metadata:\n    major_brand     : isom\n    minor_version   : 512\n    compatible_brands: isomiso2avc1mp41\n    encoder         : Lavf57.83.100\n  Duration: 00:00:27.05, start: 0.000000, bitrate: 799 kb/s\n    Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt709), 854x480 [SAR 1:1 DAR 427:240], 669 kb/s, 25 fps, 25 tbr, 90k tbn, 50 tbc (default)\n    Metadata:\n      handler_name    : VideoHandler\n    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 125 kb/s (default)\n    Metadata:\n      handler_name    : SoundHandler\n[hls @ 0x55601c225e40] Opening 'init.mp4' for writing\n[hls @ 0x55601c225e40] Failed to open segment '/app/data/storage/streaming-playlists/hls/881f46cb-4afb-4977-9fe2-7fe580d20fc0/881f46cb-4afb-4977-9fe2-7fe580d20fc0-480-fragmented.mp4'\nCould not write header for output file #0 (incorrect codec parameters ?): Read-only file system\nStream mapping:\n  Stream #0:0 -> #0:0 (copy)\n  Stream #0:1 -> #0:1 (copy)\n    Last message repeated 1 times\n"
}

error[15-10-2020 09:32:42] Cannot execute job 7 in queue video-transcoding.

{
  "payload": {
    "type": "hls",
    "videoUUID": "881f46cb-4afb-4977-9fe2-7fe580d20fc0",
    "resolution": 480,
    "copyCodecs": true
  },
  "err": {
    "stack": "Error: ffmpeg exited with code 1: \n    at ChildProcess.<anonymous> (/app/code/server/node_modules/fluent-ffmpeg/lib/processor.js:182:22)\n    at ChildProcess.emit (events.js:310:20)\n    at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12)",
    "message": "ffmpeg exited with code 1: "
  }
}

error[15-10-2020 09:32:43] Error in transcoding job.

{
  "stdout": "",
  "stderr": "ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers\n  built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)\n  configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared\n  libavutil      55. 78.100 / 55. 78.100\n  libavcodec     57.107.100 / 57.107.100\n  libavformat    57. 83.100 / 57. 83.100\n  libavdevice    57. 10.100 / 57. 10.100\n  libavfilter     6.107.100 /  6.107.100\n  libavresample   3.  7.  0 /  3.  7.  0\n  libswscale      4.  8.100 /  4.  8.100\n  libswresample   2.  9.100 /  2.  9.100\n  libpostproc    54.  7.100 / 54.  7.100\nInput #0, mov,mp4,m4a,3gp,3g2,mj2, from '/app/data/storage/videos/881f46cb-4afb-4977-9fe2-7fe580d20fc0-480.mp4':\n  Metadata:\n    major_brand     : isom\n    minor_version   : 512\n    compatible_brands: isomiso2avc1mp41\n    encoder         : Lavf57.83.100\n  Duration: 00:00:27.05, start: 0.000000, bitrate: 799 kb/s\n    Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt709), 854x480 [SAR 1:1 DAR 427:240], 669 kb/s, 25 fps, 25 tbr, 90k tbn, 50 tbc (default)\n    Metadata:\n      handler_name    : VideoHandler\n    Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 125 kb/s (default)\n    Metadata:\n      handler_name    : SoundHandler\nStream mapping:\n  Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))\n  Stream #0:1 -> #0:1 (aac (native) -> aac (native))\nPress [q] to stop, [?] for help\n[libx264 @ 0x560188acf240] using SAR=1281/1280\n[libx264 @ 0x560188acf240] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2\n[libx264 @ 0x560188acf240] profile High, level 3.1\n[libx264 @ 0x560188acf240] 264 - core 152 r2854 e9a5903 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=4 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=16 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=50 keyint_min=5 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 vbv_maxrate=728 vbv_bufsize=1456 crf_max=0.0 nal_hrd=none filler=0 ip_ratio=1.40 aq=1:1.00\n[hls @ 0x560188aca9a0] Opening 'init.mp4' for writing\n[hls @ 0x560188aca9a0] Failed to open segment '/app/data/storage/streaming-playlists/hls/881f46cb-4afb-4977-9fe2-7fe580d20fc0/881f46cb-4afb-4977-9fe2-7fe580d20fc0-360-fragmented.mp4'\nCould not write header for output file #0 (incorrect codec parameters ?): Read-only file system\nError initializing output stream 0:0 -- \n[aac @ 0x560188af2620] Qavg: 13786.650\n[aac @ 0x560188af2620] 2 frames left in the queue on closing\nConversion failed!\n"
}

error[15-10-2020 09:32:43] Cannot execute job 8 in queue video-transcoding.

{
  "payload": {
    "type": "hls",
    "videoUUID": "881f46cb-4afb-4977-9fe2-7fe580d20fc0",
    "resolution": 360,
    "isPortraitMode": false,
    "copyCodecs": false
  },
  "err": {
    "stack": "Error: ffmpeg exited with code 1: Conversion failed!\n\n    at ChildProcess.<anonymous> (/app/code/server/node_modules/fluent-ffmpeg/lib/processor.js:182:22)\n    at ChildProcess.emit (events.js:310:20)\n    at Process.ChildProcess._handle.onexit (internal/child_process.js:275:12)",
    "message": "ffmpeg exited with code 1: Conversion failed!\n"
  }
}

[girish]

@imc67 I am unable to reproduce it. I tried importing ~4-5 videos from youtube and they don't fail.

Can you give me a specific video maybe?

[girish]

@imc67 Nevermind, I reproduced it! Grrr, I thought I fixed the problem.

[girish]

OK, I have made a PR upstream - https://github.com/Chocobozzz/PeerTube/pull/3198. In the meantime, I have pushed a new package, can you check if transcoding works with that?

I found other sporadic errors:

• "Killed" - this means you have to give peertube more memory
• "Conversion failed" - not sure why this happens but it happens with some youtube videos.

[imc67]

@girish again not succesfull (sorry ) :

• I gave the app 8GB memory (was already all the time 8GB)
• the jobs are successful
• the video preview (still) is visible in the PeerTube GUI
• playing doesn't work at all in the PeerTube GUI and the 3 resolutions are not in the 'menu'
• I can see by processor use and upload speed in Zabbix that "something is happening"
• generated files are everywhere (except videos folder, see screenshots)
• the HLS mp4 files I can download them via SCP and play them correctly in the correct resolution
• import via YT URL or upload via file results in the same situation
• I doubt if the error logs are related to this problem, it feels more like that the Peertube GUI "is looking to the wrong place" for the video files?
• however, if I download the video via the Peertube GUI, the correct path is there and the download is succesful

Screenshots of the Filemanager folders:

Error log:

warn[16-10-2020 10:43:20] Cannot authenticate.

{
  "err": {
    "statusCode": 401,
    "status": 401,
    "code": 401,
    "message": "Invalid token: access token has expired",
    "name": "invalid_token",
    "stack": "invalid_token: Invalid token: access token has expired\n    at new InvalidTokenError (/app/code/server/node_modules/oauth2-server/lib/errors/invalid-token-error.js:25:14)\n    at AuthenticateHandler.validateAccessToken (/app/code/server/node_modules/oauth2-server/lib/handlers/authenticate-handler.js:227:11)\n    at AuthenticateHandler.<anonymous> (/app/code/server/node_modules/oauth2-server/lib/handlers/authenticate-handler.js:77:19)\n    at PassThroughHandlerContext.finallyHandler (/app/code/server/node_modules/bluebird/js/release/finally.js:57:23)\n    at PassThroughHandlerContext.tryCatcher (/app/code/server/node_modules/bluebird/js/release/util.js:16:23)\n    at Promise._settlePromiseFromHandler (/app/code/server/node_modules/bluebird/js/release/promise.js:547:31)\n    at Promise._settlePromise (/app/code/server/node_modules/bluebird/js/release/promise.js:604:18)\n    at Promise._settlePromise0 (/app/code/server/node_modules/bluebird/js/release/promise.js:649:10)\n    at Promise._settlePromises (/app/code/server/node_modules/bluebird/js/release/promise.js:729:18)\n    at _drainQueueStep (/app/code/server/node_modules/bluebird/js/release/async.js:93:12)\n    at _drainQueue (/app/code/server/node_modules/bluebird/js/release/async.js:86:9)\n    at Async._drainQueues (/app/code/server/node_modules/bluebird/js/release/async.js:102:5)\n    at Immediate.Async.drainQueues [as _onImmediate] (/app/code/server/node_modules/bluebird/js/release/async.js:15:14)\n    at processImmediate (internal/timers.js:456:21)"
  }
}

warn[16-10-2020 10:43:20] Cannot authenticate.

{
  "err": {
    "statusCode": 401,
    "status": 401,
    "code": 401,
    "message": "Invalid token: access token has expired",
    "name": "invalid_token",
    "stack": "invalid_token: Invalid token: access token has expired\n    at new InvalidTokenError (/app/code/server/node_modules/oauth2-server/lib/errors/invalid-token-error.js:25:14)\n    at AuthenticateHandler.validateAccessToken (/app/code/server/node_modules/oauth2-server/lib/handlers/authenticate-handler.js:227:11)\n    at AuthenticateHandler.<anonymous> (/app/code/server/node_modules/oauth2-server/lib/handlers/authenticate-handler.js:77:19)\n    at PassThroughHandlerContext.finallyHandler (/app/code/server/node_modules/bluebird/js/release/finally.js:57:23)\n    at PassThroughHandlerContext.tryCatcher (/app/code/server/node_modules/bluebird/js/release/util.js:16:23)\n    at Promise._settlePromiseFromHandler (/app/code/server/node_modules/bluebird/js/release/promise.js:547:31)\n    at Promise._settlePromise (/app/code/server/node_modules/bluebird/js/release/promise.js:604:18)\n    at Promise._settlePromise0 (/app/code/server/node_modules/bluebird/js/release/promise.js:649:10)\n    at Promise._settlePromises (/app/code/server/node_modules/bluebird/js/release/promise.js:729:18)\n    at _drainQueueStep (/app/code/server/node_modules/bluebird/js/release/async.js:93:12)\n    at _drainQueue (/app/code/server/node_modules/bluebird/js/release/async.js:86:9)\n    at Async._drainQueues (/app/code/server/node_modules/bluebird/js/release/async.js:102:5)\n    at Immediate.Async.drainQueues [as _onImmediate] (/app/code/server/node_modules/bluebird/js/release/async.js:15:14)\n    at processImmediate (internal/timers.js:456:21)"
  }
}

warn[16-10-2020 10:45:18] Warning in tracker.

{
  "err": {
    "stack": "Error: Unknown infoHash 00dfd0272f82ae6cdb0061f5af6fb395b06ba4fa requested by ip **.**.**.**\n    at Server.<anonymous> (/app/code/server/dist/server/controllers/tracker.js:54:20)\n    at Generator.next (<anonymous>)\n    at fulfilled (/app/code/server/node_modules/tslib/tslib.js:111:62)",
    "message": "Unknown infoHash 00dfd0272f82ae6cdb0061f5af6fb395b06ba4fa requested by ip **.**.**.**"
  }
}

[girish]

@imc67 That's fine Good news is I think this is a different transcoding issue and the read only filesystem thing is sorted out, it's atleast converting now. Does this happen for all videos ? I found https://github.com/Chocobozzz/PeerTube/issues/2990 which may be related?

[imc67]

@girish I give up on this piece of software, it's not worth all the waiting and debugging to get it to work.

On 27th of July I wrote:

Hi @girish , I discovered PeerTube since it was announced here and was very enthusiastic because it fits in our needs. However during the past 6 weeks I'm beginning to loose faith in this project.

The project has a very slow "beat", they write they have only 1 (paid) developer. We had to wait 5 weeks to get an essential bug (not able to config) solved. After your last update it looked fine and I started to setup everything but then discovered a "stupid" bug again: videos don't play on iPad (https://github.com/Chocobozzz/PeerTube/issues/2941)! The developer knows this for at least 3 weeks but there seems no investigation/progress. Most of our viewers use iPad so we can't start (again) ...
There is also a very annoying issue that themes are alternating switching during browsing, so 1 click you're in dark mode and the next one in light mode (https://github.com/Chocobozzz/PeerTube/issues/3007). Beside that there are 350 other open issues ...

We're now 3 months later, you did an awful lot of work but it's still not working but it's not your fault!

It's not your mentioned issue 2990 because the video simply doesn't play, no matter how long you wait.

I will uninstall the app and wait for a better alternative ........

[girish]

No problem, I understand . We are probably very early adopters of PeerTube at this point.

[robi]

Would dtube be a viable replacement?

https://github.com/dtube
looks much more actively developed

[girish]

@imc67 said in Transcode after import fails:

@girish I give up on this piece of software, it's not worth all the waiting and debugging to get it to work.

On a positive note, Debian put in some money to help improve now Peertube - https://bits.debian.org/2020/10/debian-donation-peertube.html

[imc67]

@girish I really need to use "something" like PeerTube soon and I couldn't believe why it still doesn't work with HLS!

I did some testing and research:

1. On the Cloudron demo I installed PeerTube (also there I had this issue https://forum.cloudron.io/topic/3642/new-installation-not-able-to-log-in but solved it, I really think you should give it at least 1GB App memory and 1GB Redis memory to start)
2. I only switched on 2 kind of transcoding options and HLS (no WebTorrents)
3. Uploaded a mp4
4. waited for transcoding
5. Video did not play ....

So same issue with our own PeerTube instance on our own Cloudron.

Searching through their Git I discovered solved issues that might be related to Cloudron?

1.

https://github.com/Chocobozzz/PeerTube/issues/3181

The PeerTube developer asks here "Do you have a reverse proxy in front of docker? Because it's seems the server does not respect the byte range request", that was the case and they solved it.

Could it be a similar issue on Cloudron?

2.
Another issue on the Cloudron version: ffmpeg is not the right version!

Current:

ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers
built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
configuration: --prefix=/usr --extra-version=0ubuntu0.2 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librubberband --enable-librsvg --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-omx --enable-openal --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libopencv --enable-libx264 --enable-shared
libavutil      55. 78.100 / 55. 78.100
libavcodec     57.107.100 / 57.107.100
libavformat    57. 83.100 / 57. 83.100
libavdevice    57. 10.100 / 57. 10.100
libavfilter     6.107.100 /  6.107.100
libavresample   3.  7.  0 /  3.  7.  0
libswscale      4.  8.100 /  4.  8.100
libswresample   2.  9.100 /  2.  9.100
libpostproc    54.  7.100 / 54.  7.100

Needed: You need ffmpeg >= 4.1 if you enable HLS (https://github.com/Chocobozzz/PeerTube/issues/2469#issuecomment-584563107)

[girish]

@imc67 Thanks for the detailed investigation! I have pushed a new package with ffmpeg 4.3

[imc67]

@girish thank you very much for your quick response and update! However .....

... it still doesn't work (although now it does show the start of the video!). For the last hour I've checked all of their Git and got inspired to look into my browser consoles (Safari on MacOS and Firefox on MacOS) and discovered in both a similar error that might be Cloudron related (but of course I'm not sure):

Safari:

Firefox:

It looks like Peertube in the local browser needs a kind of connection to the server but it's forbidden:

GET wss://videos.[domainname].[tld]/tracker/socket | [HTTP/1.1 403 Forbidden 64ms]

[girish]

@imc67 Can you try to see if the instances at https://joinpeertube.org/instances#instances-list work? Will help me understand if this is a packaging issue or an upstream issue.

I am not an expert on HLS. Can you tell me how I can test this? Does it require a specific kind of video or does it fail with any video ?

[imc67]

@girish I've found just at random a video and it plays well, I'm pretty sure it's playing in HLS, see screenshot:

https://tube.tardis.world/videos/watch/a56df39d-05d8-4a51-9393-b549ffd7167c

Screenshot of Network usage in browser (Firefox):
here you can see it's playing the 1080.m3u8 file (HLS), as far as I understand HLS this file "contains indexes" of the mp4 so it only retrieves from the browser at the right timing the right "slice" from the mp4 to play locally without retrieving first all the GB's of the mp4.

@girish "Does it require a specific kind of video or does it fail with any video ?" In Peertube settings you can choose for (only) HLS and Peertube makes these special files.

This is how it looks like for 1 video:

Configuration in Peertube:

[girish]

@imc67 thanks, I will have some time tomorrow to investigate this.