Trying to import a whole YT channel via CLI

jordanurbs

Two ways I am trying to do this. The cloudron documentation way gives me this error in the CLI:

bash: q2: Read-only file system

The way as outlined by PeerTube documentation:

$ node {dist/server/tools/peertube-import-videos.js \
    -u 'PEERTUBE_URL' \
    -U 'PEERTUBE_USER' \
    --password 'PEERTUBE_PASSWORD' \
    --target-url 'TARGET_URL'

where TARGET_URL is the video, channel, playlist or users.

The error I receive in Cloudron peertube CLI:

internal/modules/cjs/loader.js:983
  throw err;
  ^

Error: Cannot find module '/app/code/server/tools/peertube-import-videos.js'
    at Function.Module._resolveFilename (internal/modules/cjs/loader.js:980:15)
    at Function.Module._load (internal/modules/cjs/loader.js:862:27)
    at Function.executeUserEntryPoint [as runMain] (internal/modules/run_main.js:74:12)
    at internal/main/run_main_module.js:18:47 {
  code: 'MODULE_NOT_FOUND',
  requireStack: []
}

I am assuming /app/code/server/  is the Cloudron equivalent to dist/server/ ... Any ideas?

robi

@jordanurbs where does the internal/ dir live?

try to run the command from it's parent dir.

jordanurbs

@robi I'm afraid I don't understand. The cloudron app CLI puts me into /app/code/server by default so I am assuming that is where the app lives.

jordanurbs

Solved it, this is where the js file lives

node dist/scripts/create-import-video-file-job.js

It doesn't seem to use "-u" though so there may be updated documentation I have not stumbled upon yet

robi

@jordanurbs is this new in the latest release vs the older release?

jordanurbs

@robi I am using the latest release however this is functionality that has been around since at least the previous version..

robi

@jordanurbs odd that there are two different scripts for it.

girish

@jordanurbs Ah thanks, I will fix the docs accordingly.

jordanurbs

@girish thanks.. is the 'peertube' cli command only for the cloudron CLI or is that what I would also use in the app's own terminal on the cloudron interface? Aside from the missing script file, I should be able to run commands in the app terminal using the same commands as the peertube documentation, right?

girish

@jordanurbs Cloudron CLI terminal (via exec) and app's terminal on the web ui are one and the same. You should be able to run commands as per the peertube docs.

rmdes

With the latest version, it seems there is now an 'official' YT plugin to import entire channels from the UI but the plugin crash at install because node is trying to install inside the app/code/server read-only file system.

Do you think this is something that could be fixed in the cloudron package ?

girish

@rmdes Where is this plugin ? https://github.com/Chocobozzz/PeerTube/projects/8#card-74498056 says it is still not implemented.

rmdes

@girish on the Administration plugin/theme view

Using default Peertube cloudron package.

imc67

@rmdes @girish install still fails

girish

Just testing this out now.. Classic warning:

girish

I have pushed a fix, the plugin installs now. But I don't know if the plugin itself works, please test. The plugin hasn't been updated in a while, so YMMV.

imc67

@girish tried the plugin but alas it doesn't work, maybe it's too old and/or doesn't work with LDAP and/or I'm doing something wrong....

I guess we have to wait for native support as you wrote earlier.

Tried with LDAP user:

May 12 21:27:53 [videos.domain.tv:443] 2022-05-12 19:27:53.656 info: Login success with auth method ldap of plugin peertube-plugin-auth-ldap for ***admin user ldap***.
May 12 21:27:53 [videos.domain.tv:443] 2022-05-12 19:27:53.659 info: Bypassing oauth login by plugin peertube-plugin-auth-ldap.
May 12 21:27:53 [videos.domain.tv:443] 2022-05-12 19:27:53.671 warn: Login error {
May 12 21:27:53 "err": {
May 12 21:27:53 "statusCode": 400,
May 12 21:27:53 "status": 400,
May 12 21:27:53 "code": 400,
May 12 21:27:53 "message": "Invalid grant: user credentials are invalid",
May 12 21:27:53 "name": "invalid_grant",
May 12 21:27:53 "stack": "invalid_grant: Invalid grant: user credentials are invalid\n at new InvalidGrantError (/app/code/server/node_modules/oauth2-server/lib/errors/invalid-grant-error.js:27:14)\n at /app/code/server/dist/server/lib/auth/oauth.js:77:19\n at Generator.next (<anonymous>)\n at fulfilled (/app/code/server/node_modules/tslib/tslib.js:114:62)\n at runMicrotasks (<anonymous>)\n at processTicksAndRejections (node:internal/process/task_queues:96:5)"
May 12 21:27:53 }
May 12 21:27:53 }

Tried with local admin:

May 12 21:28:42 [videos.domain.tv:443 peertube-plugin-auto-import-ytb] 2022-05-12 19:28:42.639 warn: Error during the credential validation : Error: Cannot get access Token : Bad Request
May 12 21:29:14 [videos.domain.tv:443] 2022-05-12 19:29:14.003 info: 172.18.16.14 - - [12/May/2022:19:29:14 +0000] "GET /api/v1/oauth-clients/local HTTP/1.1" 200 99 "-" "node-fetch/1.0 (+https://github.com/bitinn/node-fetch)"
May 12 21:29:14 [videos.domain.tv:443] 2022-05-12 19:29:14.015 info: 62.238.0.0 - - [12/May/2022:19:29:14 +0000] "PUT /api/v1/plugins/peertube-plugin-auto-import-ytb/settings HTTP/1.1" 204 - "https://videos.domain.tv/admin/plugins/show/peertube-plugin-auto-import-ytb" "Firefox"
May 12 21:29:14 [videos.domain.tv:443 peertube-plugin-auth-ldap] 2022-05-12 19:29:14.119 warn: Cannot login ***local admin*** in LDAP plugin. {
May 12 21:29:14 "err": "no such user: \"***local admin***\""
May 12 21:29:14 }

girish

@imc67 thought as much PeerTube has seen a lot of changes since the plugin was last published.

rmdes

@girish

I can't get it to install but something totally weird is happening on my instance, since last month, since I the last time I came here, my instance is auto uploading the target channel I initially managed to configure but it does not make sense because the plugin is not installed...??.?

log file : https://paste.armada.digital/cageyixumu.md

I don't have any LDAP errors, I'm wondering if this is even related?

rmdes

I restarted the app, tried to install again, it works !

rmdes

Trying to understand what's the purpose of the admin/pass login for this feature, anyone knows ?

doodlemania2

@rmdes That seems suspect - if this is a test instance, feed in your peertube admin u/p to see if that's what it is looking for.
I'd be cautious of giving a plugin prod creds like that.

girish

Might be best to investigate the code at https://zeteo.me/gitea/Outils-PeerTube/peertube-plugin-auto-import-ytb . I think maybe because it's the only way to call peertube's api (with username/password).

jdaviescoates

So, @jordanurbs @rmdes have either of you now successfully imported a YouTube channel into a Cloudron instance of PeerTube (either using CLI or a plugin)? If so, how did you do it? thanks!

rmdes

@jdaviescoates Yes the plugin works just fine for me !
you can see it at work here : ukrainewararchive.eu/

Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.

Trying to import a whole YT channel via CLI