Linkding - local archiving missing?

[necrevistonnezr]

@girish said in Linkding - Package Updates:

[1.8.0]

• Update Linkding to 1.27.0
• Full changelog
• Archive snapshots of websites locally by @sissbruecker in #672

I don’t believe this feature is implemented or I can’t see it. When I logged in I saw a warning that another docker image („latest-plus“) is required for archiving as described here: https://github.com/sissbruecker/linkding/?tab=readme-ov-file#using-docker

[girish]

This should be fixed now

[necrevistonnezr]

Is anyone able to create local archive of bookmarked websites as local html with the current package?

[girish]

@necrevistonnezr indeed, this requires chromium to be integrated in the package. @vladimir-d is looking into fixing the package.

[necrevistonnezr]

Thanks!!

[necrevistonnezr]

@girish said in Linkding - Package Updates:

[1.10.0]

• Update Linkding to 1.29.0

This update does not include the local archiving, correct?

[girish]

@necrevistonnezr yes, that one is being worked on separately.

[nebulon]

Should be fixed with latest package now.

[necrevistonnezr]

Thanks…!

[necrevistonnezr]

I don’t believe this is working, yet.
I don’t see anything in settings to enable it (though I haven’t found any meaningful documentation on their GitHub page regarding this feature…). Neither do I see html files being created in the assets folder (in case this should work automatically)

[girish]

@necrevistonnezr maybe this is updated related, let me check. In a fresh instance, you get a HTML Snapshot option.

Then, you can view the local archives:

You probably know this but the 'Internet Archive' feature is about sending the URL to archive.org, I think and not a local archive.

[girish]

@necrevistonnezr ah ok, so you have to put export LD_ENABLE_SNAPSHOTS=True in /app/data/env.sh and restart the app. Was missing in the upgrade changelog.

[necrevistonnezr]

Thanks, working now!

[necrevistonnezr]

@girish
Ok, since the last update (17 June 2024)....

... the HTML snapshot feature does not work anymore:

Also the "Image Preview" feature does not do anything.

The logs show this when I (unsuccessfully) trigger a manual snapshot for a bookmark:

Jul 11 09:51:37 [pid: 16|app: 0|req: 557/1098] [Server IP] () {60 vars in 1277 bytes} [Thu Jul 11 07:51:37 2024] GET /api/bookmarks/check/?url=https%3A%2F%2Fmy.mydomain.com%2F%23%2Fapp%2Fd962942c-41f4-4531-9624-feef2a681512%2Finfo => generated 206 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 287 bytes (1 switches on core 1)
Jul 11 09:51:39 [pid: 16|app: 0|req: 558/1099] 82.140.58.126 () {48 vars in 788 bytes} [Thu Jul 11 07:51:39 2024] GET /bookmarks => generated 0 bytes in 1 msecs (HTTP/1.1 302) 9 headers in 295 bytes (1 switches on core 0)
Jul 11 09:51:39 [pid: 14|app: 0|req: 483/1100] 82.140.58.126 () {48 vars in 811 bytes} [Thu Jul 11 07:51:39 2024] GET /login?next=/bookmarks => generated 0 bytes in 2 msecs (HTTP/1.1 301) 6 headers in 227 bytes (1 switches on core 1)
Jul 11 09:51:39 [pid: 16|app: 0|req: 559/1101] 82.140.58.126 () {48 vars in 813 bytes} [Thu Jul 11 07:51:39 2024] GET /login/?next=/bookmarks => generated 5618 bytes in 20 msecs (HTTP/1.1 200) 11 headers in 509 bytes (1 switches on core 1)
Jul 11 09:51:39 [pid: 14|app: 0|req: 483/1102] [Server IP] () {60 vars in 1191 bytes} [Thu Jul 11 07:51:39 2024] GET /api/bookmarks/check/?url=https%3A%2F%2Flinks.mydomain.com%2Fbookmarks => generated 171 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 287 bytes (1 switches on core 0)
Jul 11 09:51:40 [pid: 16|app: 0|req: 560/1103] 172.18.0.1 () {30 vars in 375 bytes} [Thu Jul 11 07:51:40 2024] GET / => generated 0 bytes in 1 msecs (HTTP/1.1 302) 9 headers in 283 bytes (1 switches on core 0)
Jul 11 09:51:41 [pid: 16|app: 0|req: 561/1104] [Server IP] () {72 vars in 1378 bytes} [Thu Jul 11 07:51:41 2024] POST /bookmarks/794/details => generated 0 bytes in 44 msecs (HTTP/1.1 302) 9 headers in 295 bytes (1 switches on core 0)
Jul 11 09:51:41 [pid: 14|app: 0|req: 484/1105] [Server IP] () {66 vars in 1263 bytes} [Thu Jul 11 07:51:41 2024] GET /bookmarks/partials/tag-cloud/active => generated 7240 bytes in 24 msecs (HTTP/1.1 200) 8 headers in 261 bytes (1 switches on core 1)
Jul 11 09:51:41 [pid: 16|app: 0|req: 563/1106] [Server IP] () {66 vars in 1246 bytes} [Thu Jul 11 07:51:41 2024] GET /bookmarks/794/details_modal => generated 8461 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 397 bytes (1 switches on core 0)
Jul 11 09:51:41 [pid: 16|app: 0|req: 563/1107] [Server IP] () {66 vars in 1271 bytes} [Thu Jul 11 07:51:41 2024] GET /bookmarks/partials/bookmark-list/active => generated 88930 bytes in 51 msecs (HTTP/1.1 200) 8 headers in 262 bytes (1 switches on core 1)
Jul 11 09:51:44 [pid: 16|app: 0|req: 564/1108] [Server IP] () {60 vars in 1300 bytes} [Thu Jul 11 07:51:44 2024] GET /api/bookmarks/check/?url=https%3A%2F%2Fmy.mydomain.com%2Ffrontend%2Flogs.html%3FappId%3Dd962942c-41f4-4531-9624-feef2a681512 => generated 190 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 287 bytes (1 switches on core 0)
Jul 11 09:51:47 [pid: 16|app: 0|req: 565/1109] [Server IP] () {66 vars in 1248 bytes} [Thu Jul 11 07:51:47 2024] GET /bookmarks/794/details_assets => generated 2841 bytes in 46 msecs (HTTP/1.1 200) 8 headers in 261 bytes (1 switches on core 1)
Jul 11 09:51:50 [pid: 14|app: 0|req: 485/1110] 172.18.0.1 () {30 vars in 375 bytes} [Thu Jul 11 07:51:50 2024] GET / => generated 0 bytes in 4 msecs (HTTP/1.1 302) 9 headers in 283 bytes (1 switches on core 0)
Jul 11 09:51:53 [pid: 14|app: 0|req: 486/1111] [Server IP] () {66 vars in 1249 bytes} [Thu Jul 11 07:51:53 2024] GET /bookmarks/794/details_assets => generated 2841 bytes in 15 msecs (HTTP/1.1 200) 8 headers in 261 bytes (1 switches on core 1)
Jul 11 09:51:59 [pid: 16|app: 0|req: 566/1112] [Server IP] () {66 vars in 1249 bytes} [Thu Jul 11 07:51:59 2024] GET /bookmarks/794/details_assets => generated 2841 bytes in 28 msecs (HTTP/1.1 200) 8 headers in 261 bytes (1 switches on core 0)
Jul 11 09:52:00 [pid: 16|app: 0|req: 567/1113] 172.18.0.1 () {30 vars in 375 bytes} [Thu Jul 11 07:52:00 2024] GET / => generated 0 bytes in 1 msecs (HTTP/1.1 302) 9 headers in 283 bytes (1 switches on core 1)
Jul 11 09:52:05 [pid: 16|app: 0|req: 568/1114] [Server IP] () {66 vars in 1249 bytes} [Thu Jul 11 07:52:05 2024] GET /bookmarks/794/details_assets => generated 2841 bytes in 31 msecs (HTTP/1.1 200) 8 headers in 261 bytes (1 switches on core 0)
Jul 11 09:52:10 [pid: 14|app: 0|req: 487/1115] 172.18.0.1 () {30 vars in 375 bytes} [Thu Jul 11 07:52:10 2024] GET / => generated 0 bytes in 1 msecs (HTTP/1.1 302) 9 headers in 283 bytes (1 switches on core 0)
Jul 11 09:52:11 [pid: 16|app: 0|req: 569/1116] [Server IP] () {66 vars in 1248 bytes} [Thu Jul 11 07:52:11 2024] GET /bookmarks/794/details_assets => generated 2841 bytes in 26 msecs (HTTP/1.1 200) 8 headers in 261 bytes (1 switches on core 1)
Jul 11 09:52:11 [pid: 16|app: 0|req: 570/1117] [Server IP] () {60 vars in 1191 bytes} [Thu Jul 11 07:52:11 2024] GET /api/bookmarks/check/?url=https%3A%2F%2Flinks.mydomain.com%2Fbookmarks => generated 171 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 287 bytes (1 switches on core 0)
Jul 11 09:52:13 2024-07-11 07:52:13,871 INFO reaped unknown pid 87 (exit status 0)
Jul 11 09:52:13 2024-07-11 07:52:13,871 INFO reaped unknown pid 88 (exit status 0)
Jul 11 09:52:16 [pid: 16|app: 0|req: 571/1118] [Server IP] () {66 vars in 1290 bytes} [Thu Jul 11 07:52:16 2024] GET /bookmarks/794/details_modal?return_url=/bookmarks => generated 8410 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 397 bytes (1 switches on core 1)
Jul 11 09:52:19 [pid: 16|app: 0|req: 572/1119] [Server IP] () {60 vars in 1301 bytes} [Thu Jul 11 07:52:19 2024] GET /api/bookmarks/check/?url=https%3A%2F%2Fmy.mydomain.com%2Ffrontend%2Flogs.html%3FappId%3Dd962942c-41f4-4531-9624-feef2a681512 => generated 190 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 287 bytes (1 switches on core 0)
Jul 11 09:52:20 [pid: 16|app: 0|req: 573/1120] 172.18.0.1 () {30 vars in 375 bytes} [Thu Jul 11 07:52:20 2024] GET / => generated 0 bytes in 1 msecs (HTTP/1.1 302) 9 headers in 283 bytes (1 switches on core 1)

Is it possible that the build was not switched to 'latest-plus' that includes chromium - as described here: https://github.com/sissbruecker/linkding#using-docker ?

[girish]

@necrevistonnezr thanks for reporting, added to our internal list to investigate

[girish]

This should be fixed now

[necrevistonnezr]

Yes, looks good!

[thoresson]

I just installed Linkding for the first time, and I'm running into the same problems: No local HTML archives are created and no preview images are generated.

[necrevistonnezr]

Not directly connected, but those HTML/PDF „snapshot“ features in Linkding (or Linkwarden) have become more or less useless due to cookie banners and/or paywalls.
On most archived pages, I only see a cookie banner as many websites don’t even show the full content before your cookie decision.
And I can’t create a snapshot of newspaper articles even if I have a subscription as the archiving does not happen in your current (logged in) browser window but separately.

[Teiluj]

Which method are you using? Server based or SinglePage extension?

[necrevistonnezr]

Thanks for the link! The Singlefile extension method seems to work as it’s actually saving the current page in the browser