Posts made by scooke

@1Psychedelic No really, but that was a good explanation. @fbartels suggested you are on a home server... are you? Is each VPS really a VM on a computer? I myself run different VMs on my laptop and run into the issue of conflicting ports - I have to shut down one VM, running Wordpress, so that the other VM running something else can work. Sometimes on my VPS running LAMP I have to stop Apache so that certbot can run (it wants to use port 80 which is what Apache uses).

In the end, Cloudron has to be the only thing running.

Here is another link about using it on a homeserver, which it sounds like you are: https://blog.cloudron.io/installing-cloudron-on-a-home-server/

@1Psychedelic You know, I think I sort of understand your question... but then nothing about it makes sense!

Check out https://docs.cloudron.io/domains/#wildcard-dns which gets more into details about how to connect domains to your Cloudron using A records and IP numbers. Basically, you need to point the domains you want to be used by Cloudrdon to the VPS by making A records in the domain registrar using the IP number of the VPS.

If none of what I said makes sense, I suggest reading the documentation over alot. This stuff gets clearer. I've found that when I ask technical questions without using (or knowing) the correct technical terms in a forum like this (but not this one... this one is awesome), it's difficult for others to know what I'm getting at. So, I google the phrase I have in mind ("point my domain to my VPS, how?") and read most of the first page of results. It will either click, and you'll get it, or you'll be better prepared to ask the question you need an answer to. Good luck!

@girish I'm happy to report that once upgraded to v1.5.4 that the PDF upload and processing completes without any problems. Whatever you did worked! Thank you!

@girish Do I need to be upgraded to v1.5.2 to see it? Or do I need to have auto-updates turned on. I've turned them off and am checking manually as I'd rather have an older version that works than a newer one that doesn't.

@girish I"m not seeing v.1.5.4... is there a way to force it?

Thank you for troubleshooting this with me. Weird that I'm the only one!

@girish said in Latest update seems to have similar issue as before, resources not found:

/usr/local/share/nltk_data/corpora/stopwords

Yep

root@mypaperlessimagelongnumbernamethingy:/usr/local/share/nltk_data/corpora/stopwords# ls -al
total 160
drwxr-xr-x 2 root root  4096 Jan 26 09:05 .
drwxr-xr-x 3 root root  4096 Jan 26 09:05 ..
-rw-r--r-- 1 root root   909 Jan 26 09:05 README
-rw-r--r-- 1 root root  6348 Jan 26 09:05 arabic
-rw-r--r-- 1 root root   967 Jan 26 09:05 azerbaijani
-rw-r--r-- 1 root root  2202 Jan 26 09:05 basque
-rw-r--r-- 1 root root  5443 Jan 26 09:05 bengali
-rw-r--r-- 1 root root  1558 Jan 26 09:05 catalan
-rw-r--r-- 1 root root  5560 Jan 26 09:05 chinese
-rw-r--r-- 1 root root   424 Jan 26 09:05 danish
-rw-r--r-- 1 root root   453 Jan 26 09:05 dutch
-rw-r--r-- 1 root root   936 Jan 26 09:05 english
-rw-r--r-- 1 root root  1579 Jan 26 09:05 finnish
-rw-r--r-- 1 root root   813 Jan 26 09:05 french
-rw-r--r-- 1 root root  1362 Jan 26 09:05 german
-rw-r--r-- 1 root root  2167 Jan 26 09:05 greek
-rw-r--r-- 1 root root  1836 Jan 26 09:05 hebrew
-rw-r--r-- 1 root root  5958 Jan 26 09:05 hinglish
-rw-r--r-- 1 root root  1227 Jan 26 09:05 hungarian
-rw-r--r-- 1 root root  6446 Jan 26 09:05 indonesian
-rw-r--r-- 1 root root  1654 Jan 26 09:05 italian
-rw-r--r-- 1 root root  3880 Jan 26 09:05 kazakh
-rw-r--r-- 1 root root  3610 Jan 26 09:05 nepali
-rw-r--r-- 1 root root   851 Jan 26 09:05 norwegian
-rw-r--r-- 1 root root  1286 Jan 26 09:05 portuguese
-rw-r--r-- 1 root root  1910 Jan 26 09:05 romanian
-rw-r--r-- 1 root root  1235 Jan 26 09:05 russian
-rw-r--r-- 1 root root 15980 Jan 26 09:05 slovene
-rw-r--r-- 1 root root  2176 Jan 26 09:05 spanish
-rw-r--r-- 1 root root   559 Jan 26 09:05 swedish
-rw-r--r-- 1 root root  1818 Jan 26 09:05 tajik
-rw-r--r-- 1 root root   260 Jan 26 09:05 turkish

@girish Although there is definitely a stopwords.zip in the corpora/stopwords directory, there is also a stopwords folder (unzipped, I suppose). That is one thing to correct then.

I found this link: https://aur.archlinux.org/packages/paperless-ngx. Six comments from the bottom ammo wrote that executing ln -s /usr/share/nltk_data /usr/local/share/nltk_data fixed it for him. I tried it but, of course, these are read-only directories. So maybe this is a second thing to fix?

@scooke I've updated to v1.5.2, and neither with or without that conf setting does it work. Still saying it can't find corpora/stopwords, even though it's there.

Logs:

Jan 31 22:31:41 [2023-01-31 21:31:41,532] [INFO] [celery.worker.strategy] Task documents.tasks.consume_file[3e572bd2-9ccc-4ee4-9201-fb350b47cfd9] received
Jan 31 22:31:41 [2023-01-31 21:31:41,652] [INFO] [paperless.consumer] Consuming Doc - May 25, 2014, 11-08 AM.pdf
Jan 31 22:31:44 [2023-01-31 21:31:44,150] [INFO] [ocrmypdf._pipeline] page is facing ⇧, confidence 4.01 - no change
Jan 31 22:31:53 [2023-01-31 21:31:53,935] [INFO] [ocrmypdf._sync] Postprocessing...
Jan 31 22:31:54 [2023-01-31 21:31:54,867] [INFO] [ocrmypdf._pipeline] Optimize ratio: 1.40 savings: 28.3%
Jan 31 22:31:54 [2023-01-31 21:31:54,872] [INFO] [ocrmypdf._sync] Output file is a PDF/A-2B (as expected)
Jan 31 22:31:57 1263:M 31 Jan 2023 21:31:57.078 * 10 changes in 300 seconds. Saving...
Jan 31 22:31:57 1263:M 31 Jan 2023 21:31:57.079 * Background saving started by pid 1303
Jan 31 22:31:57 1303:C 31 Jan 2023 21:31:57.083 * DB saved on disk
Jan 31 22:31:57 1303:C 31 Jan 2023 21:31:57.084 * RDB: 0 MB of memory used by copy-on-write
Jan 31 22:31:57 1263:M 31 Jan 2023 21:31:57.180 * Background saving terminated with success
Jan 31 22:32:00 [2023-01-31 21:32:00,895] [ERROR] [paperless.consumer] The following error occurred while consuming Doc - May 25, 2014, 11-08 AM.pdf:
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00 Resource stopwords not found.
Jan 31 22:32:00 Please use the NLTK Downloader to obtain the resource:
Jan 31 22:32:00
Jan 31 22:32:00 >>> import nltk
Jan 31 22:32:00 >>> nltk.download('stopwords')
Jan 31 22:32:00
Jan 31 22:32:00 For more information see: https://www.nltk.org/data.html
Jan 31 22:32:00
Jan 31 22:32:00 Attempted to load corpora/stopwords
Jan 31 22:32:00
Jan 31 22:32:00 Searched in:
Jan 31 22:32:00 - '/usr/local/share/ntlk_data'
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00 Traceback (most recent call last):
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 84, in __load
Jan 31 22:32:00 root = nltk.data.find(f"{self.subdir}/{zip_name}")
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/data.py", line 583, in find
Jan 31 22:32:00 raise LookupError(resource_not_found)
Jan 31 22:32:00 LookupError:
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00 Resource stopwords not found.
Jan 31 22:32:00 Please use the NLTK Downloader to obtain the resource:
Jan 31 22:32:00
Jan 31 22:32:00 >>> import nltk
Jan 31 22:32:00 >>> nltk.download('stopwords')
Jan 31 22:32:00
Jan 31 22:32:00 For more information see: https://www.nltk.org/data.html
Jan 31 22:32:00
Jan 31 22:32:00 Attempted to load corpora/stopwords.zip/stopwords/
Jan 31 22:32:00
Jan 31 22:32:00 Searched in:
Jan 31 22:32:00 - '/usr/local/share/ntlk_data'
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00
Jan 31 22:32:00
Jan 31 22:32:00 During handling of the above exception, another exception occurred:
Jan 31 22:32:00
Jan 31 22:32:00 Traceback (most recent call last):
Jan 31 22:32:00 File "/app/code/src/documents/consumer.py", line 410, in try_consume_file
Jan 31 22:32:00 document_consumption_finished.send(
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/django/dispatch/dispatcher.py", line 176, in send
Jan 31 22:32:00 return [
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/django/dispatch/dispatcher.py", line 177, in <listcomp>
Jan 31 22:32:00 (receiver, receiver(signal=self, sender=sender, **named))
Jan 31 22:32:00 File "/app/code/src/documents/signals/handlers.py", line 194, in set_tags
Jan 31 22:32:00 matched_tags = matching.match_tags(document, classifier)
Jan 31 22:32:00 File "/app/code/src/documents/matching.py", line 50, in match_tags
Jan 31 22:32:00 predicted_tag_ids = classifier.predict_tags(document.content)
Jan 31 22:32:00 File "/app/code/src/documents/classifier.py", line 370, in predict_tags
Jan 31 22:32:00 X = self.data_vectorizer.transform([self.preprocess_content(content)])
Jan 31 22:32:00 File "/app/code/src/documents/classifier.py", line 331, in preprocess_content
Jan 31 22:32:00 self._stop_words = set(stopwords.words(settings.NLTK_LANGUAGE))
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 121, in __getattr__
Jan 31 22:32:00 self.__load()
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 86, in __load
Jan 31 22:32:00 raise e
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 81, in __load
Jan 31 22:32:00 root = nltk.data.find(f"{self.subdir}/{self.__name}")
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/data.py", line 583, in find
Jan 31 22:32:00 raise LookupError(resource_not_found)
Jan 31 22:32:00 LookupError:
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00 Resource stopwords not found.
Jan 31 22:32:00 Please use the NLTK Downloader to obtain the resource:
Jan 31 22:32:00
Jan 31 22:32:00 >>> import nltk
Jan 31 22:32:00 >>> nltk.download('stopwords')
Jan 31 22:32:00
Jan 31 22:32:00 For more information see: https://www.nltk.org/data.html
Jan 31 22:32:00
Jan 31 22:32:00 Attempted to load corpora/stopwords
Jan 31 22:32:00
Jan 31 22:32:00 Searched in:
Jan 31 22:32:00 - '/usr/local/share/ntlk_data'
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00
Jan 31 22:32:00 [2023-01-31 21:32:00,915] [ERROR] [celery.app.trace] Task documents.tasks.consume_file[3e572bd2-9ccc-4ee4-9201-fb350b47cfd9] raised unexpected: ConsumerError("Doc - May 25, 2014, 11-08 AM.pdf: The following error occurred while consuming Doc - May 25, 2014, 11-08 AM.pdf: \n**********************************************************************\n Resource \x1b[93mstopwords\x1b[0m not found.\n Please use the NLTK Downloader to obtain the resource:\n\n \x1b[31m>>> import nltk\n >>> nltk.download('stopwords')\n \x1b[0m\n For more information see: https://www.nltk.org/data.html\n\n Attempted to load \x1b[93mcorpora/stopwords\x1b[0m\n\n Searched in:\n - '/usr/local/share/ntlk_data'\n**********************************************************************\n")
Jan 31 22:32:00 Traceback (most recent call last):
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 84, in __load
Jan 31 22:32:00 root = nltk.data.find(f"{self.subdir}/{zip_name}")
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/data.py", line 583, in find
Jan 31 22:32:00 raise LookupError(resource_not_found)
Jan 31 22:32:00 LookupError:
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00 Resource stopwords not found.
Jan 31 22:32:00 Please use the NLTK Downloader to obtain the resource:
Jan 31 22:32:00
Jan 31 22:32:00 >>> import nltk
Jan 31 22:32:00 >>> nltk.download('stopwords')
Jan 31 22:32:00
Jan 31 22:32:00 For more information see: https://www.nltk.org/data.html
Jan 31 22:32:00
Jan 31 22:32:00 Attempted to load corpora/stopwords.zip/stopwords/
Jan 31 22:32:00
Jan 31 22:32:00 Searched in:
Jan 31 22:32:00 - '/usr/local/share/ntlk_data'
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00
Jan 31 22:32:00
Jan 31 22:32:00 During handling of the above exception, another exception occurred:
Jan 31 22:32:00
Jan 31 22:32:00 Traceback (most recent call last):
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/asgiref/sync.py", line 302, in main_wrap
Jan 31 22:32:00 raise exc_info[1]
Jan 31 22:32:00 File "/app/code/src/documents/consumer.py", line 410, in try_consume_file
Jan 31 22:32:00 document_consumption_finished.send(
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/django/dispatch/dispatcher.py", line 176, in send
Jan 31 22:32:00 return [
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/django/dispatch/dispatcher.py", line 177, in <listcomp>
Jan 31 22:32:00 (receiver, receiver(signal=self, sender=sender, **named))
Jan 31 22:32:00 File "/app/code/src/documents/signals/handlers.py", line 194, in set_tags
Jan 31 22:32:00 matched_tags = matching.match_tags(document, classifier)
Jan 31 22:32:00 File "/app/code/src/documents/matching.py", line 50, in match_tags
Jan 31 22:32:00 predicted_tag_ids = classifier.predict_tags(document.content)
Jan 31 22:32:00 File "/app/code/src/documents/classifier.py", line 370, in predict_tags
Jan 31 22:32:00 X = self.data_vectorizer.transform([self.preprocess_content(content)])
Jan 31 22:32:00 File "/app/code/src/documents/classifier.py", line 331, in preprocess_content
Jan 31 22:32:00 self._stop_words = set(stopwords.words(settings.NLTK_LANGUAGE))
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 121, in __getattr__
Jan 31 22:32:00 self.__load()
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 86, in __load
Jan 31 22:32:00 raise e
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 81, in __load
Jan 31 22:32:00 root = nltk.data.find(f"{self.subdir}/{self.__name}")
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/nltk/data.py", line 583, in find
Jan 31 22:32:00 raise LookupError(resource_not_found)
Jan 31 22:32:00 LookupError:
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00 Resource stopwords not found.
Jan 31 22:32:00 Please use the NLTK Downloader to obtain the resource:
Jan 31 22:32:00
Jan 31 22:32:00 >>> import nltk
Jan 31 22:32:00 >>> nltk.download('stopwords')
Jan 31 22:32:00
Jan 31 22:32:00 For more information see: https://www.nltk.org/data.html
Jan 31 22:32:00
Jan 31 22:32:00 Attempted to load corpora/stopwords
Jan 31 22:32:00
Jan 31 22:32:00 Searched in:
Jan 31 22:32:00 - '/usr/local/share/ntlk_data'
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00
Jan 31 22:32:00
Jan 31 22:32:00 The above exception was the direct cause of the following exception:
Jan 31 22:32:00
Jan 31 22:32:00 Traceback (most recent call last):
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/celery/app/trace.py", line 451, in trace_task
Jan 31 22:32:00 R = retval = fun(*args, **kwargs)
Jan 31 22:32:00 File "/usr/local/lib/python3.10/dist-packages/celery/app/trace.py", line 734, in __protected_call__
Jan 31 22:32:00 return self.run(*args, **kwargs)
Jan 31 22:32:00 File "/app/code/src/documents/tasks.py", line 192, in consume_file
Jan 31 22:32:00 document = Consumer().try_consume_file(
Jan 31 22:32:00 File "/app/code/src/documents/consumer.py", line 468, in try_consume_file
Jan 31 22:32:00 self._fail(
Jan 31 22:32:00 File "/app/code/src/documents/consumer.py", line 93, in _fail
Jan 31 22:32:00 raise ConsumerError(f"{self.filename}: {log_message or message}") from exception
Jan 31 22:32:00 documents.consumer.ConsumerError: Doc - May 25, 2014, 11-08 AM.pdf: The following error occurred while consuming Doc - May 25, 2014, 11-08 AM.pdf:
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00 Resource stopwords not found.
Jan 31 22:32:00 Please use the NLTK Downloader to obtain the resource:
Jan 31 22:32:00
Jan 31 22:32:00 >>> import nltk
Jan 31 22:32:00 >>> nltk.download('stopwords')
Jan 31 22:32:00
Jan 31 22:32:00 For more information see: https://www.nltk.org/data.html
Jan 31 22:32:00
Jan 31 22:32:00 Attempted to load corpora/stopwords
Jan 31 22:32:00
Jan 31 22:32:00 Searched in:
Jan 31 22:32:00 - '/usr/local/share/ntlk_data'
Jan 31 22:32:00 **********************************************************************
Jan 31 22:32:00

@girish Weird. Adding that to the conf, while still on v1.5.1, causes it to fail again.

The contents of that directory are: corpora, stemmers, tokenizers

Despite the error, which reads thusly:

********************************************************************** Resource stopwords not found. Please use the NLTK Downloader to obtain the resource: >>> import nltk >>> nltk.download('stopwords')  For more information see: https://www.nltk.org/data.html Attempted to load corpora/stopwords Searched in: - '/usr/local/share/ntlk_data' **********************************************************************

there is /usr/local/share/ntlk_data/corpora/stopwords, which includes a stopwords.zip file.

I noticed that in the conf file, the env PAPERLESS_NLTK_DIR=/usr/local/share/ntlk_data has the NLTK highlighted in brown, which must mean that the syntax is off, right?

Finally, I also noticed at the bottom of the env file that the following are all commented out:

# Binaries

#PAPERLESS_CONVERT_BINARY=/usr/bin/convert
#PAPERLESS_GS_BINARY=/usr/bin/gs
#PAPERLESS_OPTIPNG_BINARY=/usr/bin/optipng

Commenting out the line you suggested I add (running v1.5.1) sees the app functioning properly.

I guess I will now try to update again, then add that line to the conf file and see what happens.

@scooke Ah, the app updated to v1.5.2 overnight. I have restored once again to v1.5.1 and it works fine now. I've turned off Auto-update for now.

@girish It had worked when I restored to v1.5.1, but just today the problem returned.

In the actual web apps Files dashboard, under the "Failed" tab, is this error:

Drop Everything and Read—but How_.pdf: The following error occurred while consuming Drop Everything and Read—but How_.pdf:

**********************************************************************
  Resource stopwords not found.
  Please use the NLTK Downloader to obtain the resource:

  >>> import nltk
  >>> nltk.download('stopwords')
  
  For more information see: https://www.nltk.org/data.html

  Attempted to load corpora/stopwords

  Searched in:
    - '/usr/share/nltk_data'
**********************************************************************

Here are logs from the Cloudron app dashboard:

Jan 31 19:27:48 Searched in:
Jan 31 19:27:48 - '/usr/share/nltk_data'
Jan 31 19:27:48 **********************************************************************
Jan 31 19:27:48
Jan 31 19:27:48 [2023-01-31 18:27:48,579] [ERROR] [celery.app.trace] Task documents.tasks.consume_file[fa64d1a1-7726-4390-ad33-1094d0600517] raised unexpected: ConsumerError("Englishlanguagelearners.pdf: The following error occurred while consuming Englishlanguagelearners.pdf: \n**********************************************************************\n Resource \x1b[93mstopwords\x1b[0m not found.\n Please use the NLTK Downloader to obtain the resource:\n\n \x1b[31m>>> import nltk\n >>> nltk.download('stopwords')\n \x1b[0m\n For more information see: https://www.nltk.org/data.html\n\n Attempted to load \x1b[93mcorpora/stopwords\x1b[0m\n\n Searched in:\n - '/usr/share/nltk_data'\n**********************************************************************\n")
Jan 31 19:27:48 Traceback (most recent call last):
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 84, in __load
Jan 31 19:27:48 root = nltk.data.find(f"{self.subdir}/{zip_name}")
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/nltk/data.py", line 583, in find
Jan 31 19:27:48 raise LookupError(resource_not_found)
Jan 31 19:27:48 LookupError:
Jan 31 19:27:48 **********************************************************************
Jan 31 19:27:48 Resource stopwords not found.
Jan 31 19:27:48 Please use the NLTK Downloader to obtain the resource:
Jan 31 19:27:48
Jan 31 19:27:48 >>> import nltk
Jan 31 19:27:48 >>> nltk.download('stopwords')
Jan 31 19:27:48
Jan 31 19:27:48 For more information see: https://www.nltk.org/data.html
Jan 31 19:27:48
Jan 31 19:27:48 Attempted to load corpora/stopwords.zip/stopwords/
Jan 31 19:27:48
Jan 31 19:27:48 Searched in:
Jan 31 19:27:48 - '/usr/share/nltk_data'
Jan 31 19:27:48 **********************************************************************
Jan 31 19:27:48
Jan 31 19:27:48
Jan 31 19:27:48 During handling of the above exception, another exception occurred:
Jan 31 19:27:48
Jan 31 19:27:48 Traceback (most recent call last):
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/asgiref/sync.py", line 302, in main_wrap
Jan 31 19:27:48 raise exc_info[1]
Jan 31 19:27:48 File "/app/code/src/documents/consumer.py", line 410, in try_consume_file
Jan 31 19:27:48 document_consumption_finished.send(
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/django/dispatch/dispatcher.py", line 176, in send
Jan 31 19:27:48 return [
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/django/dispatch/dispatcher.py", line 177, in <listcomp>
Jan 31 19:27:48 (receiver, receiver(signal=self, sender=sender, **named))
Jan 31 19:27:48 File "/app/code/src/documents/signals/handlers.py", line 194, in set_tags
Jan 31 19:27:48 matched_tags = matching.match_tags(document, classifier)
Jan 31 19:27:48 File "/app/code/src/documents/matching.py", line 50, in match_tags
Jan 31 19:27:48 predicted_tag_ids = classifier.predict_tags(document.content)
Jan 31 19:27:48 File "/app/code/src/documents/classifier.py", line 370, in predict_tags
Jan 31 19:27:48 X = self.data_vectorizer.transform([self.preprocess_content(content)])
Jan 31 19:27:48 File "/app/code/src/documents/classifier.py", line 331, in preprocess_content
Jan 31 19:27:48 self._stop_words = set(stopwords.words(settings.NLTK_LANGUAGE))
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 121, in __getattr__
Jan 31 19:27:48 self.__load()
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 86, in __load
Jan 31 19:27:48 raise e
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/nltk/corpus/util.py", line 81, in __load
Jan 31 19:27:48 root = nltk.data.find(f"{self.subdir}/{self.__name}")
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/nltk/data.py", line 583, in find
Jan 31 19:27:48 raise LookupError(resource_not_found)
Jan 31 19:27:48 LookupError:
Jan 31 19:27:48 **********************************************************************
Jan 31 19:27:48 Resource stopwords not found.
Jan 31 19:27:48 Please use the NLTK Downloader to obtain the resource:
Jan 31 19:27:48
Jan 31 19:27:48 >>> import nltk
Jan 31 19:27:48 >>> nltk.download('stopwords')
Jan 31 19:27:48
Jan 31 19:27:48 For more information see: https://www.nltk.org/data.html
Jan 31 19:27:48
Jan 31 19:27:48 Attempted to load corpora/stopwords
Jan 31 19:27:48
Jan 31 19:27:48 Searched in:
Jan 31 19:27:48 - '/usr/share/nltk_data'
Jan 31 19:27:48 **********************************************************************
Jan 31 19:27:48
Jan 31 19:27:48
Jan 31 19:27:48 The above exception was the direct cause of the following exception:
Jan 31 19:27:48
Jan 31 19:27:48 Traceback (most recent call last):
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/celery/app/trace.py", line 451, in trace_task
Jan 31 19:27:48 R = retval = fun(*args, **kwargs)
Jan 31 19:27:48 File "/usr/local/lib/python3.10/dist-packages/celery/app/trace.py", line 734, in __protected_call__
Jan 31 19:27:48 return self.run(*args, **kwargs)
Jan 31 19:27:48 File "/app/code/src/documents/tasks.py", line 192, in consume_file
Jan 31 19:27:48 document = Consumer().try_consume_file(
Jan 31 19:27:48 File "/app/code/src/documents/consumer.py", line 468, in try_consume_file
Jan 31 19:27:48 self._fail(
Jan 31 19:27:48 File "/app/code/src/documents/consumer.py", line 93, in _fail
Jan 31 19:27:48 raise ConsumerError(f"{self.filename}: {log_message or message}") from exception
Jan 31 19:27:48 documents.consumer.ConsumerError: Englishlanguagelearners.pdf: The following error occurred while consuming Englishlanguagelearners.pdf:
Jan 31 19:27:48 **********************************************************************
Jan 31 19:27:48 Resource stopwords not found.
Jan 31 19:27:48 Please use the NLTK Downloader to obtain the resource:
Jan 31 19:27:48
Jan 31 19:27:48 >>> import nltk
Jan 31 19:27:48 >>> nltk.download('stopwords')
Jan 31 19:27:48
Jan 31 19:27:48 For more information see: https://www.nltk.org/data.html
Jan 31 19:27:48
Jan 31 19:27:48 Attempted to load corpora/stopwords
Jan 31 19:27:48
Jan 31 19:27:48 Searched in:
Jan 31 19:27:48 - '/usr/share/nltk_data'
Jan 31 19:27:48 **********************************************************************

@girish
100px wide -

600px wide -

1800x wide -

It seems to depend on the image's actual size.
Photo by Spencer Everett - https://unsplash.com/photos/mIeze0zWyvA?utm_source=unsplash&utm_medium=referral&utm_content=creditShareLink

https://www.reddit.com/r/selfhosted/comments/10oz4pl/im_done_with_standard_notes_why_im_abandoning/

I appreciate the effort that someone put into packaging SN, but this thread from reddit really suggests we scrap it here.

@jdaviescoates Phew, my thoughts and prayers worked!

Another reason is to not give Google any more data. It is SOOOOO nice to use my own translation app! Plus, I use LanguageTool, too (on Yunohost)... all my data, all mine.

Package v.1.5.2 has a problem. Fortunately I had a working backup for v.1.5.1.

Please use the NLTK Downloader to obtain the resource:

  >>> import nltk
  >>> nltk.download('stopwords')

PDFs would upload but wouldn't get processed.

@girish the bucket name has its own box in which to enter. So no, i didn't add the bucket name as part of the url. But since everything else is backing up, how would this affect just the one app?

@girish All the other apps backed up. That's the strange thing... only Mastodon is not backed up.

I'll check up on the other thing.

@doodlemania2 FWIW, Yunohost has a working WriteFeely app which I use. Checking out their repository should help you work things out, yes?

@girish Is this /snapshot/, or /home/yellow/snapshot/? Thank you.

Yes, it is in /snapshot (in the Minio bucket). Is this good?

@nebulon Not that I could tell, other than there were no error messages in the logs when I tried importing via the app. I could see it was an image problem because of the cli progress.
Oh, and I had o boost both my Wallabag app AND its Redis to 5 or 6GB of ram each to manage 1200 articles. Anything less than 5GB didn't seem to work. Afterwards I've lowered both to under 1GB and it's all good.

@girish So I just copy and paste those lines into the appropriate files?

@girish No, actually, I was just looking, saw that this app is listed in my full cloudron backup, but isn't present in the actual Minio bucket. I downloaded the individual app's backup configuration which also says it was backed up to that bucket. When I then choose to download the backup (from the apps dashboard) it starts something, then fails, and actually a get a humungusly long url on a page that says This app is currently not responding. Please try refreshing the page in a few minutes..

What in the world? Why is this app NOT getting backed up, while all the records say it is?? It can't be the S3_ENABLED=true in the env file because when i check that bucket (same Minio server) there is only the data, not the app.

Where did the app go?? If I hadn't had a full disk backup at SSDNodes I would have lost this app, and who knows what else.

https://doc.wallabag.org/en/user/import/

At that site they advised using a cli to import, so I tweaked their suggestion like so: php bin/console wallabag:import myuser /app/data/uploads/import/All_articles.json --env=prod --importer=v2 which I ran in the Wallabag app terminal (seriously, what a genius idea to add that!), after I had uploaded the json file in the File Manager (and what another amazing idea!!). I had tried and tried from within the Wallabag app, but it would just die. No warnings, nothing in the logs. But doing it with the cli revealed that it was choking on an image format that it didn't like, but at least in the cli it finished the import.

@nebulon How do I get this update to be visible? My current version is 2.4.1, but the app store lists that version is 2.5.2, but that doesn't show up when I press Check for Updates.

NM. I found the notice from A YEAR AGO! https://forum.cloudron.io/post/23720

@jdaviescoates Care to share your config (the pertinent part)?

@jdaviescoates I wonder if the problem is the TYPE of bucket. In the comments above I was running a self-installed instance of Minio. That is, I didn't use Yunohost, or CapRover, or Cloudron, etc. I installed it by hand. Somehow (I guess I could figure it out by rereading the above) I set Minio up to use virtual-host, rather than path-style. And for whatever reason, Peertube (only) works with virtual-host style. Maybe this has something to do with it?

FWIW (I'm only getting my own head sort of around all this), the end_point in teh config has to be whatever your API enpoint is. Off the top of my head, I forget how to tell which is which, but one address is the home adress, and the other is the end point address. That is to say, when it is being installed on mino.example.com, a second API address is created, something like minio-s3.example.com. The API is the address needed.

@jdaviescoates I only wish I knew why.

@jdaviescoates said in Cannot install themes:

Validation (FieldIsRequired) failed for ref

This Github link has a similar issue, and a solution, plus two workarounds.

Is this new? It seems I can create and edit in my browser, but using the Android or iOS app gives me a pop-up stating "Using the free Community version, you can open documents for viewing only. To access mobile web editors, a commerical licence is required."

I checked their website.. a commercial licence is 1500 USD.

What the heck? What am I missing here?

@girish Your comprehensional wizardy astounds me! Seriously, impressive. I aim for that type of thinking to better deduce problems, and when I see it done, right in front of me, it's impressive.

EDIT: though this sounds sarcastic, I am being totally sincere!

Hi everyone,
Ive been using WPMain to manage about 15 WordPress sites. It's handy!

But now I'm stymied about how to manage content, and visual styles. I do use MacJournal on a Mac, but I'm looking for an Android solution, or i guess another web-based solution.

Does anyone know of a solution where I can gather content from my browsing, then make a post about it in a central place, then post it to one of the blogs? I might reuse the content on 2 or 3 sites, too.

And then finally, a way to visually have a quick display or review of sites' current themes, fonts, layout?

Or am I looking at doing all that manually, as I've been doing?

Thanks!

Wouldn't you know it, I also had a similar issue recently - went to an app and suddenly it wouldn't load. A bunch of others too. I didn't know the trick that @humptydumpty shared, so I just pressed the button on the main Domain tab on the Dashboard to renew ALL the certs, and suddenly more weren't loading. I checked the logs, and I had a domain in there that didn't have an AAAA record, and was thus stalling ALL the renewals. The thing is, I'm certain many of the other domains also don't have an AAAA record. Maybe because the one in question is an IDN? Anyways, I figured out the IPv6 address and made a new AAAA record, and voila! Everything is back to normal.

@girish Thank you!

@robi It seems so, but reachable through the Terminal, not the File Manager. I edited it according to that github link, aling with the php command, and an app restart, but nothing changed.

I've followed steps suggested here: https://github.com/wallabag/wallabag/issues/4292

but the tokens remain valid still for just one hour. I don't recall this from before; it seems to me they lasted almost indefinitely.

How do we change the duration for a Cloudron Wallabag please?

@jdaviescoates That is what I assumed too, but there is no sign of the Mastodon app in the full Cloudron backup bucket, despite it being in the list of backed up apps shown in the Backup Dashboard of Cloudron.

In fact, since I've been trying to poke around, it appears that my MAstodon app stopped using the Minio destination and is instead backing up, or at least accumulating, data on the server that my Cloudron is on. The last files uploaded to the bucket was weeks ago, according to the Minio bucket. And nothing from Mastodon is showing up in the Cloudron bucket.... what is happening?

It seems to have hung now for awhile, showing,
Jan 13 22:32:34 box:tasks update 13910: {"percent":30,"message":"Uploading backup 722M@0MBps (social.futurnumerique.com)"}

It would be helpful to see WHERE it is being backed up to. Neither of the two possible destination buckets indicate a change.

@scooke If I understand you, when I do that it brings me to the app's dashboard, at which point I have chosen which back up I want to restore to, the restore begins, then fails because it can't find the backup. It's listed in the full app backup, but isn't in the bucket used for that.

All I can think is that the Mastodon app is being backed up at the same time as all the others, but to the bucket specified in the env.production list. Which, I guess makes sense, but I thought that setting was for the data, not the app.

@scooke UPDATE: The whole-server Restore by my webhost worked.

As I poked around I realized that in the env.production file of the Mastodon app it is set to use the same Minio instance, but a different bucket, for backups. The Cloudron-facing backup in the app dashboard DOES NOT indicate to WHERE the backup is happening. I assumed it was to the Cloudron-wide set destination.

Is this the cause? Even when the entire CLoudron is being backed up, does Cloudron reference the Mastodon's env.production app and thus backs it up but to the other bucket??

I might just edit that env.production file to have the Mastodon app use the same bucket for its data. But, then that bucket will get very large.

I'm putting this in Support, rather than Mastodon, because it is quite strange.

My Mastodon instance was blank this evening, and giving me some kind of https error. Instead of trying (to figure out how) to renew the cert, I just thought "I'll restore to a backup, easy-peasy". The version listed was 1.10.0, so I chose to restore to a 1.9.1, just a few days ago. Part way through an error message popped up saying the backup can't be found. ?

SO I checked the Minio instance, the bucket where the backups are going, and sure enough there is the item, like "2022-12-23-210007-476", and inside this are all the other apps... but no Mastodon app.

When I click on the backups shown in the Backup tab in the Cloudron-wide Dashboard, where it says how many apps are backed up, it will show that the Mastodon app WAS included... but then in the Minio bucket, it isn't.

What in the world? It isn't in the list of excluded apps, it IS shown as being backed up, but when I checked every single Cloudron-wide backup, it isn't there (even if the backup app list says it was).

So as it stands, I now have lost my Mastodon instance. This is not good! Because even the app-specific backup, 2 days ago, is listed as backed up, but IT IS NOT.

Any ideas?? At the very least, can I somehow get the not-running-correctly-but-at-least-it-was-here Mastodon running? Or would the current docker images/containers have been deleted already when I tried to Restore?

EDIT: This may be dumb, but I am using the webhost's "Server Backup" to restore the entire thing. If that works, I will investigate what is going on with Mastodon not being included in the backups. What other apps are likewise being excluded??

I realize there seem to be more and more Support requests here regarding installing Cloudron on various platforms - at home, in a VM, in a VM in a VM, on a virtual USB stick plugged into a Mac running a Windows VM on a remote Redhat VPS (I made that up), on a Pi, etc. These then include troubleshooting DNS, ports, routers... don't get me started on throwing CF into the mix! I mean, that's all cool. I love fiddling too. And Girish's blog post about hosting Cloudron at home more or less encourages ppl to try that. But Caprover and Yunohost, as two related services, make it clear that installations not on a standard VPS are advanced (https://caprover.com/docs/run-locally.html, https://yunohost.org/en/install/hardware:regular). Yes, I realize that these other two DO provide documentation, which is what another post asked about; but if you've ever tried troubleshooting or getting help with issues with those other two on their respective Support Forums... good luck!

Could there be a totally separate Forum category for these types of requests, along with some notice or link on that Installation page (or somewhere) that installations not on the specified platform can go to such-and-such Forum for help? And to be honest, have them be lower priority than Support requests for Cloudon installed according to the documentation. Those who have attempted, and maybe succeeded, can help each other within that Category. Maybe even iron out all the various the wrinkles for all the various platforms until there is a 99.99% functioning set of instructions for non-VPS installations.

The Cloudron Team are super with how much they try to help everyone... but helping those who don't install Cloudron according to the documentation detracts from those who followed the official instructions. Particularly when said Help includes troubleshooting someone's home setup+router+ISP+model of Pi+DNS+voodoo. Kudos to the Team!

*I suppose it makes sense that the Cloudron Team gives Support for those on a non-VPS setup who are paying for Enterprise or Priority (but do those customers actually come to the Forum??).

@LoudLemur Girish has a blog post about this: https://blog.cloudron.io/installing-cloudron-on-a-home-server/

I like to think that the instructions at https://docs.cloudron.io/installation/ are clear about how to best install, run and use Cloudron. It is not "some documentation"... it IS the documentation. I've made a new topic under Discuss about this.

@marcusquinn Oh oh... too good to be true?

@3246 The impression that the backup succeeded when it didn't is concerning, for sure.

@3246 Wow. I'm trying to figure out what exactly went wrong...
The expected backup wasn't restorable because it wasn't found, right?

And the expected backup wasn't found because it was never made because the disk was already full, did I get that right?

Or, was the backup not found because, even though it apparently DID run, it actually didn't because the disk was already full... right?

Or did the backup complete? And was then not found?

And the disk being full happened the day before, when you threw a ton of data at it. And despite clearing things out so that it seemed that there was enough space for a backup, somehow there actually wasn't, but this fact wasn't made clear?

And the initial backup (that ended up not being found) was just the Nextcloud app, right? Or was it the entire Cloudron initially, and then you thought to focus on the Nextcloud app because it is used most.

But then you end by saying the Cloudron is running happily, so was it just the NC app backup that didn't work, or was it the entire Cloudron?

And if this was just a test, why use the production server?

Maybe you could retell the tale with some more to-the-point details. At the moment it sounds like the full disk interfered with the backups (not Cloudron's responsibility, but a scenario that has been induced several times by others, including myself) but Cloudron told you the backups were successful (Cloudron's fault to give a faulty confirmation - if this is the case this is serious) when there actually wasn't a backup made (plus somehow Cloudron made it seem like there was room for a backup when there actually wasn't, in which case the expectation is that Cloudron wouldn't even try to make the backup, or at least fail with a notification of some sort).

Glad you are up and running though. That's a relief.

@yeku Free versions of Cloudron allow for 2 apps, so you can easily test this out. Unless your main backup has more than 2 apps. But since your main focus seems to be Nextcloud, the free versions ought to be enough. Good luck.

@yeku I use it mostly for a few apps that Cloudron doesn't have, but also because the server my Cloudron is on wouldn't be enough to host all the apps I like to use. So I'm spreading things out.

@jdaviescoates @LoudLemur I second the directional mic. It's a world of difference when I make a recording with my MBPr mic (all kinds of computer sounds are plain to hear). When I use my old USB Samson mic, wow! A pleasant warm tone with almost zero hum, hiss, brrr, what have you.

@jaschaezra For sure, one-click anything is convenient. If you need/want it now, then it's possible, is all I'm saying.

@robi I have run it before on a LAMP installation on a totally separate VPS, nothing special. But I am curious about it. The docs at https://docs.pkp.sfu.ca/admin-guide/en/requirements look like it should work on a Cloudron LAMP (you know, I have this faint memory that I DID install it on LAMP app here.)

Ideally a contained install would be nice, but wouldn't this work on a LAMP app.

@girish Wow, loving all this cleaning action!

Cleaning house.... good job!

@MooCloud_Matt I didn't realize this! So my WP app, my Vaultwarden, Matrix, Mastodon, Github, Grav, Jellyfin, Navidrome, Nextcloud, Vikunja, Umami, OpenVPN, LAMP app, etc. has ALL of those in the image that is installed when I click Install X app in the app store?? Why are all of those needed? I have 52 apps installed... so each of those apps has ALL of that software in its image?? Wow.

I assumed that, for example with the LAMP app, that the image would include Apache, MySQL, and PHP. No node, no Go, no Ruby, etc. This is quite eye-opening.

@MooCloud_Matt I like the diagram. Did you make it?
Also, isn't this exactly what Cloudron does though?