Latest update seems to have similar issue as before, resources not found

[girish]

@scooke said in Latest update seems to have similar issue as before, resources not found:

Jan 31 22:32:00 Attempted to load corpora/stopwords.zip/stopwords/

So, this is wrong. It should be corpora/stopwords/ , I think.

root@07a7fcf3-f9ff-4051-9d89-dec6ed4a4777:/usr/local/share/nltk_data/corpora/stopwords# ls
README       basque   chinese  english  german  hinglish    italian  norwegian   russian  swedish
arabic       bengali  danish   finnish  greek   hungarian   kazakh   portuguese  slovene  tajik
azerbaijani  catalan  dutch    french   hebrew  indonesian  nepali   romanian    spanish  turkish

[girish]

@scooke do you even have /usr/local/share/nltk_data/corpora/stopwords ?

[scooke]

@girish Although there is definitely a stopwords.zip in the corpora/stopwords directory, there is also a stopwords folder (unzipped, I suppose). That is one thing to correct then.

I found this link: https://aur.archlinux.org/packages/paperless-ngx. Six comments from the bottom ammo wrote that executing ln -s /usr/share/nltk_data /usr/local/share/nltk_data fixed it for him. I tried it but, of course, these are read-only directories. So maybe this is a second thing to fix?

[scooke]

@girish said in Latest update seems to have similar issue as before, resources not found:

/usr/local/share/nltk_data/corpora/stopwords

Yep

root@mypaperlessimagelongnumbernamethingy:/usr/local/share/nltk_data/corpora/stopwords# ls -al
total 160
drwxr-xr-x 2 root root  4096 Jan 26 09:05 .
drwxr-xr-x 3 root root  4096 Jan 26 09:05 ..
-rw-r--r-- 1 root root   909 Jan 26 09:05 README
-rw-r--r-- 1 root root  6348 Jan 26 09:05 arabic
-rw-r--r-- 1 root root   967 Jan 26 09:05 azerbaijani
-rw-r--r-- 1 root root  2202 Jan 26 09:05 basque
-rw-r--r-- 1 root root  5443 Jan 26 09:05 bengali
-rw-r--r-- 1 root root  1558 Jan 26 09:05 catalan
-rw-r--r-- 1 root root  5560 Jan 26 09:05 chinese
-rw-r--r-- 1 root root   424 Jan 26 09:05 danish
-rw-r--r-- 1 root root   453 Jan 26 09:05 dutch
-rw-r--r-- 1 root root   936 Jan 26 09:05 english
-rw-r--r-- 1 root root  1579 Jan 26 09:05 finnish
-rw-r--r-- 1 root root   813 Jan 26 09:05 french
-rw-r--r-- 1 root root  1362 Jan 26 09:05 german
-rw-r--r-- 1 root root  2167 Jan 26 09:05 greek
-rw-r--r-- 1 root root  1836 Jan 26 09:05 hebrew
-rw-r--r-- 1 root root  5958 Jan 26 09:05 hinglish
-rw-r--r-- 1 root root  1227 Jan 26 09:05 hungarian
-rw-r--r-- 1 root root  6446 Jan 26 09:05 indonesian
-rw-r--r-- 1 root root  1654 Jan 26 09:05 italian
-rw-r--r-- 1 root root  3880 Jan 26 09:05 kazakh
-rw-r--r-- 1 root root  3610 Jan 26 09:05 nepali
-rw-r--r-- 1 root root   851 Jan 26 09:05 norwegian
-rw-r--r-- 1 root root  1286 Jan 26 09:05 portuguese
-rw-r--r-- 1 root root  1910 Jan 26 09:05 romanian
-rw-r--r-- 1 root root  1235 Jan 26 09:05 russian
-rw-r--r-- 1 root root 15980 Jan 26 09:05 slovene
-rw-r--r-- 1 root root  2176 Jan 26 09:05 spanish
-rw-r--r-- 1 root root   559 Jan 26 09:05 swedish
-rw-r--r-- 1 root root  1818 Jan 26 09:05 tajik
-rw-r--r-- 1 root root   260 Jan 26 09:05 turkish

[scooke]

Thank you for troubleshooting this with me. Weird that I'm the only one!

[girish]

@scooke I think I am not testing this correctly because as per the code atleast it should fail for me but it doesn't.

Should I enable some flag inside paperless for nltk handling ? There is a complete absence of nltk in my logs.

[girish]

@scooke Can you try with 1.5.4 please?

I think I found the issue. First, the classifier needs to be created with document_create_classifier . One has to also put some tags, categories etc for documents. Once all that is setup, the nltk stuff kicks in. Without the classifier, nltk is just skipped.

[scooke]

@girish I"m not seeing v.1.5.4... is there a way to force it?

[axel0681]

Latest Update 1.5.4 is working for me .

Thanks

[girish]

@scooke said in Latest update seems to have similar issue as before, resources not found:

@girish I"m not seeing v.1.5.4... is there a way to force it?

Strange, it's published normally. Did you check for updates manually?

[scooke]

@girish Do I need to be upgraded to v1.5.2 to see it? Or do I need to have auto-updates turned on. I've turned them off and am checking manually as I'd rather have an older version that works than a newer one that doesn't.

[girish]

@scooke ah, that's correct. you have to update from 1.5.1 to 1.5.2 to 1.5.3 .

[scooke]

@girish I'm happy to report that once upgraded to v1.5.4 that the PDF upload and processing completes without any problems. Whatever you did worked! Thank you!