Nextcloud Fulltext Search
-
@spectrely said in Nextcloud Fulltext Search:
So this may be confusing.
TO install this app, it must be done from within NextCloud, not Cloudron. I just confirmed on my own instance. If you need help, let me know and I'll walk you through it.I know I need to install an app within nextcloud but there's also a "server part", see https://github.com/nextcloud/fulltextsearch/wiki/Basic-Installation#installation-of-elasticsearch--ingest-attachment-plugin-on-your-server
Installation of ElasticSearch + "Ingest Attachment Plugin" on your server
I thought this would have to happen within the Docker instance of nextcloud?
wrote on Dec 19, 2018, 10:36 PM last edited by@necrevistonnezr oooooooh, I assume with that one, you'd need your own external server for that feature.. Let me know what you find!
-
@necrevistonnezr oooooooh, I assume with that one, you'd need your own external server for that feature.. Let me know what you find!
wrote on Dec 20, 2018, 7:54 AM last edited by@spectrely said in Nextcloud Fulltext Search:
@necrevistonnezr oooooooh, I assume with that one, you'd need your own external server for that feature.. Let me know what you find!
Well, in theory you needed an external server for the Nextcloud Collabora Office app but the cloudron guys made it available, anyway...
-
wrote on Sep 11, 2019, 3:23 PM last edited by
It seems there's a Docker image for the fulltext search backend engine on Nextcloud, now: https://github.com/nextcloud/fulltextsearch/wiki/Basic-Installation
-
wrote on Feb 5, 2020, 7:14 PM last edited by
Getting elasticsearch into Cloudron would be great! Fulltext search for Nextcloud is a must and running a separate instance side by side to cloudron is very inefficient...
-
Getting elasticsearch into Cloudron would be great! Fulltext search for Nextcloud is a must and running a separate instance side by side to cloudron is very inefficient...
wrote on Dec 15, 2020, 1:52 PM last edited by jdaviescoates Dec 15, 2020, 1:52 PMCloudron 6.0 now has Solr integration!
But even though https://github.com/nextcloud/fulltextsearch says:
Full text search
Full text search is the core app of a full-text search framework for your Nextcloud.
To have it operate, and get content indexed, some other apps are needed:- Some Providers Apps to extract content from your Nextcloud.
- A Platform App that communicate with a search platform (ie. Elastic Search, Solr, …) in order to index the content provided by the Providers.
Note: There is no limit to the number of platform-apps that can be installed, however only one can be selected from the admin interface
(I bolded Solr)
Currently Solr is not yet supported:
https://github.com/nextcloud/fulltextsearch/issues/334
Someone made a start a while back, but it doesn't appear they've done anything on it for the last couple of years now
https://github.com/rearden-logic-inc/fulltextsearch_solr
I wonder any @staff or @appdev's might be up for taking this on? It'd be awesome to be able to use Cloudron's new Solr addon within Nextcloud to do full text searches!
-
Cloudron 6.0 now has Solr integration!
But even though https://github.com/nextcloud/fulltextsearch says:
Full text search
Full text search is the core app of a full-text search framework for your Nextcloud.
To have it operate, and get content indexed, some other apps are needed:- Some Providers Apps to extract content from your Nextcloud.
- A Platform App that communicate with a search platform (ie. Elastic Search, Solr, …) in order to index the content provided by the Providers.
Note: There is no limit to the number of platform-apps that can be installed, however only one can be selected from the admin interface
(I bolded Solr)
Currently Solr is not yet supported:
https://github.com/nextcloud/fulltextsearch/issues/334
Someone made a start a while back, but it doesn't appear they've done anything on it for the last couple of years now
https://github.com/rearden-logic-inc/fulltextsearch_solr
I wonder any @staff or @appdev's might be up for taking this on? It'd be awesome to be able to use Cloudron's new Solr addon within Nextcloud to do full text searches!
@jdaviescoates I think only the elastic one is maintained upstream. It's unlikey we (cloudron) will write the solr fts integration for nextcloud. That's really something we don't have any expertise for.
-
@jdaviescoates I think only the elastic one is maintained upstream. It's unlikey we (cloudron) will write the solr fts integration for nextcloud. That's really something we don't have any expertise for.
wrote on Dec 15, 2020, 9:28 PM last edited by@girish it was a longshot, but fair enough!
-
wrote on Jul 2, 2021, 8:34 AM last edited by
We've created an ElasticSearch app for Cloudron.
https://git.cloudron.io/vladimir.d/elasticsearch
Comments are welcome!
-
We've created an ElasticSearch app for Cloudron.
https://git.cloudron.io/vladimir.d/elasticsearch
Comments are welcome!
wrote on Jul 2, 2021, 8:55 AM last edited by@vladimir-d said in Nextcloud Fulltext Search:
We've created an ElasticSearch app for Cloudron.
https://git.cloudron.io/vladimir.d/elasticsearch
Comments are welcome!
Woah, cool!
-
We've created an ElasticSearch app for Cloudron.
https://git.cloudron.io/vladimir.d/elasticsearch
Comments are welcome!
I guess https://forum.cloudron.io/topic/5297/supervisord-to-manage-running-processes-in-nextcloud-app is related to this
-
wrote on Jul 2, 2021, 4:02 PM last edited by
Yup, we have this working now. It's OKish but Nextcloud's search interface is kinda sh*t, so next task is going to be fixing that to make it actually useful and hopefully work similarly to Google Drive with an actual sortable results page.
Elasticsearch as an App from @vladimir-d is a significant win for other uses too.
-
wrote on Jul 14, 2021, 10:56 AM last edited by
Anecdotally, this fulltext search (using elastic search) seems to be as fast as the filename search, or even makes both of them faster.
The search results interface as a modal is still cramped and limited, but we will try to develop a full results page to show on hitting enter or clicking the search icon.
-
wrote on Jul 14, 2021, 10:58 AM last edited by
An interesting search string for anyone managing what multiple users do with these things is to search for
password
and see how many place plaintext passwords are stored in user's documents & spreadsheets!Similar for things like passport number, driving licence, social security, national insurance. It's a handy way to do a review of personal data being stored in files and who has access to what.
-
We've created an ElasticSearch app for Cloudron.
https://git.cloudron.io/vladimir.d/elasticsearch
Comments are welcome!
-
@rmdes I think as a first step for next Cloudron release we will look into a way to run long running / periodic processes so we can support things like nextcloud indexer. Elasticsearch has to be installed as a separate package. From there, it's straightforward.
-
@rmdes I think as a first step for next Cloudron release we will look into a way to run long running / periodic processes so we can support things like nextcloud indexer. Elasticsearch has to be installed as a separate package. From there, it's straightforward.
wrote on Jul 15, 2021, 10:26 AM last edited by@girish Wonderful, I have tons of PDF's that I want to parse, OCRise, make searchable, the ability to do this in a self-hosted environment is mandatory in my case because it's related to Justice documents that I don't want to upload anywhere, ever, so I have been searching ways to go around that without having VPS's running just for that, I hope it's going to be doable in the future
(and I trust it will)
-
@girish Wonderful, I have tons of PDF's that I want to parse, OCRise, make searchable, the ability to do this in a self-hosted environment is mandatory in my case because it's related to Justice documents that I don't want to upload anywhere, ever, so I have been searching ways to go around that without having VPS's running just for that, I hope it's going to be doable in the future
(and I trust it will)
wrote on Jul 15, 2021, 5:43 PM last edited by@rmdes we're looking into the OCR stuff too, will get to that part very soon as well.
-
@rmdes we're looking into the OCR stuff too, will get to that part very soon as well.
wrote on Apr 4, 2022, 7:52 AM last edited by@marcusquinn @vladimir-d @staff
What's the status of the Elastic Search App - according to the repo, there hasn't been an update for the last 9 months. Is this still functional? -
@marcusquinn @vladimir-d @staff
What's the status of the Elastic Search App - according to the repo, there hasn't been an update for the last 9 months. Is this still functional?wrote on Apr 13, 2022, 1:10 PM last edited by@necrevistonnezr said in Nextcloud Fulltext Search:
What's the status of the Elastic Search App - according to the repo, there hasn't been an update for the last 9 months. Is this still functional?
Same question.
It'd be great to actually get this in the App Store if it is functional.