Sponsoring: n8n

marcusquinn

I think this will be valuable to everyone. I'm a big fan of Integromat - but this looks like the best FOSS self-hosted equivalent.

Discussing with @murgero and will pledge some mullah.

Please, if you can't package apps, I'm certain you'll find value from having this in your toolbox.

What I'm sponsoring is no way enough to match a respectable rate for developers - but it's something.

Please send also him something via Paypal if you can, in appreciation and we'll do all we can to get some more of these killer apps live sooner for everyone to flex with.

jdaviescoates

I'm skint so can't contribute financially atm, but also can't see how I could do so even if I was loaded. @murgero have you got a paypal.me link or something?

murgero

@jdaviescoates https://urgero.org got some options, https://paypal.me/murgero is the paypal.me link you were looking for.

marcusquinn

Part of the sponsoring for this or anything is having a quick way to interrogate if we can also sponsor feature needs in the apps themselves.

The whole point of open-source being the ability to commission things like that.

I realise nothing's perfect - but the easier to fire up instances, the easier to brief further development.

Excited for this! N8n is something I'm definitely looking to use.

marcusquinn

@atrilahiji Having looked at almost every API integration tool over the years, none of them will ever have every app connection for our ideal stack, but n8n does seem to cover more of the FOSS apps we have with Cloudron.

I'm resigned to permanently running many of these IFTTT-type apps — but better to have the right tools for each job that having to make them each time.

Currently, we use: Orbis Taskcenter (now Codeless Platforms and super expensive), Integromat (very nice and hoping to get a self-hosted version on Cloudron), NodeRED, WP CFM plugin, maybe some others I'm forgetting.

micmc

@marcusquinn Folks where has this been heading to lately?

Not only did this app have greatly evolved, they now offer their cloud service version and this is also a great companion to Mautic.

marcusquinn

@micmc Nothing I'm afraid. This is where I hit the wall sometimes, it's a so-near, yet so-far problem.

IMHO Cloudron is a couple more full-time staff short to keep up with the needs of app packaging and maintenance.

I have a list of a good dozen or so that would yield so much value for Cloudron.

Many of them you can base a service business on, which for me is the ultimate goal, for Cloudron to be a tool to solve needs, both for the Admins and many more clients that just need apps, security and confidence in their consultant.

I'm doing what I can my end, but the reality is still that Cloudron making things "easier" is not just "easy enough" still. Otherwise we'd have thousands of all the best FOSS apps.

I feel like a chef in a 5-star hotel that can cook almost anything, but unless fresh ingredients get delivered, everyone will be eating the same stuff for a very long time.

I've see a lot of entertainment apps go live in the meantime, but not so much on the money-making and saving stuff.

Best I can suggest is what I do, focus on making business successes, that can then sponsor and nurture developers, that can then maybe get extra time on top of that to package new apps.

IMHO The Selenium tests are an unnecessary blocker too. I'd rather see an app go live as unstable, and then the tests written based on those that show the most daily usage from the stats gathered.

Voting on App Wishlist posts seems arbitrary too - again, I'd rather just see them as unstable and then let the usage stats and feedback guide what needs attention priority.

Sorry, you did ask

Where is the blocker right now? Is it the package functionality or just getting on the app store.

I remember there was an issue with web hooks working correctly but I'm not sure where that went.

marcusquinn

@atrilahiji My understanding was there was concern with the lack of user management, but then the custom auth feature should solve that somewhat.

I also had a lengthy exchange with the project creator and main developer, who really wasn't mad about open-source or Cloudron at the time of the conversation, so I didn't know what to make of the intentions there.

The biggest blocker with anything is that there's a catch-22 for testing time, where many users will help test and give feedback on something but few have the wherewithall to get apps any other way than from the app store.

I expect because the majority have day-jobs that aren't dev-ops, so just like building a kit-car, it'd still be quicker and cheaper for me to do my day-job to buy a car than to build one. Which leaves us with about a dozen app-packaging benefactors running on goodwill, and a lot of patience and hope from everyone else in between.

For me ETL is the life-blood of modern business and life, and currently there are zero options for it in the App store. Whereas there's a dozen Kanban boards and salivation every time there's another app that uses the same styling as Notion, as if that somehow make it good.

Incidentally, I've sponsored things before and they just took the money and ran without finishing. I just don't know what to do with that, I'd rather cut off a finger than not keep a promise, so now I'm opting for wait and see, and focus on what I can do something about, and that's the business I generate using what we already have, which in this area is a recommendation to try Integromat instead, and leave the rest to hope and chance.

@marcusquinn Yeah fair enough. Did that happen in the cloudron community? O_O

Also, I was thinking of an "alternate" app store where you would need to enter your cloudron URL and an API key, and then select from a number of pre-built apps I can throw up. Of course with the intention that it is "one click" in a way, and things could be unstable.

Is there an appetite for this? I don't want to step on the toes of @staff but it just crossed my mind to make this for myself and friends but I can open it up. It very well could run into the limited person-power issue that the current app store has but just a thought.

marcusquinn

@atrilahiji I like the idea. I just can't do much to help as my kind of work is more focused on the usage of apps and businesses reliant on them.

I just cannot stop the world from turning, so when n8n isn't available, I go to next-best alternatives like Integromat.

It's all very well having open-source preferences, but when there's no options within reach that will cover the cost of my time, I have to go with what works over what's hoped to maybe one day if someone else agrees might work and might stay working.

I can point at the best apps that are good for providing value to business, and therefore enabling earning for consultants working with CLoudron as an integral part of their toolkit.

What I can't do is help any business or person when interest gets diverted into entertainment and gaming apps. I respect they are nice - but they aren't solving the bottleneck that is stopping good quality, legitimate value generating apps from getting launched.

thetomester13

@atrilahiji I believe the main issue with the package that's available is that there's no connection to the server, so it won't actually run any workflow.

I do love your idea of a crowd-sourced App Store, of course with the staff's blessing as you mentioned. There's already a short list of some apps here that I maintain. It'd be neat if there was a way to input a URL to an app for it to be installed.

girish

From what we have seen, when we mark something as unstable, people still expect support from it. When update fails, they want us to fix it despite it being unstable since they started using the app. One cannot make changes to app packages just because it's unstable. For example, if I publish odoo today as-is as unstable and without tests, is it OK if the next package breaks it? I think not, and you can see the statping, calibre-web, commento etc as examples where it just eats everyone's time.

One idea is that we have an ability to publish apps but they will not be listed in the app store. You have to explicitly put in like - https://my.domain.com/#/appstore/com.newapp.cloudronapp. Apps will update as always. Is this something that is interesting? So, all one needs is the appstore id and from our side we can just push things without even really testing and not spending too much time. In my mind, since it's hidden, people probably think a bit more than unstable but I don't know

robi

@girish Simply renaming Unstable to Unsupported will achieve the same effect.

And since you will do best effort anyway, it will be above and beyond what is "advertized" (displayed) and be a net positive.

@girish I suppose unstable can be re-framed. I think setting expectations and hiding those apps initially would be good. For example:

The app store has a setting where one has to go to enable the "unstable" section of the store.
Enabling this has a warning modal asking people to accept all risks associated with installing these.
Plaster notices everywhere letting people know that support requests for those apps will be ignored.

It is most definitely an issue of expectation management. Working in support, this is something I have to have front of mind always, as anything I do can set a precedent I may not want set. Therefore I have made a point of always being as clear as possible about what I will and will not do.

I guess my proposal of a fan-run unstable app store would step on your toes a bit but it was something I was going to make for myself to basically list apps that point to docker containers I build and then add the ability to use the API to install those apps to any instance.

marcusquinn

From our point of view, we're more likely to be able to find time to contribute to fixing things if we've started trialing and expecting to use them in production.

It's not that we can't get apps packaged, it's just not our core business. Our business is implementing what's already available, to focus on business logic that pays for us and apps, platforms, servers, licences, and maybe something left for fun stuff.

I'm happy to share dozens of WP plugins because we had to develop them to get a job done and no-one would know they have any use until we make them exist.

The thing with app packaging, is they are all things that have a proven market and need, usually pretty closely correlated to their GitHub Stars count. So, we're not trying to prove anything to the world, just preserve time for the utility aspect that pays for other things we don't have any business in.

I guess I see it like a utility, I need electricity or WiFi, so does my neighbour, but it gets awkward if ask to borrow theirs.

I've forgotten where I'm going with this - but it feels counter-productive for me to do things that others can do faster at the expense of not doing the things I'm very fast at.

https://git.atrilahiji.dev/atrilahiji/cloudron-n8n-app

Works

Gotta use chrome/chromium based browser it seems. Firefox gets that connection lost issue.

I did only test with a webhook trigger going to an http request action (which is 99.9% of my use cases) but ymmv. I didn't test much else because I don't use a large number of the services it works with.
This is based largely on @jimcavoli 's package (I literally changed one thing in the manifest).

Install by pulling the repo and doing the while cloudron build/install stuff. Ya know the drill now.

thetomester13

@atrilahiji can confirm I'm no longer seeing the 'Connection Lost' on Chrome! (Though still present on Firefox ). Either way, you're my hero! Will be playing around with this more over the next few days.

thetomester13

@atrilahiji I came across a few things, wondering if you have some input on these:

I'm not able to simply 'run' workflows. Trying to 'Execute' results in an endless spinning of a wheel. When trying to hit 'Stop' to stop the execution, this shows up in the logs:

Apr 27 13:51:02 Error: The execution id "6" could not be found.
Apr 27 13:51:02 at /usr/local/node-12.16.3/lib/node_modules/n8n/dist/src/Server.js:1142:27
Apr 27 13:51:02 at runMicrotasks (<anonymous>)
Apr 27 13:51:02 at processTicksAndRejections (internal/process/task_queues.js:97:5)
Apr 27 13:51:02 at async /usr/local/node-12.16.3/lib/node_modules/n8n/dist/src/ResponseHelper.js:76:26

I can switch over a workflow to a webhook, and then properly trigger the workflow, which is awesome! However, to test this out, I'm doing a simple 'send email' using my Cloudron SMTP credentials. This node fails on the workflow with the following error: ERROR: 140532647925632:error:1408F10B:SSL routines:ssl3_get_record:wrong version number:../deps/openssl/openssl/ssl/record/ssl3_record.c:332:

I know this is very much a work in progress, just wanted to record these in case anyone has some input.

@thetomester13 huh openssl errors??? O_O

Yeah not immediately sure why but I'll do some digging.

I'm also just going to do some cleaning up of the package

thetomester13

@atrilahiji upon further investigation , it seems as if it's just a problem with the Send Email node (or maybe my credentials? Though IMAP is confirmed working). I'm able to create other workflows with other triggers that run properly! Very awesome stuff!

@thetomester13 Yeah seems to be a weird upstream issue. I also just disabled SSL for SMTP and it worked. Still using port 587

@thetomester13 I also bumped both the N8N and Node versions

girish

@thetomester13 said in Sponsoring: n8n:

@atrilahiji upon further investigation , it seems as if it's just a problem with the Send Email node (or maybe my credentials? Though IMAP is confirmed working). I'm able to create other workflows with other triggers that run properly! Very awesome stuff!

There seems to a bug with the cert renewal logic which I am just investigating. If you go to Services -> Mail -> Restart it copies over the fresh cert.

girish

@atrilahiji @thetomester13 so, should i just go ahead and push that as unstable?

thetomester13

@atrilahiji said in Sponsoring: n8n:

@thetomester13 I also bumped both the N8N and Node versions

I'm still not able to get my SMTP Send Email node to work for some reason, even with the refresh of Mail certs and Ignoring SSL Errors. shrug not a huge deal for now, I'll play around with it some more coming up.

@girish said in Sponsoring: n8n:

@atrilahiji @thetomester13 so, should i just go ahead and push that as unstable?

I think that should be fine!

@girish It seems stable enough to be unstable. FYI the most up to date package is here https://git.atrilahiji.dev/atrilahiji/cloudron-n8n-app

thetomester13

@atrilahiji ooooookay. You said you turned off SSL, not SSL Errors. Yes, turning that off in the credentials themselves worked!

@thetomester13 Yep! Gmail seemed to think it was secured with TLS anyways so IDK? IMAP seems to work anyways.

girish

@atrilahiji do you think you can add a LICENSE file and I can then put the repo in git.cloudron.io. Thanks!

@girish Done

girish

@atrilahiji Thanks! Here - https://git.cloudron.io/cloudron/n8n-app . you and @thetomester13 should have push access. I am just building the unstable package.

girish

OK, this is published as unstable now. I haven't really looked into the package code itself but I will take a look when I find the time this week. I created a n8n app category, so please continue discussing there.

marcusquinn

Awesome work - thank you kindly! Will give it a good test, and see if we can contribute connectors for EspoCRM too.

girish

@marcusquinn Yes, as a heads up, it doesn't work in firefox, only in chrome. Some nginx/event source issue - https://forum.cloudron.io/topic/4980/cannot-reach-backend-server

marcusquinn

@girish Cool - got it. I guess that means all/most Chromiums.

As an aside; I have ended up reviewing Edge in the last couple of days by chance - it's surprisingly nice, and certainly better than the trojan horse that is Google Chrome.

micmc

@atrilahiji said in Sponsoring: n8n:
@girish Done KUDOS !
@marcusquinn
Great stuff mates!
Meanwhile my last post and I come back there's been a few discussion and work done.

I'd been able to successfully install the 'unstable' version from the std repo
It's my intention to much test it, specifically with Mautic but much more as incidentally this app connect with several of the FOSS we have on Cloudron apps repo.
I'd have the 'Connection lost' message as well and got it temporarily 'fixed' using a chromium based browser (I use brave, but I'm quite allergic to 'googoo' chromie sh..., heuu I mean, stuff lol) (that should / must work with Firefox based as well, not sure if the glitch is due to UI from the devs or else, something to look deeper). At moment of writing the app seems to work well with Brave browser (chromium based).
@marcusquinn Marcus, bro I agree with your sayings about apps that should be prioritized, as business apps i.e., above the fun and entertainment apps. Not that they're not appreciated and fun, and not that they're not adding value. They are! Business people too, have fun (sometimes lol) and families and all cool apps are always an added value and appreciated. However, I too believe that this, Cloudron, i$ mainly a $olution for making ($$) it easier to conduct digital business for every level, whether entrepreneur (non-techie), and nerds as well, and even beginners for any kind of new business in 2021 (I firmly believe this, I'm building some specific training for this, we can help a lot, a huge amount, of people to recover and start new careers, literally, starting with a Cloud Box as Cloudron actual offer. As there's plenty of kanban, notes taking, and music players, and the like, I personally believe we're still greatly lacking of a few, let's say MAJOR apps, that MUST be part of a 'business online apps suite'.
As business online perspective, on the major apps side which are a must fro business we have:
- Email server
- Website hosting (WP, Ghost and more, w redis)
- Email marketing lists server w automation
- Marketing Automation
- Powerful Surveys (marketing tool)
- Full Analytics Stats server
- Full Invoicing and Payment UI
- Full Help Desk Online Support System
- Project Management
- Business and Workflow Management
- Team Communication
- Team Collaboration
- Office Online suite (w collaboration)
- Audio - Video Conferencing (still small scale though)
- Powerful granulated Files Sharing System
- Video and Audio Hosting and sharing platform
- Audio and Video Streaming Podcast
- WIKI Platforms as docs and knowledge base
- Powerful Online Education and Training Platform

And there's even so much more, but I'll keep it for like I said the major apps that should more or less be used by "a business".

IMHO, what's still missing is:

SEO tools (I've proposed "SEO Panel" it's the best available as FOSS and it's SaaS ready, there's a thread here in wish list)
Social Media (marketing n management tools) I think there's a few suggestions in the wish list already but that should also be looked for.
More stable, easier (or simpler) to manage and/or implement, video conferencing / webinar platform.

I've recently went through the apps wish list and there seems to be a whole a lot more pretty much interesting apps waiting to be added. Indeed, it seems we've reached to a point where there's more demand than the capacity to handle them exists. So, yeah, for the moment, I'd agree to say let's focus on the most important ones, work them push them, increase CR sales and all make money and then hire more devs to keep going to the next level.

TTYL all
Andy

marcusquinn

@micmc We're on the same page. It's all a puzzle but going in the right direction.
If I may, a couple of recommendations I think you'll like:

Vivaldi browser - I like it a lot.
EspoCRM - I also like it a lot, and have a large amount of work invested in it now and happy to share under that post.

micmc

@marcusquinn You are right Vivaldi is a Jewel! I use it too I can use several I'm on Linux.

I'd been looking into a better integration CRM than the one I use presently (Perfex CRM from codecanyon, excellent, powerful, and open source but no API etc. thus not much integration possible, yet). Thus, looking deeper into espo was among my next moves, thanks for the recommendation.
Andy

--

jdaviescoates

@staff I just realised there hasn't been an Announcement post about n8n

girish

@jdaviescoates whoops, we seem to have missed that. @BrutalBirdie has been working on making it stable and I think he has made it stable now and added tests. I will double check and announce.

Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.

Sponsoring: n8n