trying to scale N8N

[roofboard]

@girish

At the end of the day, I found the culpret.
Also upgraded to a bigger server.

While yes N8N will happily crash it's self - I had a few perfmance bottlenecks and for now N8N seems to be happy with the traffic. Here is a breakdown of the solution without setting up queue mode.

1. N8N uses postgress - so bumping up the RAM for N8N is not enough that just grows the list of RAM eating active processes, you also have to go bump the RAM for Postgres
2. I am using Baserow for logging and followup task Queueing. By default baserow only has 3 Auth workers which is not enough to cover heavy load. So I had to install the CLI and run the command cloudron env set --app baserow.draglabs.com BASEROW_AMOUNT_OF_GUNICORN_WORKERS=9

Conclusion - Step 1 Significantly improved the performance of N8N dropping normal RAM consumption by about 30%
Step 2 Caused active processes to complete 10X faster further reducing N8N footprint.

Now that I upgraded to 24 gigs I am only using 8

[hugoo_souza10]

@roofboard Hello how are you?
Could you tell me how you did the n8n queue mode installation? I've tried and I couldn't and I don't understand your explanation very well

[girish]

@hugoo_souza10 I think @roofboard enabled queuing in baserow and not in n8n.

What are you trying to do/solve ? Maybe you can open a separate thread with your issue.

[roofboard]

@hugoo_souza10 yes that is accurate I increased the "gunicorn" workers in baserow allowing for more writes and reads. Essentially I never got queue mode working, but i did optimize the instance for maximum performance. It has a limit somewhere around 10 requests per second.

[hugoo_souza10]

@girish I wanted to see the simplest way to install the queue mode on the n8n, I've looked a lot and I don't find it. So, searching, I fell into this conversation.

[hugoo_souza10]

This post is deleted!

[hugoo_souza10]

@roofboard Can you explain to me how you did it? This would be just fantastic for escalating requests to people who have machines crashing.

[roofboard]

@hugoo_souza10
the matter of gunicorn workers is specific to baserow which I use for logging on N8N actions.

to change the baserow env variables just go into the baserow terminal and type
export BASEROW_AMOUNT_OF_GUNICORN_WORKERS=20

that should do it.

However for N8N the best you can do is give is 8gb or 16gb of ram, and increase the postgress ram to 4gb .

[zonzonzon]

@roofboard How we can increase the postgress ram in cloudron ? Thank you.

[girish]

@zonzonzon Services view - https://docs.cloudron.io/services/#configure