WARNING:waitress.queue:Task queue depth is 1

[warg]

Hello,

I just tried LibreTranslate and noticed that with only 1 user and slow requests, I still get messages like this:

Jun 01 22:50:04 WARNING:waitress.queue:Task queue depth is 1
Jun 01 22:50:04 WARNING:waitress.queue:Task queue depth is 2
Jun 01 22:50:04 WARNING:waitress.queue:Task queue depth is 3
Jun 01 22:50:04 WARNING:waitress.queue:Task queue depth is 4
Jun 01 22:50:04 WARNING:waitress.queue:Task queue depth is 5
Jun 01 22:50:04 WARNING:waitress.queue:Task queue depth is 6

According to Google results this is linked to performance bottlenecks. Can this be ignored? It surprises me that there is a bottleneck when the server basically does nothing except serving 1 user with one or two translation requests synchronously.

Best Regards,

[girish]

This took some digging. I think it comes from https://github.com/Pylons/waitress/issues/235 maybe.

But I found a LT_THREADS argument. If you put this in /app/data/env.sh and restart the app, the warning seems to disappear.

export LT_THREADS=12

I bumped the thread count to 8 for next package release.

[warg]

Yep, warning disappears with setting this environment variable.