BigBlueButton - web conferencing system for on-line learning

mehdi

@jdaviescoates After reading the arguments about why they recommend a bare-metal server ( on https://freeswitch.org/confluence/display/FREESWITCH/Performance+Testing+and+Configurations#PerformanceTestingandConfigurations-RecommendedConfigurations ), it seems to me that running it in cloudron (that means in a container) if cloudron itself is installed on a bare metal machine would be perfectly acceptable, as the kernel and its clock are shared between the host and containers.

jdaviescoates

@mehdi thanks. I've also seen this post https://forum.meet.coop/t/communitybridge/145/3?u=jdaviescoates which would seem to suggest it can work quite well on a VPS too

jdaviescoates

@jdaviescoates said in BigBlueButton - web conferencing system for on-line learning:

I think the main thing stopping the Cloudron team from working on packaging it is that at present it won't run on Ubuntu 18.04. Once that is sorted hopefully they'll prioritise it!

It's getting close! Builds of BigBlueButton 2.3-dev are ready for testing on Ubuntu 18.04 64-bit, see https://docs.bigbluebutton.org/dev/dev23.html

ei8fdb

Hi all, is there any update on a BBB app? I've been using Kopano, but I'm not liking it too much.

fbartels

Hi @ei8fdb,

@ei8fdb said in BigBlueButton - web conferencing system for on-line learning:

I've been using Kopano, but I'm not liking it too much.

You've mentioned in another topic that you are working in UX design. I would be very interested to learn why you are "not liking it too much". You can reach me through feedback at kopano dot com.

jdaviescoates

@ei8fdb said in BigBlueButton - web conferencing system for on-line learning:

Hi all, is there any update on a BBB app?

I'm assuming there wont be any progress until there is a stable 2.3 release which runs on ubuntu 18.04. Packaging a Cloudron app before then wouldn't really be possible because Cloudron needs ubuntu 18.04.

ei8fdb

@fbartels I will indeed. Apologies - my comment was unintentionally cryptic. I will reply with a longer explanation during the week.

BrutalBirdie

I am currently working on the greenlight Cloudron App for BigBlueButton.
So far the basic functionality is working fine but the ldap-auth is giving me trouble.

Right now the /app/code/bin/start script writes these variables

sed -i -e "s/LDAP_SERVER=.*/LDAP_SERVER=$CLOUDRON_LDAP_SERVER/g" /app/data/.env \
&& sed -i -e "s/LDAP_PORT=.*/LDAP_PORT=$CLOUDRON_LDAP_PORT/g" /app/data/.env \
&& sed -i -e "s/LDAP_BASE=.*/LDAP_BASE=$CLOUDRON_LDAP_USERS_BASE_DN/g" /app/data/.env \
&& sed -i -e "s/LDAP_BIND_DN=.*/LDAP_BIND_DN=$CLOUDRON_LDAP_BIND_DN/g" /app/data/.env \
&& sed -i -e "s/LDAP_PASSWORD=.*/LDAP_PASSWORD=$CLOUDRON_LDAP_BIND_PASSWORD=/g" /app/data/.env \
&& sed -i -e "s/LDAP_METHOD=.*/LDAP_METHOD=plain/g" /app/data/.env \
&& sed -i -e "s/LDAP_UID=.*/LDAP_UID=cn/g" /app/data/.env \
&& sed -i -e "s/LDAP_AUTH=.*/LDAP_AUTH=simple/g" /app/data/.env \
&& sed -i -e "s/LDAP_FILTER=.*/LDAP_FILTER=\(\&\(objectclass=user\)\(\|\(username=%uid\)\(mail=%uid\)\)\)/g" /app/data/.env \
&& sed -i -e "s/LDAP_ATTRIBUTE_MAPPING=.*/LDAP_ATTRIBUTE_MAPPING=uid=uid;name=displayname;email=mail;nickname=givenName;/g" /app/data/.env

But the LDAP Login fails.

INFO: [af608168-79eb-41e2-818c-1e514f0306bd] method=POST path=/auth/ldap format=html controller=SessionsController action=ldap status=302 duration=17.26 view=0.00 db=0.71 location=https://greenlight.stage.gzevd.de/ldap_signin host=greenlight 
INFO: [70994248-8131-4f51-bfdb-db159292bca0] method=GET path=/ldap_signin format=html controller=SessionsController action=ldap_signin status=200 duration=21.65 view=15.03 db=0.86 host=greenlight

Maybe someone can help out?

I just pushed my work here: https://git.cloudron.io/BrutalBirdie/greenlight-app
ps: Please ignore my .gitlab-ci.yml this is for my own gitlab for deploying and testing the App.

EDIT:
Thanks @nebulon
The LDAP_UID was wrong. Has to be username
And the Filter can be deleted.
Pushed.

jdaviescoates

@BrutalBirdie this is great, thanks!

I'm assuming you're using BigBlueButton 2.3-alpha-2 as the basis for this?

luckow

@BrutalBirdie Great news. So greenlight (as one of different other frontends for BigBlueButton) can be used for videoconferencing & user management. While BBB is installed on a different VM or bare metal. And we can use the built in TURN server on Cloudron. Top!

BrutalBirdie

I'm assuming you're using BigBlueButton 2.3-alpha-2 as the basis for this?

@jdaviescoates the Greenlight App is just the front end for BigBlueButton.
As @luckow mentioned BBB can be installed anywhere and Greenlight is just the front end which connects to a specific BBB instance or cluster to provide a UI etc.

BrutalBirdie

I would like someone to review my greenlight-app.
Just heads up this is my first app for Cloudron so I expect some issues but I will be happy to fix and learn from them.

doodlemania2

@girish - can you mark this as WIP for testing?

nebulon

I took a brief look at the app and overall it appears to work. Thanks a lot!

Some things to improve:

I was not sure how to login with the pre-setup admin, since I didn't know the admin email address
The tests need also test admin login
The tests need some code cleanup
Since it is only the webfrontend as far as I can tell, the icon has to somehow reflect this
The postinstall docs need to mention the fact that the backend has to be adjusted to not use the default test backend

BrutalBirdie

@nebulon said in BigBlueButton - web conferencing system for on-line learning:

I took a brief look at the app and overall it appears to work. Thanks a lot!

Some things to improve:

I was not sure how to login with the pre-setup admin, since I didn't know the admin email address

The tests need also test admin login

The tests need some code cleanup

Since it is only the webfrontend as far as I can tell, the icon has to somehow reflect this

The postinstall docs need to mention the fact that the backend has to be adjusted to not use the default test backend

The Admin E-Mail address is the Mail FROM Address aka. CLOUDRON_MAIL_SMTP_USERNAME variable from e-mail addon also noted in the POSTINSTALL.md. As far as I am aware of I can not write the POSTINSTALL.md dynamically to display the env CLOUDRON_MAIL_SMTP_USERNAME.
So either I have to do a better job to explain how to get the E-Mail address from Terminal or the log or use a static e-mail address.
What would be the status quo to for this type of issue?
Will add the test for admin login as well (above issue again, hmm so static admin e-mail would be better?)
Understandable
Greenlight has no own Icon sadly, I would suggest the BBB Icon but in Green?
Will add that.

Cheers.

nebulon

For the email address, we use admin@server.local in such a case. Hopefully it is possible to change this later by the user, just like the pre-setup password?

BrutalBirdie

@nebulon said in BigBlueButton - web conferencing system for on-line learning:

For the email address, we use admin@server.local in such a case. Hopefully it is possible to change this later by the user, just like the pre-setup password?

Yes e-mail and password can be changed.
And I will use admin@server.local.

Thanks for the input.

BrutalBirdie

@nebulon Changes pushed.

jdaviescoates

@BrutalBirdie said in BigBlueButton - web conferencing system for on-line learning:

@jdaviescoates the Greenlight App is just the front end for BigBlueButton.
As @luckow mentioned BBB can be installed anywhere and Greenlight is just the front end which connects to a specific BBB instance or cluster to provide a UI etc.

Ah, yes. I actually realised Greenlight is just a front end because it's what we as the front end for the https://meet.coop BBB server.

I was just secretly hoping that because you'd posted about it in this thread about BBB itself, you were working on a package that included BBB itself too!

BrutalBirdie

Hey @luckow can you share your insights about BBB as App in Cloudron?

Referring to this conversation:

@jdaviescoates said in Cloudron 5.6.2:

@BrutalBirdie said in Cloudron 5.6.2:

I remember a conversation about BBB as App not being a good idea.

It could possibly be that BBB recommends bare metal servers because freeswitch (which it depends on) works best like that?

https://docs.bigbluebutton.org/2.2/install.html#minimum-server-requirements

But at the same time I have also heard of people using BBB on a VPS without any real issue.

I'd definitely love to have a BBB app!

And I think that once 6.0 with it's unified dashboard (whatever that exactly turns out to be) is out it'll also be easier to have a whole separate VPS dedicated to just Cloudron + BBB, which would help too I imagine.

cyberfreakde

Is the development still going on? I host my church meetings in bbb so I need it like 3 times a week. I currently have a extra server for that which costs a lot. Would be nice to have it in Cloudron directly

I found a container directly from BBB https://hub.docker.com/r/bigbluebutton/bigbluebutton
Although they say not suitable for production use, I would still love it use it. Did someone try it? I can't get it to run on docker.

jdaviescoates

@cyberfreakde I don't think anyone has started to package BBB for Cloudron yet as there isn't a stable BBB release that runs on Ubuntu 18.04 yet...

cyberfreakde

@jdaviescoates But if it is a docker container? I think it doesn't matter.

jdaviescoates

2.3-alpha-4 is out:

https://github.com/bigbluebutton/bigbluebutton/releases/tag/v2.3-alpha-4

jdaviescoates

@cyberfreakde said in BigBlueButton - web conferencing system for on-line learning:

I think it doesn't matter.

I think it probably does matter, otherwise @staff likely would've started trying to package BBB already (rather than waiting for a stable version that runs on 18.04)

girish

Technically speaking, @cyberfreakde is correct. It doesn't matter because container can even contain centos. But to keep our maintenance burden low, we only use Ubuntu 18 in containers. Mentally, this is the equivalent of having to maintain app packages for different distributions.

robi

@girish bbb-install.sh supports installing BigBlueButton 2.3 and coturn on Ubuntu 18.04.

BrutalBirdie

@robi said in BigBlueButton - web conferencing system for on-line learning:

@girish bbb-install.sh supports installing BigBlueButton 2.3 and coturn on Ubuntu 18.04.

Yes but 2.3 is not stable.

TL;DR
It's not time yet. ~ Sound warning!

I also talked to Fred Dixon some weeks before last Christmas about the state of 2.3.

Here a quote from him, which I gather from my memory (all statements without guarantee):

We will not give a release date because we only ship a functional product and don't work with due dates.
This only sets false expectations and leads to bad code.

I can share this 2.3-draft where you could get some information about current state of 2.3.

Lets talk BBB and turnserver.

There is a turn addon default by Cloudron.
Problem is, its a docker container cloudron/turn:1.1.0 running on port:

listening-port=3478
tls-listening-port=5349

This turnserver is kinda useless.
In short terms, a app is needed for turn, so the turn can listen to port 80/443.
Why?
Company / School with a firewall.
Only Ports 80,443,22,993,587 outbound is allowed. (Everything else blocked).
The turn server should now act like as a MITM (big empasis - like a) so this client can use webRTC via turn.
But since it's running on port 5349/3478 its useless.

afaik girish and nebulon are aware of this but it's not a big priority right now. (Which I fully support)
Also BBB takes a lot of resources. For running small sessions 2-5 People or even 10 it could work out.
But since BBB is running alongside other Apps this could lead to quite a problem if to many people turn on their webcam.

girish

@brutalbirdie said in BigBlueButton - web conferencing system for on-line learning:

afaik girish and nebulon are aware of this but it's not a big priority right now. (Which I fully support)

Actually, I am just fixing this for 6.1. I am trying out https://jitsi.github.io/handbook/docs/devops-guide/turn and hopefully that works. The main motivation for us is to move to using kopano meet internally and I suspect maybe this use of different port is what is causing many issues (which have been reported on this fourm). I hope the config there works because https://github.com/coturn/coturn/issues/43 was initially closed stating it was not possible (i.e turn requires a dedicated server to run on 443!)

doodlemania2

@girish That might also help nextcloud talk high perf backend too.

BrutalBirdie

@doodlemania2 ARG I think I read something about nextcloud talk not support turnservers with TLS?

"(D)TLS is currently not supported by Nextcloud Talk and does not have any real security benefit anyway. For more details see the changelog below." -- https://help.nextcloud.com/t/howto-setup-nextcloud-talk-with-turn-server/30794/93703

So be aware of this.

robi

What we really need then is a TURN server integrated with Nginx.

Doing a quick search I haven't found an extension for Nginx, but then I thought why not front the TURN server we have with Nginx as a proxy load balancer which can include port 80/443 and UDP ports.

This post goes into the configuration of something like that:
https://stackoverflow.com/questions/51566225/nginx-load-balancing-a-turn-server

@staff could easily adapt this to handle non HTTP traffic via the TURN server and the rest going to the Apps.

girish

@robi Yes, see the jitsi handbook link in my previous post.

jdaviescoates

@girish said in BigBlueButton - web conferencing system for on-line learning:

Actually, I am just fixing this for 6.1. I am trying out https://jitsi.github.io/handbook/docs/devops-guide/turn and hopefully that works.

Did this get into 6.1?

girish

@jdaviescoates unfortunately, no

luckow

Hi,

from time to time there is an app request for jitsi & BigBlueButton here in the forum. I would like to throw my 2 cents into this discussion.

First: We need a turn server on port 443 and 80 to help people join conferences. There are so many stupid networks / firewalls that a turn server is mandatory. Good news: We have a turn server as an app on Cloudron. Maybe later, it's possible to configure this app.

Second: What is the background to this request? A video conference with friends? Say up to 10 people on the server? A combination of moodle and BigBlueButton for your local school? All my experience with video conferencing for larger groups brings me to the conclusion: forget these apps on Cloudron. They are hungry. In terms of RAM, CPU and bandwidth. The underlying software stack is real-time critical. Better use bare metal instead of cheap VMs. For schools, you need a cluster of BBB nodes and an upstream load balancer. Because of latency, you need a hosting provider close to most of the people using the video conference. For really huge conferences you need a dedicated 10 Gbit network. You need a lot of customisation under the hood. In short, to have a reliable infrastructure for videoconferencing, you need a lot of time to dig deep into the subject.

(My) conclusion: We have Kopano Meet as an app. Let's make this app better for our use case (having a self hosted videoconference for our family and friends meetings). We have Greenlight as a frontend for dedicated BigBlueButton infrastructure. We can use Moodle, Nextcloud and WordPress as alternative frontends for BBB servers. We have Grafana and Prometheus for the metrics of BBB servers. We can use Statping.

Good news is:

The installation process for a dedicated BBB server is painless.
https://github.com/bigbluebutton/bbb-install

Wait for the configurable turn app on Cloudron or install a coturn yourself.

Click yourself a dedicated bare metal. Let's say https://www.hetzner.com/de/dedicated-rootserver/ax41-nvme
Install ubuntu 16 on it.
SSH into it
wget -qO- https://ubuntu.bigbluebutton.org/bbb-install.sh | bash -s -- -w -v xenial-22 -s bbb.example.com -e info@example.com -c <hostname>:<secret>
Install Greenlight on Cloudron
Take the output of bbb-conf --secret and put it into .env of Greenlight.
Restart the Greenlight app.
Happy videoconferencing with many users.

For a better understanding of "What's going on?" install https://github.com/greenstatic/bigbluebutton-exporter to your BBB instance and add Grafana and Prometheus to your Cloudron.

The basic installation of a dedicated Jitsi instance is also trouble-free.
https://jitsi.github.io/handbook/docs/devops-guide/devops-guide-quickstart

Since my larger conferences rely on BigBlueButton, I didn't feel the need to dig deep into jitsi's scaling. That's why I've installed jitsi meet on cheap VMs for up to 30 users.
But if you want to go deeper into this topic, here is a link to a talk by a maintainer of jitsi meet -> https://fosdem.org/2021/schedule/event/jitsi_scaling/

atridad

@luckow These are good points. I don't think its a bad idea to have the option (like with Jitsi) still but BBB specifically should stay out. Especially when considering how resource hungry it is and that it requires older versions of Ubuntu. That being said Cloudron should probably never be used for truly large scale conferences simply because those tasks are better suited for distributed setups behind a loadbalancer as you said.

I did also want to mention that there are cloudron instances that have more resources available. I'm running an i3-9100 and 128GB of RAM. My CPU and 300Mbps network bandwidth are the bottlenecks now and would still not be suited to this sort of high load scenario (large conferences)

jimcavoli

@atrilahiji I'm increasingly inclined to agree - and the Greenlight interface being available and usable by Cloudron LDAP seems like the best of all worlds for that split. That's a really elegant solution that meets needs in my opinion for anyone who needs heavier-duty conferencing.

girish

@luckow Thanks! I put your instructions here - https://docs.cloudron.io/apps/greenlight/#installing-bigbluebutton

jdaviescoates

@atrilahiji said in BigBlueButton - web conferencing system for on-line learning:

BBB specifically should stay out. Especially when considering how resource hungry it is and that it requires older versions of Ubuntu.

BBB 2.3 that'll work on Ubuntu 18.04 is getting there (currently alpha-8) and with Cloudron 7.0 we should be getting multi-host support, which would make it easier to give BBB it's own server.

I'd still love it on here!

atridad

@jdaviescoates yeah same. For me it’s mostly because I’m cheap. If I can avoid paying for a VPS I want to try. Everything I run now (except for my BBB backend) is on my home server

jdaviescoates

@atrilahiji heh, fair enough. Like lots of people I don't have good enough internet at home to be able to do that

jeau

Version 2.3 just released
https://github.com/bigbluebutton/bigbluebutton/releases/tag/v2.3.0

But the documentation is not yet up to date, especially about the installation which is now possible on Ubuntu 18.04 and about the improvements and new features.

jeau

@jeau read also this post 5 most exciting newly added features of BigBlueButton Version 2.3

luckow

Use the "official" ansible role for the deployment -> https://github.com/ebbba-org/ansible-role-bigbluebutton/tree/develop/2.3

luckow

Presentation foto for the new release. Taken from the release party.

girish

@luckow So, this one adds ubuntu 18/20 support?

luckow

@girish ubuntu 18 only.

doodlemania2

@luckow my BBB as a service is almost ready - if anyone is interested, DM me

doodlemania2

BBB as a service is now available for testing... DM me if you'd like to hook your Greenlights up to it.

luckow

@doodlemania2 where are the server instances located? I only have instances in germany. So no experience with other countries
If you need a nice default presentation which explains the BBB-UI go to Presentation_Slides -> BBB-default-slides_en.pdf https://cloud.ebbba.org/s/Q2i9FqZaPdjQKmM

doodlemania2

@luckow I have one in Southern California and another in Dallas, TX. Everything except presentations work (screen sharing, polls, chat, voice/video, presence, CC, etc all good). Will figure out presentations in a day or so.

DM me if you wanna give it a spin.

BrutalBirdie

@doodlemania2

Everything except presentations work

Did you use ansible? I just fixed a permission issue with bbb-web and bbb-html5 which blocked presentation parsing.

doodlemania2

@brutalbirdie nah, good ol docker compose

privsec

Any updates on a cloudron deploy-able package? I'd pay a separate fee for this app on a separate server, no questions asked.

jdaviescoates

@privsec I note it's one of the apps newly auto installable on Hetzner Cloud

a8edfe02576b44a6a8950dff89f6c2abd9ca86015829eeb7a3fd4effa30750b6.png

31c0fff8d2fee8fa371c32092e42855caa9210164164d3d9f7e3bd9b728bba1c.png

BrutalBirdie

@jdaviescoates but its bad, really bad! - And Outdated! 2.3.0 < 2.3.10
I maintain the official Ansible role for BBB and stay in close contact to at least 25 Admins from universities in Germany.
They basically uniformly agreed that the Hetzner BBB app is unusable for any real work with BBB.

The Ansible Role:
https://github.com/ebbba-org/ansible-role-bigbluebutton

privsec

This post is deleted!

privsec

@brutalbirdie said in BigBlueButton - web conferencing system for on-line learning:

@jdaviescoates but its bad, really bad!
I maintain the official Ansible role for BBB and stay in close contact to at least 25 Admins from universities in Germany.
They basically uniformly agreed that the Hetzner BBB app is unusable for for any real work with BBB.

The Ansible Role:
https://github.com/ebbba-org/ansible-role-bigbluebutton

Darn it. Was really hoping for a major win.

BrutalBirdie

@privsec use the ansible role and you have a major win.

I currently maintain multiple BBB clusters, Load-Balancers and Turn servers all via ansible and my work time for that is pretty much zero thanks to ansible.

Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.

BigBlueButton - web conferencing system for on-line learning