Best posts made by doodlemania2

I have begun to package this today. Hope to have something for comment in the next few days.

cc: @marcusquinn

This app is now up and functional. Please test! I'll submit to the appstore for WIP in a day or so after some more cleanup and testing.

https://git.cloudron.io/doodlemania2/paperless-ng/

Note: inbound mail is enabled, but you have to configure it yourself in paperless config. I haven't tested that yet and from the looks of the repo, there are lots of issues with mail at the moment, so we may ship unstable without inbound mail.

cc: @girish

@robi Here's the recording yall if you like:
https://video.apps.thedoodleproject.net/videos/watch/e7125134-fca9-4c0a-9d29-69cf19eb2464

The encoding was a bit off between audio and video. Not sure what that was about.

As for tech used to produce this glorious (haha) event - writing up a blog entry on that today/tomorrow and will publish if anyone was curious.

Goodnight all - and go paperlessng!

All - I have begun packaging this based on instructions found here as well as basing it off of PHP Lamp. It's still VERY rough (IE, doesn't fully build yet), but would appreciate some eyes on it.

https://git.cloudron.io/doodlemania2/pixelfed

Currently, I'm trying to decide whether the initial setup goes in Dockerfile (would think so) or in start.sh in the uninitialized section. It's been a VERY long while since I attempted to package something, so am more than a little rusty

Also, my run.sh is doing an artisan migrate force on each run - thinking that is a good thing cause run wouldn't know if the container updated, but maybe there's another pattern somewhere that is better.

cc: @girish

@doodlemania2 If anyone is still interested, I'm game to doing another event. Maybe only loosely related to app packaging, maybe we do an educational series or something about how to use the CR.

As an aside, you are all now welcome to use my BBB/Greenlight I have up and running!

@doodlemania2 I've got this thing to a heartbeat status but it has lots of dependencies flying around - trying another approach to packaging to squash em. Will advise on first checkin.

@doodlemania2 Latest checking (simple one tonight) - I switched from supervisor to the build in gunicorn runner and was able to create a username/password and log in! Woot

Now, it's throwing errors about attempt to write to a read only database, so I suspect the auth mechanism is doing something in /app/code that I'll need to symlink.
After that is:
Get the supervisors to work (some weird ini file error)
Test the app
Cleanup
Final commit before handing it off for cloudron test dev in case anyone wants to see it in the app store.

this is ready for testing - please send me a DM if you'd like to try it out!

@sam_uk I'm going to try next week when things at work calm down a bit.

I have a Nextcloud Talk High Performance Backend and BBB (for your Greenlight app) available for your use.

If you'd like to use it, I'm offering it for free*. Just DM me for details.

*I will likely start charging in the not terribly distant future, but am open to understanding:

1. Does anyone think this is useful?
2. What would you be willing to pay?

I'm thinking $1-2 US / mo for up to 10 users. Eh? Really the only expense is bandwidth and just a hair of admin overhead. Would welcome your thoughts. Not in it to make $$$, just cover costs.

@doodlemania2 If anyone is interested - I know some of you weren't keen on my original service cause it was US based (Latency being the top questions).

So, happy to announce I'm now up and running in Frankfurt, so if you'd like to leverage either of those tools (or anything else I offer hosting for), let me know. See www.thedoodleproject.com for details if you are curious.

@doodlemania2 Here's my blog on packaging, love of cloudron, and how I set up my broadcast. https://www.derekmartin.org/my-favorite-way-to-host/

@bubonicfred I am starting to package this fork since I am stuck on Papermerge. Hopefully this one will be a bit more cooperative. Will post link when I get something resembling functional.

@doodlemania2 My initial commit is here: https://git.cloudron.io/doodlemania2/paperless-ng

THIS DOES NOT YET WORK

But - I need to do these things and I think it's done:

1. sed in the environment variables to the config
2. create the start.sh (with #1 above)
3. setup the three services in systemd

I've done all of the above previously, I just am short on time, so, if anyone can give me an assist, would greatly appreciate it! If not, will continue just as quick as I can.

@doodlemania2 just an fyi - this is working well, but the "consumption" directory isn't polling so still tinkering with that. I am able to upload manually and auto tagging and pdf extraction is working. so, we're about 95% there I think.

@jimcavoli alrighty - that seems to have worked (running it with cloudron scheduler). now just need someone to help me with tests and it can ship!

@kaxline I might could package this for you if you send me the instructions for how you did it in LAMP stack!

@jdaviescoates I haven't yet and I feel really bad about it - work has been all consuming of late. It's literally at the top of my list, just haven't had a chance! I promise more soon fast as I can!

Time to rip the bandaid off!
I'll start at 3PM EST this Friday and broadcast for one hour. Might even record it if I can find a button for that. Will send out a link later in the week to this thread on how to join. Will walk through how I package, what I'm currently packaging and how (paperlessng), my current state, and where I'm currently at. Can crowdsource after the fact.

Just a quick update to those watching this space. I've got the app loading the DB and getting up and running now. Last things to deal with are:

1. An apache error that throws out a 403, probably my .htaccess
2. Moving the logs to /run
3. Try one more time to leverage /app/code but at least this way works!

@marcusquinn Thank you all so much! That was so much fun I'll post more, including replay and "how I did that" in a while.
We also have a volunteer for next session "Tomer" - I'll work with them to firm up the tooling.

It's destined to be a standard app for Cloudron so will support server reboots, etc. Some tweaks will need to be made by the CR teams for it to move into the app store but will work with them on those over the coming days.

@doodlemania2 ahaha!

So apparently if you DONT click that button, it doesn't get saved in PeerTube. Let that be a lesson for ya. Suffice to say - I did a secondary recording just in case. And it's uploading now

Following closely. I've offered to package this and seatable as soon as they get ready!

this is huge! welcome @bram - big fan of your app!!!!

I've got a very early prototype of this working - it just needs some API fun from the Cloudron TURN feature sets. https://git.cloudron.io/doodlemania2/nthpbe

Could we get per app bandwidth consumption graphs!? Pretty please!!!!

Just tracking note here so others can see. I'm starting to package InfluxDB. Probably will get 1.x before 2.0 as 2.0 is wildly different and seems to have some issues changing the default storage path (working through that though) Will see. Stay tuned if you are interested.

@doodlemania2 latest checkin has the start.sh and systemd files getting checked in. Still iterating as time permits.

If you are running Mastodon and would like to leverage an open relay I'm running to help ... relay, please reach out to me and I'll share the address.
Open relays are allow smaller instances to become more connected by relaying their traffic to other participants. The biggest one, mastodon.host recently went offline which severely hampered smaller shops.

BTW - this relay also works for any app that uses ActivityPub, so almost everyone.

You can reach me on mastodon (at)derek(at)toot.thedoodleproject.net

Feature request to view network traffic (in/out) by App in Box

Today at 3PM Eastern US Time, I'll be hosting (or trying to - it's the first one!) an app packaging event.

If you'd like to join, I will be on chat here:
https://matrix.to/#/#apppackaging:thedoodleproject.net

And the livestream will be here:
https://video.apps.thedoodleproject.net/videos/watch/d0e86f98-2ec4-4e24-967b-8711944f0e58

Again, this may or may not work, but I've practiced a few times and will be around to show what I do and we can chat.

Hope to see you there!

Would it be possible to get a measurement of bandwidth used per month per container (in and out)?

https://github.com/StreisandEffect/streisand implements an outstanding VPN (more than just OpenVPN) solution for dummies to use. Full Ansible scripts available to construct VMs.
Other features include:
L2TP/IPsec using Libreswan and xl2tpd
A randomly chosen pre-shared key and password are generated.
Windows, macOS, Android, and iOS users can all connect using the native VPN support that is built into each operating system without installing any additional software.
Monit
Monitors process health and automatically restarts services in the unlikely event that they crash or become unresponsive.
OpenSSH
Windows and Android SSH tunnels are also supported, and a copy of the keypair is exported in the .ppk format that PuTTY requires.
Tinyproxy is installed and bound to localhost. It can be accessed over an SSH tunnel by programs that do not natively support SOCKS and that require an HTTP proxy, such as Twitter for Android.
An unprivileged forwarding user and SSH keypair are generated for sshuttle and SOCKS capabilities.
OpenConnect / Cisco AnyConnect
OpenConnect (ocserv) is an extremely high-performance and lightweight VPN server that also features full compatibility with the official Cisco AnyConnect clients.
The protocol is built on top of standards like HTTP, TLS, and DTLS, and it's one of the most popular and widely used VPN technologies among large multi-national corporations.
This means that in addition to its ease-of-use and speed, OpenConnect is also highly resistant to censorship and is almost never blocked.
OpenVPN
Self-contained "unified" .ovpn profiles are generated for easy client configuration using only a single file.
Both TCP and UDP connections are supported.
Client DNS resolution is handled via Dnsmasq to prevent DNS leaks.
TLS Authentication is enabled which helps protect against active probing attacks. Traffic that does not have the proper HMAC is simply dropped.
Shadowsocks
The high-performance libev variant is installed. This version is capable of handling thousands of simultaneous connections.
A QR code is generated that can be used to automatically configure the Android and iOS clients by simply taking a picture. You can tag '8.8.8.8' on that concrete wall, or you can glue the Shadowsocks instructions and some QR codes to it instead!
AEAD support is enabled using ChaCha20 and Poly1305 for enhanced security and improved GFW evasion.
The simple-obfs plugin is installed to provide robust traffic evasion on hostile networks (especially those implementing quality of service (QOS) throttling).
sslh
Sslh is a protocol demultiplexer that allows Nginx, OpenSSH, and OpenVPN to share port 443. This provides an alternative connection option and means that you can still route traffic via OpenSSH and OpenVPN even if you are on a restrictive network that blocks all access to non-HTTP ports.
Stunnel
Listens for and wraps OpenVPN connections. This makes them look like standard SSL traffic and allows OpenVPN clients to successfully establish tunnels even in the presence of Deep Packet Inspection.
Unified profiles for stunnel-wrapped OpenVPN connections are generated alongside the direct connection profiles. Detailed instructions are also generated.
The stunnel certificate and key are exported in PKCS #12 format so they are compatible with other SSL tunneling applications. Notably, this enables OpenVPN for Android to tunnel its traffic through SSLDroid. OpenVPN in China on a mobile device? Yes!
Tor
A bridge relay is set up with a random nickname.
Obfsproxy is installed and configured with support for the obfs4 pluggable transport.
A BridgeQR code is generated that can be used to automatically configure Orbot for Android.
UFW
Firewall rules are configured for every service, and any traffic that is sent to an unauthorized port will be blocked.
unattended-upgrades
Your Streisand server is configured to automatically install new security updates.
WireGuard
Linux users can take advantage of this next-gen, simple, kernel-based, state-of-the-art VPN that also happens to be ridiculously fast and uses modern cryptographic principles that all other highspeed VPN solutions lack.

@jdaviescoates thanks! hi @thetomester13 didn't catch that earlier.
Blog on how I did all this coming in a few.

This is something I've personally been looking for forever! So, great find. Given the proprietary bits, we likely CAN package it as CE and then one would need to just 'upgrade' it per their terms. CR does this with another package (Confluence maybe?) already.

The compose file looks like we could take it apart for CR based use decently, but we'd really need the original Dockerfile files to really do it. Those don't appear to be published anywhere accessible. If you find them, I'd be happy to take a closer look at packaging it for you.

The alternative looks VERY promising, but they are brand new (baserow) and haven't published a repo yet.

@thetomester13 this was such a great session today! kudos on the efforts and excited to see phase 2 - xpath for the...uh... ewe! hehe

You can clone the repo locally and deploy it with the Cloudron CLI: https://cloudron.io/documentation/custom-apps/cli/#installing

I can attest that it is definitely NOT a good idea to add more Docker images to a CR box outside of CR. CR assumes it has full use of the box, so, anything additional you add can and possibly will break things

That's a lot of pieces! I'd be happy to look at packaging it @oj but will have to do quite a bit of research to see what all is involved. I was thinking it was just that one needed the spreed signaling. Will give it a go!

Chronograf is an open-source web application written in Go and React.js that provides the tools to visualize your monitoring data and easily create alerting and automation rules.

https://www.influxdata.com/time-series-platform/chronograf/
https://github.com/influxdata/chronograf

An initial packaging of Chronograf is now available for comment: https://git.cloudron.io/doodlemania2/chronograf

@murgero hi yall, storj miner here. Great solution, works just fine. I'm currently sharing about 5TB out of an allotted 8TB and earn about $10/mo. Packaging this for Cloudron would certainly be interesting. It's obviously a Docker container, but would feel "weird" in the context of cloudron. I don't see any major gotchas on doing it - there is even a web interface to show stats that you could throw behind the new auth addon.

An app like Firefox Relay would be amazing: https://relay.firefox.com

All - I wanted to report back and not just be a flake - I've been saddled with a crazy go nuts project at work and won't be able to work on this for a while. I've really very sorry, I had gotten everything loaded and was about to start

I hope another app_dev person can pick this up!

I've packaged this here: https://git.cloudron.io/doodlemania2/pixelfed it's just waiting for review but works if you'd like to try it out.

@luckow Given the issue with BBB and recording, I've got that disabled on my service. Great points all around. Again, this is for the small shops that need a place.

@girish I can help with this doc when you're read sir - I've got a PiHole on the public internet and simply block all requests at the router except requests from my IP address. If I'm not mistaken, we'll have some sort of control in 6 to whitelist/blacklist access by IP address to an app?

might have committed directly to master teehee

Mastodon is published. I've also pushed Pixelfed if you are interested, pending app store approval.

The app is finished packaging and works pretty well! Final Cloudron specific tweaks like tests, medialinks, etc and then I guess it can publish. If you want it now, you can grab it from my repo: https://git.cloudron.io/doodlemania2/pixelfed and do cloudron install

@girish woohooo!!! TURN server API!!!

@marcusquinn on the Talk front, we're packaging Nextcloud Talk High Performance Backend, so you should be able to scale up nicely soon(ish)

Happy to look at packaging it for you. May need some testers. Currently tilting between seatable and this as my next attempt.
+@mehdi just FYI

I've got BBB up and running and am happy to share access to it if you want to wire your Greenlight up. Just let me know. Obviously, smaller CRs. It's got some beefy specs, but I don't wanna get my teeth kicked in hehe.

Yep! I hear they are working on it soonish. +@girish FYI

@doodlemania2 Everyone okay with Jitsee Meet for this? I can use mine or we can use @girish 's on the main CR if that'd be more appropriate. Not sure if it supports recording though...
hmmm - maybe I should use PeerTube's new live streaming...

So, good news, I've got this working in the Cloudron Base image (I think?) using the signaling test client. My next step will be to wrap things up and start testing against live NextClouds. Currently, I'm thinking I'll disable ALL security since it will only be reachable by a local, on box Nextcloud. Open to suggestions on that.

This isn't an endorsement, but I got a "feels too good to be true" deal from ssdnodes.com if anyone wants to check them out. I'm putting my purchase through its paces to see if it holds up to the advertised specs now. Here's my reference link if you are interested.

I'm a volunteer app packager but avid user of Cloudron - it's the simplest thing I've ever done and a great community of folks working to enhance the catalog of apps. It's built to just work!

I've got this ready for #unstable with just a few tweaks needed. There's an upstream issue that prevents installing marketplace items from the in app marketplace (licensing really) that I'll try to document over the coming days how to work with. cc: @girish https://git.cloudron.io/doodlemania2/vs-code
Hat tip to @murgero for the bulk of the hard work!

@yusf I wish it was - too many unknowns from that list as to which files are which, etc. I've asked them again if they are interested in being packaged. Will revert if they reply!