I could not migrate the database until I deleted the tables in Cloudron that caused the problem. After that, everything worked out. These tables were repeated in a dump.
Ah indeed, that makes sense, those are created during initial app startup. Not sure if the database migration guide should mention some drop tables command to have a fresh start.