Thanks for the reply @MooCloud_Matt!
Proxmox is set to bridge and works with ipv4 without any problem.
But the problem is probably elsewhere, I tried opening the ipv6 test page on my laptop and it said my provider doesn't support ipv6, which is bullshit. I actually have two public ipv6s assigned from it.
So I would need to somehow run the installation with only ipv4, is it possible to do that?
alt text