So I've switched the Trigorilla board in the printer with a SKR 1.3 with TMC2208 drivers and installed the latest Marlin 2.0, with a config based on this one. You can find the Configuration.h here, the only thing I changed in Configuration_adv.h was the pin of the hotend fan.
Now when let the printer autocalibrate the delta settings, it tells me that the height is 141.35 mm, instead of the actual ~300 mm and I had to set the radius to 78 mm, instead of the actual 115 mm so that it doesn't try to probe outside the bed.
What settings could I have set so horribly wrong that I get these results?