There wasn't any work to do at all once the firmware was done the right way (KVM works out of the box in this case). So kudos to the guys who ported ATF+UEFI to this board, that was the right thing to do.
The branch I was mentioning:
is now fairly outdated but is enough to get things going (don't use the MMC for anything but loading the kernel, it is broken - USB is your only hope). Oh, and you'll need to fiddle with the device-tree, because it is utterly broken.
Unfortunately, the way development is done for this board makes it impossible to follow (the git tree is an absolute mess), the mainlining effort seems to progress at a glacial pace, and this looks more and more like a RPi-like effort (no, this is not a compliment).