For the AArch64 Linux enablement, support was added to the Linux 3.7 kernel, has been merged for the next release of the GCC compiler, and other GNU/Linux components are beginning to see this ARMv8 support work.
Via a small patch, AArch64 support for the X.Org Server is beginning. "AArch64 is the new 64 bits architecture from ARM, for which a few definitions are needed in the X.org server to make it build properly. Like for the ARM 32 bits architecture, we for now assume that AArch64 will be used in Little Endian mode for Linux."
At least now the X.Org Server can build properly on the 64-bit ARM architecture. Though by the time AArch64 hardware begins shipping next year, hopefully Wayland will be more common place. It will also be interesting to see if any of the SoC vendors are more open with their graphics drivers for the future ARM hardware.