Just a minor note: it does not _have_ to be a GPU: any many-core CPU will provide for good training, too.
E.g. with (old used) MacBook Pros you...