With Nvidia, you do not have an option. With AMD, the situation is much better, but the free driver still has plenty of room for improvement. They released the specs, are helping the development, but they are keeping their special secrets for themselves. Fine.
What I find really difficult to comprehend is people who come on a Linux forum and keep insisting that open source is wrong and people demanding open drivers are stupid.
No, I don't mean you, but you've read these posts too.