Performance When Playing FOSS Games on Libre Kernel

I am not sure about rules regarding necroing threads so while I saw some similar threads they were from almost a year ago so I decided to start a new one.
My question is whether trying to play FOSS games on a FSF approved OS is a fools goal ? I have been trying it out the last six months or so on a spare system and can't say I am seeing it as a viable option. So right away by doing this I am currently limited to an Intel HD 4600 GPU on my i7-4770 or a GTX 760 using Nouveau drivers if I embark on this path. I have tried games like Red Eclipse; Super Tux Kart; and Yorg so far and the results have been basically an average of 30-40 FPS on lowest settings using the HD 4600 and an average of 20-30 FPS on the GTX 760. I also tried a GTX 780 Ti using Nouveau and at best could match the HD 4600 and other times lose to it as well. I could try to upgrade the CPU to a newer Intel model but not sure even the Xe models could give me what I want. On my main system which uses an RX 580; Manjaro and a non libre kernel I am used to 100+ FPS at highest settings.
It seems that when you try to go too pure you reach a point of dimenshing reults in other areas very fast. The easy answer is to simply continue to use a non libre kernel and enjoy my FOSS games but the logic I keep bumping against in my head is if I accept that then why deprive myself of non free games ? Curious to hear other opinions or ideas I hadn't thought of.
My question is whether trying to play FOSS games on a FSF approved OS is a fools goal ? I have been trying it out the last six months or so on a spare system and can't say I am seeing it as a viable option. So right away by doing this I am currently limited to an Intel HD 4600 GPU on my i7-4770 or a GTX 760 using Nouveau drivers if I embark on this path. I have tried games like Red Eclipse; Super Tux Kart; and Yorg so far and the results have been basically an average of 30-40 FPS on lowest settings using the HD 4600 and an average of 20-30 FPS on the GTX 760. I also tried a GTX 780 Ti using Nouveau and at best could match the HD 4600 and other times lose to it as well. I could try to upgrade the CPU to a newer Intel model but not sure even the Xe models could give me what I want. On my main system which uses an RX 580; Manjaro and a non libre kernel I am used to 100+ FPS at highest settings.
It seems that when you try to go too pure you reach a point of dimenshing reults in other areas very fast. The easy answer is to simply continue to use a non libre kernel and enjoy my FOSS games but the logic I keep bumping against in my head is if I accept that then why deprive myself of non free games ? Curious to hear other opinions or ideas I hadn't thought of.