I've been thinking it over for a bit, since last night.
I watched a video about what what makes a computer a good video editor. Seems it's several things (we knew that), CPU, GPU, Ram, Motherboard, and some other stuff.
What stuck in my head is he mentioned CPU several times and at different parts of the video. In fact when choosing between the top of the line GPU and CPU, go with the CPU and use a moderate GPU.
So that's what I'm going to do, slowly. I start a new job next week so I'll be saving up some bucks for this venture.