I've been using Yosemite pretty well in a very stable system (Nvidia Drivers, Asus Motherboard, i5 , 16GB, SSD, etc). Everything works fine.
Does it make sense to upgrade to El Capitan? I'm using most of the time Google Chrome, Terminal (hombrew unix tools, docker, etc), mainly for server side...