Unfortunately Doomsday has some issues like this with antialiasing at the moment. It might still work correctly if you launch with antialiasing enabled, either with the -fsaa command line argument or by quitting and restarting after turning on AA (while the view is frozen; you can press alt-F4 a few times on Windows, for example).
Oh well, then it must be that Doomsday isn't getting along with your OpenGL drivers. To restore the defaults (no antialias) I recommend deleting the file "persist.pack" in your runtime folder. If you're on Windows, this should be "\Users\{username}\Documents\Doomsday Frontend\runtime".
persist.pack is where Doomsday stores the video config options etc.
Nope, antialiasing works on the 750 Ti with latest drivers, Windows 10. You may want to check that the driver isn't configured to force any options and instead should let the application decide.
Comments
persist.pack is where Doomsday stores the video config options etc.
Windows 10 64bit
Gtx 980 ( latest Drivers )
16gb 2400mhz ram
500g SSD
i5 3ghz ( haswel )
All Drivers and windows updates all upto date.
I really want to enhance the graphics as much as I can
I'll take a look if I can reproduce this on my Nvidia card, although it is only a 750 Ti.