Unable to use nvidia driver

I've had major trouble trying to get Nvidia driver to work on my HP OMEN 15-5250no 15,6". It has GeForce GTX 960M + Intel GPU. I'm ruing Ubuntu 14.04.4 LTS 64bit. Installed it like a month ago when I bought this PC. Xorg driver works, but Minecraft isn't ruing well with it (low FPS, some chunks fail to render, crashes). I've tried at least 5 different versions of nvidia driver, including 361 and 364.

I always get one of these issues:

• black/blank screen when I hear the login sound (sometimes starts to work if I wait over 10min)
• login loop (with all users, but only when using nvidia driver)
• it just uses intel GPU.

I've tried different keels:

• linux-image-4.2.0-35-generic: After I hear the login sound, I have to wait over 10min until I get a login screen. Then it will work fine and actually use the Nvidia driver. With nvidia-361 I get nice performance with Minecraft even. But I don't really want to wait for 10-30min every time I login.
• linux-image-4.5.3-040503-generic: Renames my xorg.conf into xorg.conf.<date> and resets prime setting from nvidia to intel. So I caot use the Nvidia driver to get some performance on Minecraft.
• linux-image-4.6.0-040600rc2-generic: Login loop with nvidia driver.

Me and the users on #ubuntu @ Freenode IRC chael are ruing out of ideas. What else could I try?