Even though the HDMI port in my GPU is HDMI 2.0b and should support 4K tried using the same setup in windows and both displays work perfectly at 4K So this is not a hardware issue, rather it's some weird software issue where MacOS is just not allowing the GPU to run a display at over HDMI. After setting everything up and trying 3 different HDMI 2.0 supported cables, I realized that Mac doesn't support over HDMI. I am using DP for the first display and HDMI for the second. I recently purchased two Samsung U28E590D 4K monitors.
