My motherboard doesn't have a HDMI Port but my GPU does.
More about motherboard hdmi port gpu
You connect the GPU to your monitor.
Is it through the back of the case?
Yes , use a connection from the card to your monitor.