Embedded Graphics in Dell Poweredge T110 II and a new Graphics Card

I have a Dell Poweredge T110 II Bios Rev 2.0.5. I put in a VTX Raedon HD 5450 graphics card and the computer starts with a black screen and a tiny white horizontal blinker at the top left corner. It just freezes on that so I am unable to disable the embedded graphics. I have reset the BIOS and CMOS.
I have disconnected all except the basics.
Should I try installing the 5450 graphics drivers or trying to plug and play the card? I know I shouldn't do this, I understand the process for installation and I have to work around the basics which I understand to find a solution and would appreciate some constructive input.