Installing a Graphics Card In Your Mac Pro 1,1, 2,1, or 3,1 (2006 or 2008)
Begin by disconnecting your Mac Pro's power cable and any display monitors currently connected to the back of the Mac Pro. Remove the side panel of the computer by lifting the tab with a picture of a lock. The inside of your computer should look like Figure 1, with the gray fan on the left and your current graphics card on the right.
Take note of the two small black clips located next to the top of the fan (A), they will be used momentarily.
Loosen the thumbscrew (B) and the matching one above it. Remove the retaining plate that they were holding. Remove the bottom-most PCIe cover (C). This is necessary to accommodate the larger fan on your new graphics card. You may now remove your current graphics card by gently rocking it back and forth while pulling it towards you out of the Mac Pro.
Refer back to the black clips mentioned earlier (Figure 2). If your GPU came with power cables this is where you will connect them (some smaller cards do not require and thus do no come with power cables). Insert the small black end of each power cable into the clip until they "snap" into place.
Before inserting your new graphics card take note of the bottom-most PCIe slot (D). Just like your old graphics card, your new graphics card has a connector tab along its edge that will fit in this slot. Make sure to line up the connector tab and the PCIe slot correctly and apply gentle pressure until the card "snaps" into place. This should not involve excessive force. If the card does not seem to be inserting correctly remove it and check the alignment again.
Insert the large end of the power cables into your graphics card, as shown in Figure 6. Installation complete! Replace the retaining plate and tighten the thumb screws. Replace the Mac Pro's side panel, reconnect the power cable, and reconnect your display monitors. Turn on your computer and enjoy!