Exchange the CEC enclosure PCIe four-port card

Before you begin

Icon for electrostatic discharge wrist strapUse approved ESD procedures to prevent damage.

Attention:
  • This procedure is not a stand-alone procedure. Customer disruption and damage to the hardware might occur when microcode and power boundaries are not in the proper conditions for this service action.
  • If a serviceable event FRU repair directed you to this procedure, the microcode and power boundaries are already set.
  • If a serviceable event FRU repair did not direct you to this procedure, see MAP1230 Replace a FRU without using a serviceable event.
Notes:
  • All the cables and FRUs to be removed must be uniquely identified so they can be reinstalled correctly.
  • If an installed earthquake resistance kit prevents you from accessing this FRU, refer to MAP1600.

Preparing the CEC enclosure to remove and replace the PCIe four-port card

Procedure

  1. Use a replacement part with a valid DS8000® part number to ensure it has the proper firmware, VPD, and/or configuration to ensure it is compatible with the DS8000 service procedures. Attempting to use a generic server FRU might fail and require next level of support to recover.
  2. All parts being removed must be marked or identified so they can be installed into their original locations.
    Note: Failure to do this can extend the service duration and may require next level of support assistance.
  3. The management console keyboard can be moved between the operating and stowed position as needed to allow service clearance above the CEC enclosure.
  4. Use the front and rear blue identify LEDs to determine the CEC enclosure to be repaired. Both blue LEDs should be lit.
    • CEC control panel blue identify LED Callout label B as shown in Figure 1.
    • CEC enclosure rear blue identify LED Callout label 1 as shown in Figure 2.
    Note: If both the front and rear CEC enclosure identify LEDs are not lit, use the location code listed in the serviceable event FRU list. See MAP1245 Finding FRUs by using location codes.
    Figure 1. Control panel LEDs
    Control panel LEDs
    Figure 2. CEC enclosure rear LEDs
    Rear view of the CEC enclosure LEDs
  5. Verify that the CEC enclosure is in the power-off state. See Figure 3.
    1. At the rear of the CEC enclosure, view all CEC enclosure power supply DC LEDs.
    2. Are all DC (output) LEDs flashing?
    Figure 3. Location of the power supplies and LEDs (Models 980, 983, 984)
    Location of the power supplies and LEDs (Model 980)
  6. Use the flashing slot-identify LED to confirm the location of the adapter to be replaced.
  7. Attach the electrostatic discharge (ESD) wrist strap.
    Attention:
    • Attach an electrostatic discharge (ESD) wrist strap to an unpainted metal surface of your hardware to prevent the electrostatic discharge from damaging your hardware.
    • When using an ESD wrist strap, follow all electrical safety procedures. An ESD wrist strap is used for static control. It does not increase or decrease your risk of receiving electric shock when using or working on electrical equipment.
    • If you do not have an ESD wrist strap, just prior to removing the product from ESD packaging and installing or replacing hardware, touch an unpainted metal surface of the system for a minimum of 5 seconds.
  8. Disconnect the power cords Callout label B from the CEC with the DC (output) LEDs flashing. See Figure 4.
    Notes:
    • Ensure the power cords are correctly labeled.
    • The power supply LEDs might continue to flash for up to 20 seconds while internal power is discharged.
    • The power cord is fastened to the system using the hook-and-loop fastener Callout label A. Unstrap the fastener to allow the enclosure to be placed in the service position.
    Figure 4. Removing the power cords (Models 980, 983, 984)
    Removing the power cords (Model 980)
  9. Observe the CEC enclosure control panel green power button LED Callout label A. See Figure 5.
    • If it is off, go to the next step.
    • If it is flashing, the CEC enclosure is still in the power-off state. DO NOT CONTINUE. Ensure that you have unplugged the power cables.
    Figure 5. Control panel LEDs
    Control panel LEDs
  10. Disconnect all remaining cables from the rear of the CEC enclosure. See Table 1 and Figure 6.
    Table 1. CEC enclosure cable connections
    Connection Description
    P1-T1 (HMC 1) FSP Ethernet
    P1-T2 (HMC 2) FSP Ethernet
    P1-C7-T1, P1-C7-T2, P1-C7-T3, P1-C7-T4 PCIe to I/O enclosures (2U)
    P1-C8-T1, P1-C8-T2 i2c to RPCs
    P1-C10-T1, P1-C10-T2 LPAR Ethernet
    P1-C10-T3, P1-C10-T4 Customer network (optional feature, if used)
    P1-C11-T1, P1-C11-T2
    P1-C11-T3, P1-C11-T4    		 Customer network (optional feature, if used)
    P1-C12-T1, P1-C12-T2 RS485 to RPCs
    Figure 6. CEC enclosure location codes (rear view) (Models 980 and 984)
    CEC enclosure location codes (rear view)
  11. Remove the front cover.
    1. Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
    2. Remove the two shipping screws Callout label A (if present) that secure the system to the rack.
    3. Pull the cover away from the system. The cover has an indentation where you can hold onto it more easily.
    Figure 7. Removing the front cover
    Removing the front cover
  12. Place the CEC enclosure into the service position.
    1. Remove the front screws Callout label A (if present) that secure the enclosure to the rack.
      Figure 8. Removing the front screws
      Removing the front screws
    2. Release the side latches Callout label B and pull the latches to slide out the enclosure assembly.
      Figure 9. Releasing the side latches
      Releasing the side latches
  13. Remove the service access cover.
    1. Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
    2. Release the latch by pushing the release latch Callout label A in the direction shown.
    3. Slide the cover Callout label B off the system unit. When the front of the service access cover has cleared the upper frame ledge, lift the cover up and off the system unit.
      Attention: For proper cooling and airflow, replace the cover before turning on the system.
    Figure 10. Removing the service access cover
    Removing the service access cover
  14. Attach the electrostatic discharge (ESD) wrist strap. Your system has an ESD pin on the backplane as shown in Figure 11. Attach the ESD wrist strap to the ESD pin.
    Attention:
    • Attach an electrostatic discharge (ESD) wrist strap to an unpainted metal surface of your hardware to prevent the electrostatic discharge from damaging your hardware.
    • When using an ESD wrist strap, follow all electrical safety procedures. An ESD wrist strap is used for static control. It does not increase or decrease your risk of receiving electric shock when using or working on electrical equipment.
    • If you do not have an ESD wrist strap, just prior to removing the product from ESD packaging and installing or replacing hardware, touch an unpainted metal surface of the system for a minimum of 5 seconds.
    Figure 11. Location of the ESD pin
    Location of the ESD pin

Removing the CEC enclosure PCIe four-port card

About this task

To remove the CEC enclosure PCIe four-port card, complete the following steps:

Procedure

  1. Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
  2. To set the adapter latch Callout label A at the target slot into the open position, rotate the latch Callout label A on the rear of the system, in the direction shown in Figure 12.
  3. Carefully grasp the adapter Callout label B by its top edge or tailstock, and remove the adapter from the slot, as shown in Figure 12.
    Attention: A pin on the tailstock of the adapter resembles a removable screw. Do not remove this pin. It is required for correct alignment and seating.
    Note: If adapter port filler plugs are present, note their locations and remove them. Retain the plugs for use with the new adapter.
    Figure 12. Removing a PCIe adapter from a rack-mounted system
    Removing a PCIe adapter from a rack-mounted system
  4. Place the removed adapter on an approved ESD surface.

Replacing the CEC enclosure PCIe four-port card

About this task

To replace the CEC enclosure PCIe four-port card, complete the following steps:

Procedure

  1. Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
  2. If necessary, remove the adapter from the antistatic package.
    Attention: Avoid touching the components and gold connectors on the adapter.
  3. Place the adapter, component-side up, on a flat, antistatic surface.
    Attention: A pin on the tailstock of the adapter resembles a removable screw. Do not remove this pin. It is required for correct alignment and seating.
  4. If the adapter latch Callout label B at the target slot is not already in the open position, pull the latch into the open position by rotating the latch outwards from its clip on the back of the system, as shown in Figure 13.
  5. Carefully grasp the adapter by its top edge or tailstock, and align the adapter with the slot and its connector on the system backplane, as shown in Figure 13.
  6. On the system, press the adapter firmly into its connector.
  7. If port filler plugs were removed from the old adapter, install them in the same port locations in the new adapter.
  8. To lock the adapter in its slot, rotate the adapter latch Callout label B in the direction that is shown in Figure 13.
    Figure 13. Installing or replacing a PCIe adapter in a rack-mounted system
    Installing or replacing a PCIe adapter in a rack-mounted system

Preparing the CEC enclosure for operation after removing and replacing the PCIe four-port card

About this task

To prepare the system for operation, complete the following steps:

Procedure

  1. Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
  2. Replace the service access cover.
    1. Slide the cover Callout label B on to the system unit.
    2. Close the latch release Callout label A by pushing it in the direction shown.
    Figure 14. Installing the service access cover
    Installing the service access cover
  3. Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
  4. Place the CEC enclosure into the operating position.
    1. Ensure that you have the electrostatic discharge (ESD) wrist strap attached. If not, attach it now.
    2. Unlock the blue rail safety latches Callout label A by lifting them upward.
    3. Push the system unit Callout label B back into the rack until both system unit release latches lock into position.
    4. Secure the enclosure to the rack with screws, if screws were removed when preparing the enclosure for service.
    Figure 15. Placing the CEC enclosure into the operating position
    Placing the CEC enclosure into the operating position
  5. Replace the front cover.
    1. Slide the cover onto the system.
    2. Close the release latches by pushing in the direction as shown in Figure 16. The cover snaps into place and has an indentation where you can hold onto it more easily.
    3. Replace the shipping screws Callout label A.
    Figure 16. Installing the front cover
    Installing the front cover
  6. Attach the electrostatic discharge (ESD) wrist strap.
  7. Reconnect all cables, except for power cords. See Table 2 and Figure 17.
    If optical Ethernet connections are used, use proper cleaning procedures.
    Important: The optical cable plugs (LC connectors) and ports (SFPs) must be cleaned before connecting them. Use cleaning tool 54Y4392 or IBM-approved alternative. After cleaning SFPs with the tool, use air bulb 45D2645 or IBM-approved alternative. For detailed procedures, refer to current DS8000 Info Alerts or contact your next level of support.
    Table 2. CEC enclosure cable connections
    Connection Description
    P1-T1 (HMC 1) FSP Ethernet
    P1-T2 (HMC 2) FSP Ethernet
    P1-C7-T1, P1-C7-T2, P1-C7-T3, P1-C7-T4 PCIe to I/O enclosures (2U)
    P1-C8-T1, P1-C8-T2 i2c to RPCs
    P1-C10-T1, P1-C10-T2 LPAR Ethernet
    P1-C10-T3, P1-C10-T4 Customer network (optional feature, if used)
    P1-C11-T1, P1-C11-T2
    P1-C11-T3, P1-C11-T4    		 Customer network (optional feature, if used)
    P1-C12-T1, P1-C12-T2 RS485 to RPCs
    Figure 17. CEC enclosure location codes (rear view) (Models 980 and 984)
    CEC enclosure location codes (rear view)
  8. Reconnect the power cords Callout label A to the CEC enclosure. See Figure 18.
  9. Fasten the power cords to the enclosure using the hook-and-loop fasteners Callout label B.
    Figure 18. Connecting the power cords
    Connecting the power cords
  10. Verify the CEC enclosure has power available. See Figure 19.
    1. At the rear of the CEC enclosure, view the CEC enclosure power supply DC LEDs.
    2. Are all DC (output) LEDs flashing?
      • Yes, continue with the next step.
      • No, ensure the power cords are properly connected. If no connection problem is found, contact your next level of support.
    Figure 19. Location of the power supplies and LEDs (Models 980, 983, 984)
    Location of the power supplies and LEDs (Model 980)
  11. Wait up to 5 minutes for the CEC enclosure control panel power button LED Callout label A to flash. See Figure 20.
    Note: This ensures the CEC enclosure is in the power-off state.

    Is the power button LED flashing?

    • Yes, go to the next step.
    • No, ensure the CEC enclosure power supplies are fully seated. The possible failing FRUs are the CEC enclosure system backplane, I2C interface card and cables, and control panel. You can also call the next level of support.
    Figure 20. Control panel LEDs
    Control panel LEDs
  12. Close the rear door of the rack.
  13. Exit this service information center parts exchange procedure and return to the procedure that sent you here.