Hi there!
TLDR: I had my rig working with 9 nvidia cards(FHR) for some time. I ended up selling a FHR card (3070 MSI) to a friend. A couple of weeks ago, I purchased a 3060ti FE (FHR) to add back to my rig. For some reason, I can no longer get the system to post when adding a 9th card. All hardware has stayed the same with the exception of the new 9th card.
Steps I have taken to troubleshoot the issue:
- Reset CMOS / BIOS to factory and restore all settings
- Enable above 4g decoding, PCI lanes set to Gen2, disabling serial port, disable audio, disable internal GPU, disable intel-VT
- Started the rig with no GPU’s, then 1, then 2, etc all the way up to 9. When adding any 9th card on any riser in any slot, the system will not post or boot into hive
- Verified hardware is seated correctly (GPU, USB, risers, etc)
Hardware/settings:
- Z370P D3-CF Gigabyte Technology Co., Ltd. (F15b 03/23/2021)
- 850W gold ATX power supply for 2 cards and mobo
- 2X1200W server PSU’s at 60-80% capacity
- NGFF M.2 To USB 3.0 Transfer PCI-E Riser Card Adapter
- GPU List: 2x3080 FHR, 4x3070 FHR, 2-3 x 3060ti FE FHR GPU
- Hive is running on a USB drive
- Hive Version: 0.6-210@211010
- Driver versions A 20.40 (5.9.0325) N 470.74
* PCI multi card riser