Our build out of the Open Compute Windmill V3 server utilizes the Mellanox MCX342A XCAN 10GbE, 2-p SFP+ mezzanine card. By default, the Mellanox card is not natively supported by CentOS 6.4.

[root@server /]# lspci | grep Mellanox
06:00.0 Ethernet controller: Mellanox Technologies MT27500 Family [ConnectX-3]

That being said, I had to download the appropriate driver from Mellanox here. That being said, I also needed quite a few RPM’s to do the driver install, I did:

yum -y install kernel-source kernel headers gcc rpm-build  gcc make patch redhat-rpm-config

Even then, I was getting an error:

No kernel sources/headers found for 2.6.32-358.el6.x86_64 kernel.

As it turns out, the symbolic link of /lib/modules/2.6.32-358.el6.x86_64/build to ../../../usr/src/kernels/xxxxxxx was incorrect. I had to do:

ln -s ../../../usr/src/kernels/2.6.32-358.23.2.el6.x86_64 build

within /lib/modules/2.6.32-358.el6.x86_64/

Only then was I able to correctly install the Mellanox driver.

Tags: cloud, Facebook Server, Facebook Servers, OCP, Open Compute, opencompute, virtualization