Infiniband and Ubuntu

June 10, 2009 - 10:23 pm

Executed on a clean install of 9.04 server:

apt-get install libipathverbs1 libcxgb3-1 librdmacm1 libibverbs1 libmthca1 libmlx4-1
apt-get install gcc make bison flex
cd /opt
wget http://www.openfabrics.org/downloads/management/libibumad-1.3.2.tar.gz
tar -zxf libibumad*gz
cd libibumad*
./configure
make
make install
cd ..
wget http://www.openfabrics.org/downloads/management/libibmad-1.3.2.tar.gz
tar -zxf libibmad*gz
cd libibmad*
./configure
make
make install
cd ..
wget http://www.openfabrics.org/downloads/management/opensm-3.3.2.tar.gz
tar -zxf opensm*gz
cd opensm*
./configure
make
make install
cd ..
wget http://www.openfabrics.org/downloads/management/infiniband-diags-1.5.2.tar.gz
tar -zxf infiniband-diags*.gz
cd infiniband-diags*
./configure
make
make install
ldconfig
modprobe ib_mthca
modprobe ib_ipoib
modprobe ib_umad
ibstat

You probably want the IB kernel modules loading on boot, but I leave that as an exercise to the reader.