Infiniband support in docker container?


anton.brekhov@...
 

Hi everyone! 

Is there opportunity to use infiniband interface inside docker container and launch daos_server? 

Is there any examples? 

Thank you!


Lombardi, Johann
 

Hi Anton,

 

We have never tried to use IB with docker containers. That being said, I am not aware of any issue that would prevent this from working as long as the IB interface can be accessed by the container.

As a first basic test, you could follow the instructions in the docker section (https://daos-stack.github.io/admin/installation/#daos-in-docker) and apply the following patch to the yaml config file to switch to ib (please adjust fabric_iface with the IB interface you want to use):

 

diff --git a/utils/config/examples/daos_server_local.yml b/utils/config/examples/daos_server_local.yml

index 21b3943..e26b490 100644

--- a/utils/config/examples/daos_server_local.yml

+++ b/utils/config/examples/daos_server_local.yml

@@ -3,7 +3,7 @@

name: daos_server

access_points: ['localhost']

# port: 10001

-provider: ofi+sockets

+provider: ofi+verbs;ofi_rxm

nr_hugepages: 4096

control_log_file: /tmp/daos_control.log

transport_config:

@@ -14,7 +14,7 @@ servers:

   targets: 1

   first_core: 0

   nr_xs_helpers: 0

-  fabric_iface: eth0

+  fabric_iface: ib0

   fabric_iface_port: 31416

   log_file: /tmp/daos_server.log

 

And see whether you can start & format the server as specified in the doc.

 

Cheers,

Johann

 

From: <daos@daos.groups.io> on behalf of "anton.brekhov@..." <anton.brekhov@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Thursday 19 March 2020 at 23:21
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Infiniband support in docker container?

 

Hi everyone! 

Is there opportunity to use infiniband interface inside docker container and launch daos_server? 

Is there any examples? 

Thank you!

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.