Re: DAOS with NVMe-over-Fabrics

Nabarro, Tom

Hello Anton


helper_log_file and bdev_exclude parameters are both global parameters and should be included in the top section (just under control_log_file), see utils/config/daos_server.yml for reference/parameter documentation.


Please move them from the per-server sections into global and retry.


This highlights that we need to implement parser errors for unrecognised parameters in the per-server sections.



Tom Nabarro – DCG/ESAD

M: +44 (0)7786 260986

Skype: tom.nabarro


From: <> On Behalf Of anton.brekhov@...
Sent: Friday, October 16, 2020 2:36 PM
Subject: Re: [daos] DAOS with NVMe-over-Fabrics


Tom here is the active config file content:

name: daos_server

access_points: ['apache512']

#access_points: ['localhost']

port: 10001

#provider: ofi+sockets

provider: ofi+verbs;ofi_rxm

nr_hugepages: 4096

control_log_file: /tmp/daos_control.log


   allow_insecure: true




  targets: 4

  first_core: 0

  nr_xs_helpers: 0

  fabric_iface: ib0

  fabric_iface_port: 31416

  log_mask: ERR

  log_file: /tmp/daos_server.log

  helper_log_file: /tmp/daos_admin.log



  - DAOS_MD_CAP=1024






  #- OFI_DOMAIN=mlx5_0

  #- CRT_PHY_ADDR_STR=ofi+verbs;ofi_rxm


  # Storage definitions


  # When scm_class is set to ram, tmpfs will be used to emulate SCM.

  # The size of ram is specified by scm_size in GB units.

  scm_mount: /mnt/daos  # map to -s /mnt/daos

  #scm_class: ram

  #scm_size: 8

  scm_class: dcpm

  scm_list: [/dev/pmem0]


  bdev_class: nvme

  #bdev_list: ["0000:b1:00.0","0000:b2:00.0"]

  bdev_exclude: ["0000:b1:00.0","0000:b2:00.0","0000:b3:00.0","0000:b4:00.0"]

Before starting server:

[root@apache512 ~]# nvme list

Node             SN                   Model                                    Namespace Usage                      Format           FW Rev

---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- --------

/dev/nvme0n1     BTLJ81460E1M1P0I     INTEL SSDPELKX010T8                      1           1,00  TB /   1,00  TB    512   B +  0 B   VCV10300

/dev/nvme1n1     BTLJ81460E031P0I     INTEL SSDPELKX010T8                      1           1,00  TB /   1,00  TB    512   B +  0 B   VCV10300

/dev/nvme2n1     BTLJ81460E1J1P0I     INTEL SSDPELKX010T8                      1           1,00  TB /   1,00  TB    512   B +  0 B   VCV10300

/dev/nvme3n1     BTLJ81460E341P0I     INTEL SSDPELKX010T8                      1           1,00  TB /   1,00  TB    512   B +  0 B   VCV10300

After starting server:

[root@apache512 ~]# nvme list

[root@apache512 ~]#

The helper_log_file was ignored...

Intel Corporation (UK) Limited
Registered No. 1134945 (England)
Registered Office: Pipers Way, Swindon SN3 1RJ
VAT No: 860 2173 47

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.

Join to automatically receive all group messages.