Re: DAOS with NVMe-over-Fabrics


Nabarro, Tom
 

https://github.com/pmem/ndctl/issues/130 regression is fixed in Centos8

 

From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of Nabarro, Tom
Sent: Wednesday, October 14, 2020 2:13 PM
To: daos@daos.groups.io
Subject: Re: [daos] DAOS with NVMe-over-Fabrics

 

Yes , this is a bug with current centos7 kernel and ndctl, I will find the ticket number

 

Regards,

Tom Nabarro – DCG/ESAD

M: +44 (0)7786 260986

Skype: tom.nabarro

 

From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of anton.brekhov@...
Sent: Wednesday, October 14, 2020 12:58 PM
To: daos@daos.groups.io
Subject: Re: [daos] DAOS with NVMe-over-Fabrics

 

Is it OK that daos_server storage scan says that both pmem on one socket:

[root@apache512 ib0]# daos_server storage scan

Scanning locally-attached storage...

NVMe controllers and namespaces:

PCI:0000:b3:00.0 Model:INTEL SSDPELKX010T8  FW:VCV10300 Socket:1 Capacity:1.0 TB

PCI:0000:b4:00.0 Model:INTEL SSDPELKX010T8  FW:VCV10300 Socket:1 Capacity:1.0 TB

SCM Namespaces:

Device:pmem0 Socket:0 Capacity:981 GB

Device:pmem1 Socket:0 Capacity:981 GB


But ipmctl says that dcpmm is on two separate sockets?

[root@apache512 ib0]# ipmctl show -topology -socket 0

 DimmID | MemoryType                  | Capacity    | PhysicalID| DeviceLocator

================================================================================

 0x0001 | Logical Non-Volatile Device | 502.563 GiB | 0x001e    | CPU1_DIMM_A2

 0x0101 | Logical Non-Volatile Device | 502.563 GiB | 0x0024    | CPU1_DIMM_D2

 N/A    | DDR4                        | 16.000 GiB  | 0x001d    | CPU1_DIMM_A1

 N/A    | DDR4                        | 16.000 GiB  | 0x001f    | CPU1_DIMM_B1

 N/A    | DDR4                        | 16.000 GiB  | 0x0021    | CPU1_DIMM_C1

 N/A    | DDR4                        | 16.000 GiB  | 0x0023    | CPU1_DIMM_D1

 N/A    | DDR4                        | 16.000 GiB  | 0x0025    | CPU1_DIMM_E1

 N/A    | DDR4                        | 16.000 GiB  | 0x0027    | CPU1_DIMM_F1

 

[root@apache512 ib0]# ipmctl show -topology -socket 1

 DimmID | MemoryType                  | Capacity    | PhysicalID| DeviceLocator

================================================================================

 0x1001 | Logical Non-Volatile Device | 502.563 GiB | 0x002a    | CPU2_DIMM_A2

 0x1101 | Logical Non-Volatile Device | 502.563 GiB | 0x0030    | CPU2_DIMM_D2

 N/A    | DDR4                        | 16.000 GiB  | 0x0029    | CPU2_DIMM_A1

 N/A    | DDR4                        | 16.000 GiB  | 0x002b    | CPU2_DIMM_B1

 N/A    | DDR4                        | 16.000 GiB  | 0x002d    | CPU2_DIMM_C1

 N/A    | DDR4                        | 16.000 GiB  | 0x002f    | CPU2_DIMM_D1

 N/A    | DDR4                        | 16.000 GiB  | 0x0031    | CPU2_DIMM_E1

 N/A    | DDR4                        | 16.000 GiB  | 0x0033    | CPU2_DIMM_F1

 

---------------------------------------------------------------------
Intel Corporation (UK) Limited
Registered No. 1134945 (England)
Registered Office: Pipers Way, Swindon SN3 1RJ
VAT No: 860 2173 47

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.

---------------------------------------------------------------------
Intel Corporation (UK) Limited
Registered No. 1134945 (England)
Registered Office: Pipers Way, Swindon SN3 1RJ
VAT No: 860 2173 47

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.

Join daos@daos.groups.io to automatically receive all group messages.