Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)


Huang, Lei
 

E5-2680 v2 is Ivy Bridge.

I guess some packages (maybe spdk) was compiled to run on haswell or newer architecture. You may use gdb to run “daos_admin”. Gdb will stop when cpu runs into an unsupported instruction. With “bt” and “info proc mappings” in gdb, you can find out which module/library contains unsupported instruction. You need to compile your library from source targeting your own CPU and install it.

 

Or you can compile daos and its dependent libraries from scratch.

https://github.com/daos-stack/daos/blob/release/2.2/site_scons/components/__init__.py#L348-L355

You may need to replace this part with

spdk_arch = 'nehalem'

 

Not sure whether there are other places to fix the compiling flags for CPU optimizations.

 

-lei

 

From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of JiangYu
Sent: Friday, November 4, 2022 12:58 AM
To: daos@daos.groups.io
Subject: Re: [daos] DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)

 

Thanks, the CPU information is as follows, how can I choose the CPU?

[root@Rocky-1 ~]# lscpu

Architecture:        x86_64

CPU op-mode(s):      32-bit, 64-bit

Byte Order:          Little Endian

CPU(s):              40

On-line CPU(s) list: 0-39

Thread(s) per core:  2

Core(s) per socket:  10

Socket(s):           2

NUMA node(s):        2

Vendor ID:           GenuineIntel

BIOS Vendor ID:      Intel

CPU family:          6

Model:               62

Model name:          Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz

BIOS Model name:           Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz

Stepping:            4

CPU MHz:             3600.000

CPU max MHz:         3600.0000

CPU min MHz:         1200.0000

BogoMIPS:            5599.96

Virtualization:      VT-x

L1d cache:           32K

L1i cache:           32K

L2 cache:            256K

L3 cache:            25600K

NUMA node0 CPU(s):   0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38

NUMA node1 CPU(s):   1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31,33,35,37,39

Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm cpuid_fault pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear flush_l1d

Join daos@daos.groups.io to automatically receive all group messages.