Hi,

First of all, please note that we are in the process of implementing our own wire-up protocol that will eventually allow us to start the DAOS server on each storage node independently. At that point, we won’t require opmi/pmix any longer and will be able to start the DAOS servers via systemd, kubernetes or any parallel launchers (e.g. pdsh, …). This feature will be available this summer.

Meanwhile, it would be great to see the output of the “orterun … daos_server" command. I suspect that the backend storage hasn’t been formatted and the data plane not started yet. Could you please file a ticket on https://jira.hpdd.intel.com and attach the daos_server output? Thanks.

Cheers,

Johann

Hello,

Thank you for your help, since the ompi/pmix is depends projects of daos, I didn’t touch them, just follow quick-start in github, to build and run it.

I enter the path _build.external/ompi and pmix,  and then make && make install, all finished successfully.

For report-uri, since I’m running daos server in the /root/daos, I can see the uri file was created and can see the content, therefor just specify full path for the client, seems connection between client and server is OK (if I specify wrong, or nic not started, there is another error).

And also if I run: daosctl create-pool testpool, will get the same issue.

So I’m wondering where the problem is.

There are some information in the logs:

PMIx_Lookup group daos_server failed, rc: -46, value.type 0.
crt_pmix_attach group daos_server failed, rc: -1023.

Best Regards

From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of xuezhao.liu@...
Sent: Thursday, June 20, 2019 4:08 PM
To: daos@daos.groups.io
Subject: [External] Re: [daos] failed to create pool: -1023 #chat

Hi,
-1023 is DER_PMIX, that commonly due to your ompi/pmix building/usage is incorrect.
You may check "which orterun" to see if the orterun path is the one built by DAOS package.
and for server loading cmd line, at least you need "--report-uri /root/daos/uuu" to allow the dmg client can hook with it (by --ompi-server option).

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.