Hugepage config update


Macdonald, Mjmac
 

Hi all.

 

Just a notice that as of commit ad85e5b which landed on master today, the nr_hugepages config value defines the number of hugepages to be used for each ioserver. In other words, if you are running a dual-ioserver config and have nr_hugepages set to 4096, then the total number of hugepages that will be reserved for DAOS is 8192.

 

Best,

mjmac


Colin Ngam <cngam@...>
 

Hi,

 

Upgraded to the latest. Started daos “daos_server start”:

 

03/18-16:58:15.09 delphi-006 DAOS[57841/57841] server INFO src/iosrv/init.c:503 server_init() Network successfully initialized

03/18-16:58:15.09 delphi-006 DAOS[57841/57841] server ERR  src/iosrv/module.c:105 dss_module_load() cannot load librdb.so: librdb.so: cannot open shared object file: No such file or directory

03/18-16:58:15.09 delphi-006 DAOS[57841/57841] server ERR  src/iosrv/init.c:195 modules_load() Failed to load module rdb: -1003

 

This is I believe because librdb.so has moved “lib64/daos_srv/librdb.so”? Now have to set LD_LIBRARY_PATH appropriately? Or am I running the scons build incorrectly? Or some scripts that I am not running?

 

Thanks.

 

Colin

 

From: <daos@daos.groups.io> on behalf of "Macdonald, Mjmac" <mjmac.macdonald@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Wednesday, March 18, 2020 at 3:59 PM
To: "daos-devel@..." <daos-devel@...>, "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Hugepage config update

 

Hi all.

 

Just a notice that as of commit ad85e5b which landed on master today, the nr_hugepages config value defines the number of hugepages to be used for each ioserver. In other words, if you are running a dual-ioserver config and have nr_hugepages set to 4096, then the total number of hugepages that will be reserved for DAOS is 8192.

 

Best,

mjmac


Farrell, Patrick Arthur <patrick.farrell@...>
 

I actually hit this as well - For some reason, librdb.so (and probably the other stuff in daos_srv) aren't getting found.

I assumed my environment was messed up and hacked around this by copying install/lib64/daos_srv/* to install/lib64, but it actually appears like some recent change has introduced this issue.

-Patrick

From: daos@daos.groups.io <daos@daos.groups.io> on behalf of Colin Ngam <cngam@...>
Sent: Wednesday, March 18, 2020 5:19 PM
To: daos@daos.groups.io <daos@daos.groups.io>; daos-devel@... <daos-devel@...>
Subject: Re: [daos] Hugepage config update
 

Hi,

 

Upgraded to the latest. Started daos “daos_server start”:

 

03/18-16:58:15.09 delphi-006 DAOS[57841/57841] server INFO src/iosrv/init.c:503 server_init() Network successfully initialized

03/18-16:58:15.09 delphi-006 DAOS[57841/57841] server ERR  src/iosrv/module.c:105 dss_module_load() cannot load librdb.so: librdb.so: cannot open shared object file: No such file or directory

03/18-16:58:15.09 delphi-006 DAOS[57841/57841] server ERR  src/iosrv/init.c:195 modules_load() Failed to load module rdb: -1003

 

This is I believe because librdb.so has moved “lib64/daos_srv/librdb.so”? Now have to set LD_LIBRARY_PATH appropriately? Or am I running the scons build incorrectly? Or some scripts that I am not running?

 

Thanks.

 

Colin

 

From: <daos@daos.groups.io> on behalf of "Macdonald, Mjmac" <mjmac.macdonald@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Wednesday, March 18, 2020 at 3:59 PM
To: "daos-devel@..." <daos-devel@...>, "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Hugepage config update

 

Hi all.

 

Just a notice that as of commit ad85e5b which landed on master today, the nr_hugepages config value defines the number of hugepages to be used for each ioserver. In other words, if you are running a dual-ioserver config and have nr_hugepages set to 4096, then the total number of hugepages that will be reserved for DAOS is 8192.

 

Best,

mjmac