Fio with I/O Engine=DFS


shmatsuu@...
 

Hi, 

I have a question regarding fio with dfs io engine.
I'm trying to run fio benchmarks with ioengine=dfs, by following the example here (https://docs.daos.io/admin/performance_tuning/), but getting the below error message. I'm sure that my Pool UUID and Container UUID are correct.
Can anyone point out for me what I'm doing wrong or any possible cause for the error, please? Or can you please share with me how you successfully run fio with ioengine=dfs. 

[How I run the fio with ioengine=dfs]
(1) dmg pool create --size=<specific size> --user=<fio running user>@ --group=<fio running user group>@
(2) daos cont create --pool=<Pool UUID>  --user=<fio running user>@ --group=<fio running user group>@ --type=POSIX
(3) export POOL=<Pool UUID>
(4) export CONT=<Container UUID>
(5) fio ./examples/dfs.fio

[Error Messages]
daos-seqwrite: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=dfs, iodepth=1
daos-seqread: (g=1): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=dfs, iodepth=1
daos-randwrite: (g=2): rw=randwrite, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=dfs, iodepth=1
daos-randread: (g=3): rw=randread, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=dfs, iodepth=1
fio-3.27-84-gf7942
Starting 4 processes
mgmt ERR  src/mgmt/cli_mgmt.c:815 dc_mgmt_get_pool_svc_ranks() 35396364: MGMT_POOL_GET_SVCRANKS rpc failed to all 1 ranks, DER_NONEXIST(-1005): 'The specified entity does not exist'
pool ERR  src/pool/cli.c:195 dc_pool_choose_svc_rank() 35396364: dc_mgmt_get_pool_svc_ranks() failed, DER_NONEXIST(-1005): 'The specified entity does not exist'
pool ERR  src/pool/cli.c:512 dc_pool_connect() 35396364: cannot find pool service: DER_NONEXIST(-1005): 'The specified entity does not exist'
Failed to connect to pool -1005
fio: io engine dfs init failed.

Thank you very much, 
---
Shohei


Lombardi, Johann
 

Hi Shohei,

 

Could you please give us an example of what you set the POOL and CONT env vars to? Also, I assume that you are using DAOS 1.2, right?

 

Cheers,

Johann

 

From: <daos@daos.groups.io> on behalf of "shmatsuu@..." <shmatsuu@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Wednesday 8 September 2021 at 16:30
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Fio with I/O Engine=DFS

 

Hi, 

I have a question regarding fio with dfs io engine.
I'm trying to run fio benchmarks with ioengine=dfs, by following the example here (https://docs.daos.io/admin/performance_tuning/), but getting the below error message. I'm sure that my Pool UUID and Container UUID are correct.
Can anyone point out for me what I'm doing wrong or any possible cause for the error, please? Or can you please share with me how you successfully run fio with ioengine=dfs. 

[How I run the fio with ioengine=dfs]
(1) dmg pool create --size=<specific size> --user=<fio running user>@ --group=<fio running user group>@
(2) daos cont create --pool=<Pool UUID>  --user=<fio running user>@ --group=<fio running user group>@ --type=POSIX
(3) export POOL=<Pool UUID>
(4) export CONT=<Container UUID>
(5) fio ./examples/dfs.fio

[Error Messages]

daos-seqwrite: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=dfs, iodepth=1

daos-seqread: (g=1): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=dfs, iodepth=1

daos-randwrite: (g=2): rw=randwrite, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=dfs, iodepth=1

daos-randread: (g=3): rw=randread, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=dfs, iodepth=1

fio-3.27-84-gf7942

Starting 4 processes

mgmt ERR  src/mgmt/cli_mgmt.c:815 dc_mgmt_get_pool_svc_ranks() 35396364: MGMT_POOL_GET_SVCRANKS rpc failed to all 1 ranks, DER_NONEXIST(-1005): 'The specified entity does not exist'

pool ERR  src/pool/cli.c:195 dc_pool_choose_svc_rank() 35396364: dc_mgmt_get_pool_svc_ranks() failed, DER_NONEXIST(-1005): 'The specified entity does not exist'

pool ERR  src/pool/cli.c:512 dc_pool_connect() 35396364: cannot find pool service: DER_NONEXIST(-1005): 'The specified entity does not exist'

Failed to connect to pool -1005

fio: io engine dfs init failed.

Thank you very much, 
---
Shohei

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.


shmatsuu@...
 

Hi Johann,

Thank you. Here is an example how I set POOL and CONT env vars to. Yes, I'm using DAOS 1.2 and fio version fio-3.27-84-gf7942.

[Setting Env Vars]
 export POOL=4a6fa2f6-f2aa-40d5-9092-63ea46641887
 export CONT=1ed2c63e-9c20-4746-9ec4-03ce57c5d5a2 

[FIO Version]
fio --version
fio-3.27-84-gf7942

Thank you very much,
---
Shohei


Lombardi, Johann
 

Hm, I wonder whether I broke something with my latest fio upstream patch.

Could you please try to revert commit 2819492b94f9ef901178e6972e0e5784ef3a8be9 locally, rebuild fio and retry?

Thanks in advance.

 

Cheers,

Johann

 

From: <daos@daos.groups.io> on behalf of "shmatsuu@..." <shmatsuu@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Thursday 9 September 2021 at 01:38
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: Re: [daos] Fio with I/O Engine=DFS

 

Hi Johann,

Thank you. Here is an example how I set POOL and CONT env vars to. Yes, I'm using DAOS 1.2 and fio version fio-3.27-84-gf7942.

[Setting Env Vars]
 export POOL=4a6fa2f6-f2aa-40d5-9092-63ea46641887
 export CONT=1ed2c63e-9c20-4746-9ec4-03ce57c5d5a2 

[FIO Version]
fio --version
fio-3.27-84-gf7942

Thank you very much,
---
Shohei

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.