Re: FIO Results & Running IO500


Lombardi, Johann
 

Hi Peter,

 

A few things to try/explore:

  • I don’t think that we have ever tested with 2x pmem DIMMs per socket. Maybe you could try with dram instead of pmem to see whether the performance increases.
  • 16x targets might be too much for 2x pmem DIMMs. You could try to reduce it to 8x targets and set “nr_xs_helpers” to 0.
  • It sounds like you run the benchmark (fio, IO500) and the DAOS engine on the same node. There might be interferences between both. You could try to change the affinity of the benchmark to run on CPU cores not used by the DAOS engine (e.g. with taskset(1) or mpirun args).

 

Cheers,

Johann

 

From: <daos@daos.groups.io> on behalf of Peter <magpiesaresoawesome@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 13 July 2021 at 03:16
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: Re: [daos] FIO Results & Running IO500

 

Hello again,

I've tried some more to improve these results, different DAOS versions (including the YUM repo), different MPI versions, DAOS configurations, etc.

I'm still unable to diagnose this issue, IOPS performance remains low for both FIO and IO500.

Does anyone have any input on how I can try to debug or resolve this issue?

Thanks for your help.

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.

Join daos@daos.groups.io to automatically receive all group messages.