|
I can not improve my client's performance by increasing client's thread
Hi everyone:
Recently, i use daos array interface to do some test, i found that the client's performance would be improved by increasing the client’s thread num. And the server does not reach the
Hi everyone:
Recently, i use daos array interface to do some test, i found that the client's performance would be improved by increasing the client’s thread num. And the server does not reach the
|
By
shadow_vector@...
·
#1591
·
|
|
DAOS Community Update / May'22
Hi there,
Please find below the DAOS community newsletter for May 2022.
Past Events
2022 Energy HPC Conference (March 3rd)
DAOS Use at Argonne
Kevin Harms (Argonne)
Johann Lombardi
Hi there,
Please find below the DAOS community newsletter for May 2022.
Past Events
2022 Energy HPC Conference (March 3rd)
DAOS Use at Argonne
Kevin Harms (Argonne)
Johann Lombardi
|
By
Johann
·
#1589
·
|
|
Re: Is there any problem at blobstore load err
Right, that’s probably something could be improved in the future. Maybe we could move the blobstore creation from io engine (on first start) to control plane (on storage format?). Thanks for
Right, that’s probably something could be improved in the future. Maybe we could move the blobstore creation from io engine (on first start) to control plane (on storage format?). Thanks for
|
By
Niu, Yawei
·
#1588
·
|
|
DAOS BoF at ISC'22
Hi there,
The DAOS BoF at ISC’22 (Hamburg) will be held on May 30th from 4pm to 5pm in Hall E. Please save the date!
The format of the BoF will be short lightening talks followed by
Hi there,
The DAOS BoF at ISC’22 (Hamburg) will be held on May 30th from 4pm to 5pm in Hall E. Please save the date!
The format of the BoF will be short lightening talks followed by
|
By
Johann
·
#1587
·
|
|
Is there any problem at blobstore load err
Hi everyone:
In create_bio_bdev function, if load_blobstore is failed, DAOS would init it. I'm a little worry about it. Whether there is a possibility of an exception when creating bdev or
Hi everyone:
In create_bio_bdev function, if load_blobstore is failed, DAOS would init it. I'm a little worry about it. Whether there is a possibility of an exception when creating bdev or
|
By
shadow_vector@...
·
#1586
·
|
|
Re: dfuse mount error in centos 7
Yes, libioil works in conjunction with DFuse and allows the interception of POSIX I/O calls.
Yes, libioil works in conjunction with DFuse and allows the interception of POSIX I/O calls.
|
By
Wang, Shilong
·
#1585
·
|
|
Re: The file removal performance is very low by mdtest
Try to explicitly set the object class for files and directories –
the defaults are not providing the best performance for mdtest-like workloads:
--dfs.oclass=S1 --dfs.dir_oclass=SX
Try to explicitly set the object class for files and directories –
the defaults are not providing the best performance for mdtest-like workloads:
--dfs.oclass=S1 --dfs.dir_oclass=SX
|
By
Wang, Shilong
·
#1584
·
|
|
Re: object classes (was: The file removal performance is very low by mdtest)
Hi,
Without data protection, SX (striping across all storage targets) and S1 (using only a single storage target) are your two main options. With replication or erasure coding, there are more
Hi,
Without data protection, SX (striping across all storage targets) and S1 (using only a single storage target) are your two main options. With replication or erasure coding, there are more
|
By
Hennecke, Michael
·
#1583
·
|
|
Re: The file removal performance is very low by mdtest
Thanks, I want to know where I can get the description of --dfs.oclass and --dfs.dir_oclass?Do they contain other parameters except S1 and SX?
Thanks, I want to know where I can get the description of --dfs.oclass and --dfs.dir_oclass?Do they contain other parameters except S1 and SX?
|
By
Groot
·
#1582
·
|
|
Re: The file removal performance is very low by mdtest
Hi,
What is you mdtest command that you used to run?
Typically low remove performance might indicate that you are using SX object class for files (the default),, which is fine if your files are
Hi,
What is you mdtest command that you used to run?
Typically low remove performance might indicate that you are using SX object class for files (the default),, which is fine if your files are
|
By
Chaarawi, Mohamad
·
#1581
·
|
|
Re: dfuse mount error in centos 7
Yes that’s correct – libioil requires the container to be dfuse-mounted. And note that all metadata operations will still go through dfuse, libioil only intercepts (most of) the data I/O calls.
Yes that’s correct – libioil requires the container to be dfuse-mounted. And note that all metadata operations will still go through dfuse, libioil only intercepts (most of) the data I/O calls.
|
By
Hennecke, Michael
·
#1580
·
|
|
The file removal performance is very low by mdtest
I install the DAOS and use the mdtest to do some test with -a DFS (one server and one client with 20 cores, the server use 256G DCPM without nvme ssd). But I find the file removal performance is very
I install the DAOS and use the mdtest to do some test with -a DFS (one server and one client with 20 cores, the server use 256G DCPM without nvme ssd). But I find the file removal performance is very
|
By
Groot
·
#1579
·
|
|
Re: dfuse mount error in centos 7
OK, thanks. And I want to know if I must mount the dfuse before using the libioil interception library?
Thanks a lot.
Groot
OK, thanks. And I want to know if I must mount the dfuse before using the libioil interception library?
Thanks a lot.
Groot
|
By
Groot
·
#1578
·
|
|
Re: dfuse mount error in centos 7
Hi,
please make sure that you are on CentOS 7.9, your kernel level indicates that you may be on an older level?
Best,
Michael
Hi,
please make sure that you are on CentOS 7.9, your kernel level indicates that you may be on an older level?
Best,
Michael
|
By
Hennecke, Michael
·
#1577
·
|
|
dfuse mount error in centos 7
I create the pool and container with POSIX type successfully. But I mount the dfs by dfuse failed and I get the error message as follow:
fuse: error: filesystem requested capabilities 0x10000 that are
I create the pool and container with POSIX type successfully. But I mount the dfs by dfuse failed and I get the error message as follow:
fuse: error: filesystem requested capabilities 0x10000 that are
|
By
Groot
·
#1576
·
|
|
DAOS Community Update / Apr'22
Hi there,
Please find below the DAOS community newsletter for April 2022.
Past Events
Dell Technologies HPC Community Event (February 9th)
DAOS: High Performance Storage for All HPC Workloads
Hi there,
Please find below the DAOS community newsletter for April 2022.
Past Events
Dell Technologies HPC Community Event (February 9th)
DAOS: High Performance Storage for All HPC Workloads
|
By
Johann
·
#1575
·
|
|
Re: dfs_lookup behavior for non-existent files?
Mohamad
Thank you for the sanity check regarding dfs_lookup. After a little sleuthing, the application (evidently) was modifying the effective UID/GID around the time of that lookup. And it was this
Mohamad
Thank you for the sanity check regarding dfs_lookup. After a little sleuthing, the application (evidently) was modifying the effective UID/GID around the time of that lookup. And it was this
|
By
Tuffli, Chuck
·
#1574
·
|
|
Re: dfs_lookup behavior for non-existent files?
Hi Chuck,
Neither dfs_lookup nor dfs_stat do set the st_ino in the stat buf.
The reason being is that files are uniquely identified by the daos object ID which is 128 bits (64 hi, 64 lo).
You
Hi Chuck,
Neither dfs_lookup nor dfs_stat do set the st_ino in the stat buf.
The reason being is that files are uniquely identified by the daos object ID which is 128 bits (64 hi, 64 lo).
You
|
By
Chaarawi, Mohamad
·
#1573
·
|
|
Re: What will happen to DAOS if all SCM space is consumed?
Hi there,
Applications will get a DER_NOSPACE error. We currently don’t support serialization of metadata to SSDs.
Cheers,
Johann
From:<daos@daos.groups.io> on behalf of "bob@..."
Hi there,
Applications will get a DER_NOSPACE error. We currently don’t support serialization of metadata to SSDs.
Cheers,
Johann
From:<daos@daos.groups.io> on behalf of "bob@..."
|
By
Johann
·
#1572
·
|
|
Re: the fault domain setting of the daos container
Hi there,
There is a gap in the support of rf_lvl which is not used by the placement algorithm yet. Please seehttps://daosio.atlassian.net/browse/DAOS-10215 to track progress on this.
Hi there,
There is a gap in the support of rf_lvl which is not used by the placement algorithm yet. Please seehttps://daosio.atlassian.net/browse/DAOS-10215 to track progress on this.
|
By
Johann
·
#1571
·
|