|
DAOS Community Update / Sep'21
Hi there,
Please find below the DAOS community newsletter for September 2021.
Upcoming Events
5th EAGE workshop on HPC for Upstream (September 6-8)
Leveraging DAOS file system for seismic
Hi there,
Please find below the DAOS community newsletter for September 2021.
Upcoming Events
5th EAGE workshop on HPC for Upstream (September 6-8)
Leveraging DAOS file system for seismic
|
By
Johann
·
#1445
·
|
|
Re: protential deadlock problem in daos/src/client/dfuse/il/int_posix.c
Hi Chengfeng,
Good catch and thanks for the patch!
Cheers,
Johann
From:<daos@daos.groups.io> on behalf of "cyeaa@..." <cyeaa@...>
Reply-To: "daos@daos.groups.io"
Hi Chengfeng,
Good catch and thanks for the patch!
Cheers,
Johann
From:<daos@daos.groups.io> on behalf of "cyeaa@..." <cyeaa@...>
Reply-To: "daos@daos.groups.io"
|
By
Johann
·
#1444
·
|
|
protential deadlock problem in daos/src/client/dfuse/il/int_posix.c
Hi developers,
I am about to report a protential bug, but I couldn't get access to the issue tracker in this site https://daosio.atlassian.net . I just put the description here, and thanks a lot if
Hi developers,
I am about to report a protential bug, but I couldn't get access to the issue tracker in this site https://daosio.atlassian.net . I just put the description here, and thanks a lot if
|
By
cyeaa@...
·
#1443
·
|
|
Re: Question about Pool Size Expansion
Hi Kevin,
Thank you very much for your response! I'll test it on my environment.
Thank you,
---
Shohei
Hi Kevin,
Thank you very much for your response! I'll test it on my environment.
Thank you,
---
Shohei
|
By
shmatsuu@...
·
#1442
·
|
|
Re: Question about Pool Size Expansion
Shohei,
my understanding is that the current implementation assumes you have servers with the same configuration, so if for example, rank0 and rank1 have 5 targets each with 10GB, when you add
Shohei,
my understanding is that the current implementation assumes you have servers with the same configuration, so if for example, rank0 and rank1 have 5 targets each with 10GB, when you add
|
By
Harms, Kevin
·
#1441
·
|
|
Re: Question about Pool Size Expansion
Hi Kevin,
Thanks for your reply. I noted. Maybe I'm missing something here, but does this lead us to expanding the size of an existing pool?
For example, let's say we have a pool with uuid=puuid and
Hi Kevin,
Thanks for your reply. I noted. Maybe I'm missing something here, but does this lead us to expanding the size of an existing pool?
For example, let's say we have a pool with uuid=puuid and
|
By
shmatsuu@...
·
#1440
·
|
|
Re: Question about Pool Size Expansion
Shohei,
you can add additional servers, see this in the manual:
https://docs.daos.io/admin/pool_operations/#pool-extension
kevin
________________________________________
Sent: Saturday, August
Shohei,
you can add additional servers, see this in the manual:
https://docs.daos.io/admin/pool_operations/#pool-extension
kevin
________________________________________
Sent: Saturday, August
|
By
Harms, Kevin
·
#1439
·
|
|
unable to configure raft service;no dRPC client set (data plane not started?)
Hello DAOS developers and users
I am trying to start a DAOS server with real SCM and NVme Devices.
After formating the storage device,the server complain "instance 0 exited: failed to start system db:
Hello DAOS developers and users
I am trying to start a DAOS server with real SCM and NVme Devices.
After formating the storage device,the server complain "instance 0 exited: failed to start system db:
|
By
21960347@...
·
#1438
·
|
|
Questions about Daos consistency
DAOS uses two-phase commit to ensure consistency between replicas. According to "src/vos/readme.md", read requests can be sent to any replica, but if this replica server has a network partition(the
DAOS uses two-phase commit to ensure consistency between replicas. According to "src/vos/readme.md", read requests can be sent to any replica, but if this replica server has a network partition(the
|
By
段世博
·
#1437
·
|
|
Question about Pool Size Expansion
Hi,
I have a question about expanding the size of existing pools online in DAOS v1.2? Is there any way to do it?
Thank you,
---
Shohei
Hi,
I have a question about expanding the size of existing pools online in DAOS v1.2? Is there any way to do it?
Thank you,
---
Shohei
|
By
shmatsuu@...
·
#1436
·
|
|
Re: Increasing FIO performance
Hi Eeheet,
You can use the fio DAOS engine (https://daos-stack.github.io/devbranch/admin/performance_tuning/#fio).
If you want to stick to dfuse, then I would advise to use the posixaio engine
Hi Eeheet,
You can use the fio DAOS engine (https://daos-stack.github.io/devbranch/admin/performance_tuning/#fio).
If you want to stick to dfuse, then I would advise to use the posixaio engine
|
By
Johann
·
#1435
·
|
|
Re: Question about DFS
Hi,
The DFS layer does not track openers, so the other client will be able to proceed and delete the file. The original opener will thus suddenly see an empty file.
Please note that if the two
Hi,
The DFS layer does not track openers, so the other client will be able to proceed and delete the file. The original opener will thus suddenly see an empty file.
Please note that if the two
|
By
Johann
·
#1434
·
|
|
Increasing FIO performance
Hi,
I’m an intern on the HPC team, and I’m trying to increase the performance of FIO on my server (wolf-169), admin/client (wolf-57). I attached a screencap of what I’m currently getting and
Hi,
I’m an intern on the HPC team, and I’m trying to increase the performance of FIO on my server (wolf-169), admin/client (wolf-57). I attached a screencap of what I’m currently getting and
|
By
Hayer, Eeheet <eeheet.hayer@...>
·
#1433
·
|
|
Question about DFS
While a file is opened by one client, can other clients delete the file? If it cannot be deleted, how is this guaranteed?
Thanks~
While a file is opened by one client, can other clients delete the file? If it cannot be deleted, how is this guaranteed?
Thanks~
|
By
段世博
·
#1432
·
Edited
|
|
Re: FIO Results & Running IO500
Hi Peter,
A few things to try/explore:
I don’t think that we have ever tested with 2x pmem DIMMs per socket. Maybe you could try with dram instead of pmem to see whether the performance
Hi Peter,
A few things to try/explore:
I don’t think that we have ever tested with 2x pmem DIMMs per socket. Maybe you could try with dram instead of pmem to see whether the performance
|
By
Johann
·
#1431
·
|
|
Re: Creating a POSIX container first and opening it inside my code
Hi Lipeng,
Assuming that you are using 1.2, you can create a POSIX container with the daos utility:
$ daos cont create --pool <POOL_UUID> --type POSIX
You get back a container UUID that you
Hi Lipeng,
Assuming that you are using 1.2, you can create a POSIX container with the daos utility:
$ daos cont create --pool <POOL_UUID> --type POSIX
You get back a container UUID that you
|
By
Johann
·
#1430
·
|
|
Re: Update to privileged helper
Try running the utils/setup_daos_admin.sh script as sudo.
The admin binary should be moved to /usr/bin/ with setuid.
Remove executable bit from install/bin/daos_admin.
These steps are performed
Try running the utils/setup_daos_admin.sh script as sudo.
The admin binary should be moved to /usr/bin/ with setuid.
Remove executable bit from install/bin/daos_admin.
These steps are performed
|
By
Nabarro, Tom
·
#1429
·
|
|
Re: Update to privileged helper
What are the manual steps? I tried using setuid and checking immutable bit, but I still get the privileged helper (daos_admin) does not have root permissions, e.g.,
# chmod u+s
What are the manual steps? I tried using setuid and checking immutable bit, but I still get the privileged helper (daos_admin) does not have root permissions, e.g.,
# chmod u+s
|
By
Ethan Mallove <ethanx.a.mallove@...>
·
#1428
·
|
|
Re: FIO Results & Running IO500
Thank you for the reply,
Yes, I have mounted the Optane modules as an ext4 filesystem; a quick FIO test is able to achieve > 1 MIOPs.
My thought was that it would be network related, however I've
Thank you for the reply,
Yes, I have mounted the Optane modules as an ext4 filesystem; a quick FIO test is able to achieve > 1 MIOPs.
My thought was that it would be network related, however I've
|
By
Peter <magpiesaresoawesome@...>
·
#1427
·
|
|
Re: FIO Results & Running IO500
Hi,
Have you tried benchmarking the hardware directly, rather than through
DAOS? i.e. running some benchmarks just on an ext4 filesystem mounted on
the Optane on a single node. Just to check that
Hi,
Have you tried benchmarking the hardware directly, rather than through
DAOS? i.e. running some benchmarks just on an ext4 filesystem mounted on
the Optane on a single node. Just to check that
|
By
JACKSON Adrian
·
#1426
·
|