|
Re: High latency in metada write
Hi Johann:
So you mean that although the operation over SCM is fast, but several sequential operations over SCM may result in the high latency?
Here is the test in my server with
Hi Johann:
So you mean that although the operation over SCM is fast, but several sequential operations over SCM may result in the high latency?
Here is the test in my server with
|
By
shadow_vector@...
·
#1538
·
|
|
Re: High latency in metada write
Hi,
A DAOS update operation actually results in several sequential latency-sensitive operations over SCM to locate the object/dkey/akey (and create the associated trees if those don’t exist
Hi,
A DAOS update operation actually results in several sequential latency-sensitive operations over SCM to locate the object/dkey/akey (and create the associated trees if those don’t exist
|
By
Lombardi, Johann
·
#1537
·
|
|
Re: High latency in metada write
Hi Johann:
Tansks for the information. I have checked the latency in the online documentation, about 12 us for update, much lower than that in my test. But I think SCM would be much faster while the
Hi Johann:
Tansks for the information. I have checked the latency in the online documentation, about 12 us for update, much lower than that in my test. But I think SCM would be much faster while the
|
By
shadow_vector@...
·
#1536
·
|
|
Re: High latency in metada write
Hi there,
I don’t think that we have ever run any benchmarks with only 2x Optane DIMMs. Maybe you could start by running vos_perf and compare to the results we have in the online
Hi there,
I don’t think that we have ever run any benchmarks with only 2x Optane DIMMs. Maybe you could start by running vos_perf and compare to the results we have in the online
|
By
Lombardi, Johann
·
#1535
·
|
|
Re: High latency in metada write
Thansks for reponseing. And can you share your latency in you internal testing?
Best Regards!
Thansks for reponseing. And can you share your latency in you internal testing?
Best Regards!
|
By
shadow_vector@...
·
#1534
·
|
|
Re: External API
When I replied last week I forgot to mention, we do have a control API written in Go, which you could also use for this purpose:https://github.com/daos-stack/daos/tree/master/src/control/lib/control
When I replied last week I forgot to mention, we do have a control API written in Go, which you could also use for this purpose:https://github.com/daos-stack/daos/tree/master/src/control/lib/control
|
By
Jacque, Kristin
·
#1533
·
|
|
Re: External API
You should use dmg storage format. As things stand, we don’t enable users to call the administrative gRPC methods directly. The API is internal and may change.
Thanks,
Kris
You should use dmg storage format. As things stand, we don’t enable users to call the administrative gRPC methods directly. The API is internal and may change.
Thanks,
Kris
|
By
Jacque, Kristin
·
#1532
·
|
|
External API
After services started, I'll format pmem and nvme (from code).
Need to exec 'dmg storage format' or can call 'ctlpb.CtlSvcClient.StorageFormat'?
Can I use dRPC for control daos_server?
Or in the
After services started, I'll format pmem and nvme (from code).
Need to exec 'dmg storage format' or can call 'ctlpb.CtlSvcClient.StorageFormat'?
Can I use dRPC for control daos_server?
Or in the
|
By
d.korekovcev@...
·
#1531
·
|
|
Re: High latency in metada write
Here is my HW configuration:
CPU: Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
SCM:2 SCM ,256GB
I use array interface in this test and set the obj class to OC_RP_3GX. 32GB for hugepage
Here is my HW configuration:
CPU: Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
SCM:2 SCM ,256GB
I use array interface in this test and set the obj class to OC_RP_3GX. 32GB for hugepage
|
By
shadow_vector@...
·
#1530
·
|
|
Re: Post DAOS 2.0 installation and comments and questions
Might take a few days till I'm back working on that setup, but will update. As far as I remember, no output what so ever was printed though.
Might take a few days till I'm back working on that setup, but will update. As far as I remember, no output what so ever was printed though.
|
By
Omer
·
#1529
·
|
|
Re: Post DAOS 2.0 installation and comments and questions
Omer,
I’d be interested in seeing the stdout/stderr and logging from dfuse where this is happening. As you say the -f option should make it run in the foreground so if you’re not passing this
Omer,
I’d be interested in seeing the stdout/stderr and logging from dfuse where this is happening. As you say the -f option should make it run in the foreground so if you’re not passing this
|
By
Pittman, Ashley M
·
#1528
·
|
|
Re: Post DAOS 2.0 installation and comments and questions
Hi,
Thanks for your reply.
1. I saw :). Cool.
2. I used to build DAOS and install it, so I had a script that did that for me, but yes, with RPM based solution this shouldn't be a concern. I fixed my
Hi,
Thanks for your reply.
1. I saw :). Cool.
2. I used to build DAOS and install it, so I had a script that did that for me, but yes, with RPM based solution this shouldn't be a concern. I fixed my
|
By
Omer
·
#1527
·
|
|
Re: Post DAOS 2.0 installation and comments and questions
Hi there,
Thanks for reaching out.
The online doc has been fixed and now specifies a different URL for CentOS7 and 8.
/var/run/daos_agent should be automatically created after enabling/starting
Hi there,
Thanks for reaching out.
The online doc has been fixed and now specifies a different URL for CentOS7 and 8.
/var/run/daos_agent should be automatically created after enabling/starting
|
By
Lombardi, Johann
·
#1526
·
|
|
Re: High latency in metada write
Hi there,
Could you please tell us more about your HW configuration and the test case (e.g. I/O size, read or write, object class, …)? We definitely see lower latency in our internal testing.
Hi there,
Could you please tell us more about your HW configuration and the test case (e.g. I/O size, read or write, object class, …)? We definitely see lower latency in our internal testing.
|
By
Lombardi, Johann
·
#1525
·
|
|
Post DAOS 2.0 installation and comments and questions
Some post DAOS 2.0 installation and comments and questions:
1. We use a mix of CentOS 7 and 8 in our setup. However, the DAOS online documentation at "https://docs.daos.io/v2.0/QSG/setup_centos/"
Some post DAOS 2.0 installation and comments and questions:
1. We use a mix of CentOS 7 and 8 in our setup. However, the DAOS online documentation at "https://docs.daos.io/v2.0/QSG/setup_centos/"
|
By
Omer
·
#1524
·
|
|
High latency in metada write
Hello everyone:
Recently, I did some testing with daos array interface, found that after finishing nvme bio, it took me a long time for writing metadata and resource release ; The total latency of
Hello everyone:
Recently, I did some testing with daos array interface, found that after finishing nvme bio, it took me a long time for writing metadata and resource release ; The total latency of
|
By
shadow_vector@...
·
#1523
·
|
|
Re: Questions about ULT Schedule
Hi,
In your example, the ULT will be tracked in the wait list from “ABT_future” on waiting, once it’s waked up, it’ll be pushed back to a runnable ULT FIFO list (per ABT pool, maintained
Hi,
In your example, the ULT will be tracked in the wait list from “ABT_future” on waiting, once it’s waked up, it’ll be pushed back to a runnable ULT FIFO list (per ABT pool, maintained
|
By
Niu, Yawei
·
#1522
·
|
|
Re: Unable to build libmfu properly
I’m not sure why the libraries aren’t being linked/loaded – maybe someone more knowledgeable on the DAOS team has an idea. The make command does include the libraries, and the libraries are
I’m not sure why the libraries aren’t being linked/loaded – maybe someone more knowledgeable on the DAOS team has an idea. The make command does include the libraries, and the libraries are
|
By
Bohning, Dalton
·
#1520
·
|
|
Re: Unable to build libmfu properly
Yes, the same errors.
daos_agent@sw2:~/git/mpifileutils/build$ export LD_LIBRARY_PATH=${MY_DAOS_INSTALL_PATH}/lib64:$LD_LIBRARY_PATH
daos_agent@sw2:~/git/mpifileutils/build$ echo
Yes, the same errors.
daos_agent@sw2:~/git/mpifileutils/build$ export LD_LIBRARY_PATH=${MY_DAOS_INSTALL_PATH}/lib64:$LD_LIBRARY_PATH
daos_agent@sw2:~/git/mpifileutils/build$ echo
|
By
netsurfed
·
#1519
·
|
|
Re: Unable to build libmfu properly
Will you try appending ${MY_DAOS_INSTALL_PATH}/lib64 to your LD_LIBRARY_PATH and re-run the “make” command?
export LD_LIBRARY_PATH=${MY_DAOS_INSTALL_PATH}/lib64:$LD_LIBRARY_PATH
~Dalton
Will you try appending ${MY_DAOS_INSTALL_PATH}/lib64 to your LD_LIBRARY_PATH and re-run the “make” command?
export LD_LIBRARY_PATH=${MY_DAOS_INSTALL_PATH}/lib64:$LD_LIBRARY_PATH
~Dalton
|
By
Bohning, Dalton
·
#1518
·
|