|
Re: DPI_SPACE query after extending pool
Could you double check if creating container would cause NVMe free space dropping? If it’s true, please open a ticket for further investigation. I can’t think of why container creation could
Could you double check if creating container would cause NVMe free space dropping? If it’s true, please open a ticket for further investigation. I can’t think of why container creation could
|
By
Niu, Yawei
·
#1622
·
|
|
Re: DPI_SPACE query after extending pool
If the space change isn't caused by reservation, what else might be causing this? What other things might I check?
From: daos@daos.groups.io <daos@daos.groups.io> on behalf of Niu, Yawei
If the space change isn't caused by reservation, what else might be causing this? What other things might I check?
From: daos@daos.groups.io <daos@daos.groups.io> on behalf of Niu, Yawei
|
By
Tuffli, Chuck
·
#1621
·
|
|
Re: DPI_SPACE query after extending pool
Hi, Chuck
The reserved space is per pool, it’s not relevant with container creation, so I think the space change you observed after container creation isn’t caused by space reservation.
Hi, Chuck
The reserved space is per pool, it’s not relevant with container creation, so I think the space change you observed after container creation isn’t caused by space reservation.
|
By
Niu, Yawei
·
#1620
·
|
|
Re: DPI_SPACE query after extending pool
Thank you, Niu
After thinking about what you said and running some additional experiments, I believe everything is working as you described.
I created a 500 GB pool and added a POSIX container. After
Thank you, Niu
After thinking about what you said and running some additional experiments, I believe everything is working as you described.
I created a 500 GB pool and added a POSIX container. After
|
By
Tuffli, Chuck
·
#1619
·
|
|
Re: Slack Invite
Hi Lombardi,
Yes finally I got the invite, thanks!
--
Best Regards
Kevin Zhao
Tech Lead, LDCG Cloud Infrastructure
Linaro Vertical Technologies
IRC(freenode): kevinz
Slack(kubernetes.slack.com):
Hi Lombardi,
Yes finally I got the invite, thanks!
--
Best Regards
Kevin Zhao
Tech Lead, LDCG Cloud Infrastructure
Linaro Vertical Technologies
IRC(freenode): kevinz
Slack(kubernetes.slack.com):
|
By
Kevin Zhao
·
#1618
·
|
|
DAOS Community Update / June'22
Hi there,
Please find below the DAOS community newsletter for June 2022.
Past Events
Salishan Conference On High Speed Computing (April 26th)
Accelerating Data-driven Workflows with
Hi there,
Please find below the DAOS community newsletter for June 2022.
Past Events
Salishan Conference On High Speed Computing (April 26th)
Accelerating Data-driven Workflows with
|
By
Lombardi, Johann
·
#1617
·
|
|
Re: DPI_SPACE query after extending pool
Hi, Chuck
The “used space” (total – free) is kind of OP (over-provisioning), you know that DAOS server has to reserve some space on both SCM and NVMe to ensure punch, container/object
Hi, Chuck
The “used space” (total – free) is kind of OP (over-provisioning), you know that DAOS server has to reserve some space on both SCM and NVMe to ensure punch, container/object
|
By
Niu, Yawei
·
#1616
·
|
|
Re: DPI_SPACE query after extending pool
Hello Chunk
That is strange. According the output of dmg pool query, 83 objects were deleted after extend, so some space should be reclaimed.
“dmg pool query kiddie
………
Rebuild
Hello Chunk
That is strange. According the output of dmg pool query, 83 objects were deleted after extend, so some space should be reclaimed.
“dmg pool query kiddie
………
Rebuild
|
By
Wang, Di
·
#1615
·
|
|
Re: DPI_SPACE query after extending pool
Wangdi
When I checked this morning, the pool had been idle four days, but the values from daos_pool_query() have not changed.
As for object class, I'm not sure. Pool creation didn't specify a class.
Wangdi
When I checked this morning, the pool had been idle four days, but the values from daos_pool_query() have not changed.
As for object class, I'm not sure. Pool creation didn't specify a class.
|
By
Tuffli, Chuck
·
#1614
·
|
|
Re: Slack Invite
Hi Kevin,
I see you on slack, so I assume that you eventually got the invite.
Cheers,
Johann
From:<daos@daos.groups.io> on behalf of Kevin Zhao <kevin.zhao@...>
Reply-To:
Hi Kevin,
I see you on slack, so I assume that you eventually got the invite.
Cheers,
Johann
From:<daos@daos.groups.io> on behalf of Kevin Zhao <kevin.zhao@...>
Reply-To:
|
By
Lombardi, Johann
·
#1613
·
|
|
Slack Invite
Hi DAOS,
I've followed the guide to join the DAOS mailist, but I don't receive the automatically invite to join the Slack. Cloud you help to send me the invite? Thanks!
--
Best Regards
Kevin
Hi DAOS,
I've followed the guide to join the DAOS mailist, but I don't receive the automatically invite to join the Slack. Cloud you help to send me the invite? Thanks!
--
Best Regards
Kevin
|
By
Kevin Zhao
·
#1612
·
|
|
Re: mmap support with a dfuse-mounted posix conntainer
So, you may want to use mmap() without MAP_SHARED when using DFuse"--disable-caching" option ??
What do you think ?
From: <daos@daos.groups.io> on behalf of Bruno Faccini <bruno.faccini@...>
Reply
So, you may want to use mmap() without MAP_SHARED when using DFuse"--disable-caching" option ??
What do you think ?
From: <daos@daos.groups.io> on behalf of Bruno Faccini <bruno.faccini@...>
Reply
|
By
Faccini, Bruno
·
#1611
·
|
|
Re: mmap support with a dfuse-mounted posix conntainer
Ok, I can reproduce the behaviour you have reported.
Having a look to the related source code, this may come from the fact if caching is disabled, DFuse automatically/silently switches to
Ok, I can reproduce the behaviour you have reported.
Having a look to the related source code, this may come from the fact if caching is disabled, DFuse automatically/silently switches to
|
By
Faccini, Bruno
·
#1610
·
|
|
Re: mmap support with a dfuse-mounted posix conntainer
Hi Bruno,
Thank you very much for checking! I'm using DAOS v2.0.1.One thing I forgot to mention previously is that I mounted the POSIX container with dfuse "--disable-caching" and got an error from
Hi Bruno,
Thank you very much for checking! I'm using DAOS v2.0.1.One thing I forgot to mention previously is that I mounted the POSIX container with dfuse "--disable-caching" and got an error from
|
By
shmatsuu@...
·
#1609
·
|
|
Re: mmap support with a dfuse-mounted posix conntainer
Well, I just tried your test-case on my test-bed and you program just works as expected, no error from mmap() !
Well, I just tried your test-case on my test-bed and you program just works as expected, no error from mmap() !
|
By
Faccini, Bruno
·
#1608
·
|
|
mmap support with a dfuse-mounted posix conntainer
Hi,
I have a very quick question about the below selection in Posix compliance. From a single DAOS client node, is mmap with MAP_SHARED supported from the client node against a file on a DAOS POSIX
Hi,
I have a very quick question about the below selection in Posix compliance. From a single DAOS client node, is mmap with MAP_SHARED supported from the client node against a file on a DAOS POSIX
|
By
shmatsuu@...
·
#1607
·
|
|
Re: New to DAOS: Storage Pools
It's also possible to define pool that only use one particular storage
class (i.e. a pool of just SCM or a pool on NVME) but as Kevin says,
it's up to you to put data in a specific
It's also possible to define pool that only use one particular storage
class (i.e. a pool of just SCM or a pool on NVME) but as Kevin says,
it's up to you to put data in a specific
|
By
JACKSON Adrian
·
#1606
·
|
|
Re: New to DAOS: Storage Pools
That's an important differentiating point, Kevin, thank you, and it does make a lot of sense to me.
Thank you,
David
That's an important differentiating point, Kevin, thank you, and it does make a lot of sense to me.
Thank you,
David
|
By
TheCTEgroup
·
#1605
·
Edited
|
|
Re: New to DAOS: Storage Pools
In my opinion, I would not say that DAOS has tiers. It does support a configuration for small writes landing in PMEM and then a later aggregation service will batch them into the NVME. However, there
In my opinion, I would not say that DAOS has tiers. It does support a configuration for small writes landing in PMEM and then a later aggregation service will batch them into the NVME. However, there
|
By
Harms, Kevin
·
#1604
·
|
|
Re: DPI_SPACE query after extending pool
Hello Chuck
Pool extend might migrate the data to the new pool target, then the original data will be delete asynchronous, so those space might be reclaimed a few mins later if the system is not
Hello Chuck
Pool extend might migrate the data to the new pool target, then the original data will be delete asynchronous, so those space might be reclaimed a few mins later if the system is not
|
By
Wang, Di
·
#1603
·
|