Hi there,

Please find below the DAOS community newsletter for April 2022.

Past Events

• Dell Technologies HPC Community Event (February 9^th)
  DAOS: High Performance Storage for All HPC Workloads and Scales
  Kelsey Prantis (Intel)
  https://www.dellhpc.org/event_2-9-2022.html
• 2022 Energy HPC Conference (March 3^rd)
  DAOS Use at Argonne
  Kevin Harms (Argonne)
  Johann Lombardi (Intel)
  Mohamad Chaarawi (Intel)
  https://energyhpc.rice.edu/program/

Upcoming Events

• Salishan Conference On High Speed Computing (April 26^th)
  Accelerating Data-driven Workflows with DAOS
  Johann Lombardi (Intel)
• ECP BoF (May 11^th)
  DAOS Next Generation Storage
  Kevin Harms (ANL)
  Mohamad Chaarawi (Intel)
  Johann Lombardi (Intel)
• ISC BoF (May 30^th or June 1^st)
  Accelerating HPC and AI with DAOS Storage
  Kevin Harms (ANL)
  Michael Hennecke (Intel)
  Johann Lombardi (Intel)

Release

• Current stable release is 2.0.2. See https://docs.daos.io/v2.0/ and https://packages.daos.io/v2.0/ for more information.
• Branches:
• release/2.0 is the release branch for the stable 2.0 release. Latest bug fix release is 2.0.2.
• release/2.2 has been created earlier this week for the future 2.2 release. Latest test build is 2.1.101.
• Master is the development branch for the future 2.4 release. Latest test build is 2.3.100.
• Major recent changes on release/2.0:
• Several documentation fixes
• Several test fixes
• Avoid holding CPU for too long in DTX
• Fix intermittent failure that can occur when a node loses MS leadership and regains it
• Major recent changes on release/2.2 and master (same for now):
• Add UCX support to the CART and the control plane
• Add UCX support to the RPM
• Update dmg query command to show the list of excluded engines in a pool.
• Add support to core_dump_filter to the server yaml file
• Several aggregation/reclaim improvements
• Add pool versioning and upgrade capability for interoperability with 2.0.
• Add interoperability check to the control plane
• Rewrite netdetect in the control plane
• Report accurate mtime via libdfs/dfuse by using DAOS internal versioning scheme
• Several coverity fixes
• Remove CentOS 8 support and move build/testing to Rocky Linux 8.5
• Add tensorflow-IO documentation
• Use strict CPU binding for the engine
• Improve response time of dmg pool list
• What is coming:
• 2.2.0 testing and code freeze
• 2.4 features to land to master

R&D

• Major features under development:
• Checksum scrubber (targeted for 2.4)
• Catastrophic recovery / distributed fsck
• API to collect libdaos metrics to be integrated with Darshan (targeted for 2.4)
• Multi-user dfuse (targeted for 2.4)
• More aggressive caching in dfuse for AI APPs (targeted for 2.4)
• TensorFlow-IO plugin for DFS
• https://github.com/daos-stack/tensorflow-io-daos/blob/devel/docs/daos_tf_docs.md
• https://docs.daos.io/v2.2/user/tensorflow/
• LDMS plugin to export DAOS metrics
• Pathfinding:
• DAOS Pipeline API for active storage
• Work in progress to support pipeline API in the engine
• Use cases under development:
• MariaDB DAOS engine with predicate pushdown to the DAOS storage nodes https://github.com/daos-stack/mariadb
• Accelerated find
• Leveraging the Intel Data Streaming Accelerator (DSA) to accelerate DAOS
• Prototype leveraging DSA for VOS aggregation delivered
• S3 support via a DAOS backend to Rados Gateway (RGW)
• Block interface over DAOS using SPDK DAOS bdev
• GPU data path optimizations

News

• Ivan Poddubnyy joins the Intel DAOS team as the new Community Support and Enablement manager.
• Sodacode 2022 hackathon is still underway. The list of DAOS activities offered in this hackathon has been created in jira: https://daosio.atlassian.net/browse/DAOS-10010?jql=labels%20%3D%20%22SODACODE2022%22%20and%20statusCategory%20!%3D%20Done

See https://events.linuxfoundation.org/sodacode/ for more information.