Re: DAOS server rpm installation failure
Thanks a lot, my problem was with the wrong repository selection.
toggle quoted messageShow quoted text
Regards Krishnalal.K.K Scientist E Control and Instrumentation Group C-DAC, Thiruvananthapuram Ph: 0471-2723333-445 Mob: 9895317126
-----Original Message-----
From: daos@daos.groups.io [mailto:daos@daos.groups.io] On Behalf Of Murrell, Brian Sent: 23 January 2023 09:20 PM To: daos@daos.groups.io Subject: Re: [daos] DAOS server rpm installation failure On Mon, 2023-01-23 at 10:06 +0530, Krishnalal K K wrote: Hi,Hi. I am using the same guide u mentioned. I am using Rocky Linux 8.6.^^^ You appear to be installing the EL7 packages on EL8. You should be installing the EL8 packages as Rocky Linux 8.6 is an EL8 distro. Specifically, you need to follow the 'For EL8:' not 'For CentOS7:' sections of the guide (https://docs.daos.io/v2.2/QSG/setup_rhel/#rpm-installation). Cheers, b. ---------------------------------------------------------------------------- -------------------------------- [ C-DAC is on Social-Media too. Kindly follow us at: Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ] This e-mail is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies and the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email is strictly prohibited and appropriate legal action will be taken. ---------------------------------------------------------------------------- -------------------------------- ------------------------------------------------------------------------------------------------------------ [ C-DAC is on Social-Media too. Kindly follow us at: Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ] This e-mail is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies and the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email is strictly prohibited and appropriate legal action will be taken. ------------------------------------------------------------------------------------------------------------
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server rpm installation failure
Murrell, Brian
On Mon, 2023-01-23 at 10:06 +0530, Krishnalal K K wrote:
Hi,Hi. I am using the same guide u mentioned. I am using Rocky Linux 8.6.^^^ You appear to be installing the EL7 packages on EL8. You should be installing the EL8 packages as Rocky Linux 8.6 is an EL8 distro. Specifically, you need to follow the 'For EL8:' not 'For CentOS7:' sections of the guide (https://docs.daos.io/v2.2/QSG/setup_rhel/#rpm-installation). Cheers, b.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server rpm installation failure
The dependency versions are not met, you need >= 3.4.2 but you have 3.3.0
From: daos@daos.groups.io <daos@daos.groups.io>
On Behalf Of Krishnalal K K
Hi, I am using the same guide u mentioned. I am using Rocky Linux 8.6. Mostly I am getting errors in dependencies. I have installed the dependency libraries, but still it is saying it is not installed. Please see below. Is I am missing any configuration or doing wrongly.
[daos@client-1 Downloads]$ sudo yum install -y daos-client
Regards Krishnalal.K.K Scientist E Control and Instrumentation Group C-DAC, Thiruvananthapuram Ph: 0471-2723333-445 Mob: 9895317126
From:
daos@daos.groups.io [mailto:daos@daos.groups.io]
On Behalf Of Nabarro, Tom
Which installation guide have you been following? What step is failing and how is it failing?
Instructions for red-hat related distros are here: https://docs.daos.io/v2.2/QSG/setup_rhel/
Regards, Tom
From:
daos@daos.groups.io <daos@daos.groups.io>
On Behalf Of Krishnalal K K
Hi all, I am a new user to DAOS. I am exploring the possibilities of DAOS for the replacement of Lustre. Can anybody can share the installation steps of DAOS 2.2 on Rocky Linux 8.6. As I am facing lot of dependency error on the installation of daos_server module in a DAOS server system. I am trying to install the daos_server in a virtual machine.
Please help for completing the daos_server installation
Regards Krishnalal.K.K
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server rpm installation failure
Hi, I am using the same guide u mentioned. I am using Rocky Linux 8.6. Mostly I am getting errors in dependencies. I have installed the dependency libraries, but still it is saying it is not installed. Please see below. Is I am missing any configuration or doing wrongly.
[daos@client-1 Downloads]$ sudo yum install -y daos-client
Regards Krishnalal.K.K Scientist E Control and Instrumentation Group C-DAC, Thiruvananthapuram Ph: 0471-2723333-445 Mob: 9895317126
From: daos@daos.groups.io [mailto:daos@daos.groups.io] On Behalf Of Nabarro, Tom
Sent: 20 January 2023 08:04 PM To: daos@daos.groups.io Subject: Re: [daos] DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
Which installation guide have you been following? What step is failing and how is it failing?
Instructions for red-hat related distros are here: https://docs.daos.io/v2.2/QSG/setup_rhel/
Regards, Tom
From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of Krishnalal K K
Hi all, I am a new user to DAOS. I am exploring the possibilities of DAOS for the replacement of Lustre. Can anybody can share the installation steps of DAOS 2.2 on Rocky Linux 8.6. As I am facing lot of dependency error on the installation of daos_server module in a DAOS server system. I am trying to install the daos_server in a virtual machine.
Please help for completing the daos_server installation
Regards Krishnalal.K.K
------------------------------------------------------------------------------------------------------------ [ C-DAC is on Social-Media too. Kindly follow us at: Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ] This e-mail is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies and the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email is strictly prohibited and appropriate legal action will be taken. ------------------------------------------------------------------------------------------------------------
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
Murrell, Brian
On Thu, 2023-01-19 at 15:55 +0530, Krishnalal K K wrote:
Are you creating the /etc/yum.repos.d/daos-packages.repo file with $ pdsh -w $ALL_NODES 'sudo wget -O /etc/yum.repos.d/daos-packages.repo https://packages.daos.io/v2.2/EL8/packages/x86_64/daos_packages.repo' as directed by https://docs.daos.io/v2.2/QSG/setup_rhel/#rpm-installation before you try to install any daos-* packages? Likely the missing dependencies are in that repo, if you have all of the other standard Rocky 8 repos installed, including EPEL (which is also described in the above URL): $ pdsh -w $ALL_NODES 'sudo yum install -y epel-release' If you have done all of that, your full command-line and *all* of the output from it would be most useful in helping you to try and diagnose the issue. Cheers, b.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
Which installation guide have you been following? What step is failing and how is it failing?
Instructions for red-hat related distros are here: https://docs.daos.io/v2.2/QSG/setup_rhel/
Regards, Tom
From: daos@daos.groups.io <daos@daos.groups.io>
On Behalf Of Krishnalal K K
Hi all, I am a new user to DAOS. I am exploring the possibilities of DAOS for the replacement of Lustre. Can anybody can share the installation steps of DAOS 2.2 on Rocky Linux 8.6. As I am facing lot of dependency error on the installation of daos_server module in a DAOS server system. I am trying to install the daos_server in a virtual machine.
Please help for completing the daos_server installation
Regards Krishnalal.K.K
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
Hi all, I am a new user to DAOS. I am exploring the possibilities of DAOS for the replacement of Lustre. Can anybody can share the installation steps of DAOS 2.2 on Rocky Linux 8.6. As I am facing lot of dependency error on the installation of daos_server module in a DAOS server system. I am trying to install the daos_server in a virtual machine.
Please help for completing the daos_server installation
Regards Krishnalal.K.K
------------------------------------------------------------------------------------------------------------ [ C-DAC is on Social-Media too. Kindly follow us at: Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ] This e-mail is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies and the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email is strictly prohibited and appropriate legal action will be taken. ------------------------------------------------------------------------------------------------------------
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
DAOS server installation failure- dependency errors
Hi all, I am a new user to DAOS. I am exploring the possibilities of DAOS for the replacement of Lustre. Can anybody can share the installation steps of DAOS 2.2 on Rocky Linux 8.6. As I am facing lot of dependency error on the installation of daos_server module in a DAOS server system. I am trying to install the daos_server in a virtual machine.
Please help for completing the daos_server installation
Regards Krishnalal.K.K
Regards Krishnalal.K.K Scientist E Control and Instrumentation Group C-DAC, Thiruvananthapuram Ph: 0471-2723333-445 Mob: 9895317126
------------------------------------------------------------------------------------------------------------ [ C-DAC is on Social-Media too. Kindly follow us at: Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ] This e-mail is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies and the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email is strictly prohibited and appropriate legal action will be taken. ------------------------------------------------------------------------------------------------------------
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
[DUG'22] DAOS User Group replay is available.
Kudryavtsev, Andrey O
Greetings DAOS Community!
Thank you to everybody for attending DUG'22 event in person or being able to join remotely. We recorded presentations, so they are available for replay as well as slides shared separately. The content is now posted on DUG website: http://dug.daos.io
-- Andrey Kudryavtsev, DAOS Product Manager Intel Corp.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Logfile rotation
john.mechalas@...
What steps need to be taken when rotating log files from a running daos_agent or daos_server instance? Do they need a signal/restart/reload? If so, is there something more graceful than a full restart of the daemon that will get them to reopen the logfile for writing?
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: [DUG'22] DAOS User Group virtual meeting details
Mora Acosta, Josue
Is there an abstract for each of the presentations so we can be selective on what to attend ?
Thanks, Joshua
From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of
Kudryavtsev, Andrey O
Dear DAOS community, The final agenda is posted and we added virtual meeting details for those who are not able to join us in person. Those who are travelling, have a safe trip. We can wait to see you in person in Dallas.
-- Andrey Kudryavtsev, DAOS Product Manager Intel Corp.
From: Andrey O Kudryavtsev <andrey.o.kudryavtsev@...>
Dear DAOS community, Following the email I sent earlier, DAOS team is proud to announce DUG'22 details and the agenda.
Date: November 14th, 9:00am-1:00pm CT Event Location: Venetian Room, Fairmont Hotel (1717 N Akard St, Dallas, TX 75201)
Based on the feedback you provided, we are going to make it hybrid. We will be glad to see many of you in person and welcome others to join remotely who can’t make SC this year. The details for remote connection will be shared later.
Agenda:
* agenda may have some changes later.
Please, also take a moment to stop by other DAOS session during workshop, tutorials and official SC program. We have the large presence this year in many of those, including with our partners.
SC22 Tutorial, Workshop and Program:
· SC'22 Tutorial (Nov 14 at 8:30am CST)
Emerging Storage Interfaces: DAOS and PMDK · SuperCheck-SC'22 (Nov 14 at 8:35am CST)
DAOS: Nextgen Storage Stack for HPC and AI · PDSW (Nov 14 at 3:30pm CST) Performance Comparison of DAOS and Lustre for Object Data Storage Approaches http://www.pdsw.org/index.shtml Nicolau Manubens Gil (ECMWF) Simon Smart (ECMWF) Tiago Quintino (ECMWF) Adrian Jackson (EPCC) · SC'22 BoF (Nov 16 at 5:15pm CST)
DAOS Storage Community BoF · SC'22 BoF (Nov 17 at 12:15pm CST)
The Storage Tower of Babel? ... Not! Actually, maybe?
SC22 Exhibition:
· Intel booth presentations at SC22 Showcase
Panel: Google
Cloud Platform (GCP) and Intel DAOS Further HPC Data Pipeline Optimization (Nov
15 at 3:30pm CST) Dean Hildebrand (Google) Kelsey Prantis (Intel) Tech Talk: Aurora DAOS Storage Innovation at Argonne National Laboratory (Nov 16 at 3:30pm CST) Kevin Harms (ANL) Tech Talk: Cambridge University is Tackling Tomorrow’s Problems Today (Nov 16 at 11:00am CST) Paul Calleja (UoC) · Google booth at SC22 Showcase (all time) DAOS Storage live demo in GCP environment Margaret Lawson (Google) · Croit booth at SC22 Showcase (all time) DAOS live demo running Block and NFS interface with Croit.io Denis Nuja (Croit)
All the best, DAOS team.
-- Andrey Kudryavtsev, DAOS Product Manager Intel Corp.
From: Andrey O Kudryavtsev <andrey.o.kudryavtsev@...>
Greetings DAOS Community!
SC22 is around the corner and it means we have a special event coming again. The Intel DAOS team invites you to join us for the 6th annual DAOS User Group (DUG22). This will be the first in-person user group since the pandemic.
The agenda is not yet finalized and we’re inviting the community members to submit their presentation proposals. Please, send brief submissions to daos-info@daos.groups.io and keep me copied. If you have any feedback to share, what you want to see the most, type of presentations, areas to cover and others to listen, - don’t hesitate to contact me directly. This is the event we make for you!
The event will take place on November 14th from 9am until 1pm. We did our best to avoid overlaps with other activities and that’s why Monday was selected. We hope it fits your plans and the agenda and doesn’t overlap with other workshops and tutorials that day.
Event Location: Venetian Room, Fairmont Hotel (1717 N Akard St, Dallas, TX 75201), which is within one mile from the Kay Bailey Hutchison Convention Center.
Additional details will be shared once the agenda is finalized. We hope to see you all in person.
Best Regards, Andrey, Kelsey, Johann and the rest of the DAOS team.
-- Andrey Kudryavtsev, DAOS Product Manager Intel Corp.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
[DUG'22] DAOS User Group virtual meeting details
Kudryavtsev, Andrey O
Dear DAOS community, The final agenda is posted and we added virtual meeting details for those who are not able to join us in person. Those who are travelling, have a safe trip. We can wait to see you in person in Dallas.
-- Andrey Kudryavtsev, DAOS Product Manager Intel Corp.
From: Andrey O Kudryavtsev <andrey.o.kudryavtsev@...>
Dear DAOS community, Following the email I sent earlier, DAOS team is proud to announce DUG'22 details and the agenda.
Date: November 14th, 9:00am-1:00pm CT Event Location: Venetian Room, Fairmont Hotel (1717 N Akard St, Dallas, TX 75201)
Based on the feedback you provided, we are going to make it hybrid. We will be glad to see many of you in person and welcome others to join remotely who can’t make SC this year. The details for remote connection will be shared later.
Agenda:
* agenda may have some changes later.
Please, also take a moment to stop by other DAOS session during workshop, tutorials and official SC program. We have the large presence this year in many of those, including with our partners.
SC22 Tutorial, Workshop and Program:
· SC'22 Tutorial (Nov 14 at 8:30am CST)
Emerging Storage Interfaces: DAOS and PMDK · SuperCheck-SC'22 (Nov 14 at 8:35am CST)
DAOS: Nextgen Storage Stack for HPC and AI · PDSW (Nov 14 at 3:30pm CST) Performance Comparison of DAOS and Lustre for Object Data Storage Approaches http://www.pdsw.org/index.shtml Nicolau Manubens Gil (ECMWF) Simon Smart (ECMWF) Tiago Quintino (ECMWF) Adrian Jackson (EPCC) · SC'22 BoF (Nov 16 at 5:15pm CST)
DAOS Storage Community BoF · SC'22 BoF (Nov 17 at 12:15pm CST)
The Storage Tower of Babel? ... Not! Actually, maybe?
SC22 Exhibition:
· Intel booth presentations at SC22 Showcase
Panel: Google
Cloud Platform (GCP) and Intel DAOS Further HPC Data Pipeline Optimization (Nov
15 at 3:30pm CST) Dean Hildebrand (Google) Kelsey Prantis (Intel) Tech Talk: Aurora DAOS Storage Innovation at Argonne National Laboratory (Nov 16 at 3:30pm CST) Kevin Harms (ANL) Tech Talk: Cambridge University is Tackling Tomorrow’s Problems Today (Nov 16 at 11:00am CST) Paul Calleja (UoC) · Google booth at SC22 Showcase (all time) DAOS Storage live demo in GCP environment Margaret Lawson (Google) · Croit booth at SC22 Showcase (all time) DAOS live demo running Block and NFS interface with Croit.io Denis Nuja (Croit)
All the best, DAOS team.
-- Andrey Kudryavtsev, DAOS Product Manager Intel Corp.
From: Andrey O Kudryavtsev <andrey.o.kudryavtsev@...>
Greetings DAOS Community!
SC22 is around the corner and it means we have a special event coming again. The Intel DAOS team invites you to join us for the 6th annual DAOS User Group (DUG22). This will be the first in-person user group since the pandemic.
The agenda is not yet finalized and we’re inviting the community members to submit their presentation proposals. Please, send brief submissions to daos-info@daos.groups.io and keep me copied. If you have any feedback to share, what you want to see the most, type of presentations, areas to cover and others to listen, - don’t hesitate to contact me directly. This is the event we make for you!
The event will take place on November 14th from 9am until 1pm. We did our best to avoid overlaps with other activities and that’s why Monday was selected. We hope it fits your plans and the agenda and doesn’t overlap with other workshops and tutorials that day.
Event Location: Venetian Room, Fairmont Hotel (1717 N Akard St, Dallas, TX 75201), which is within one mile from the Kay Bailey Hutchison Convention Center.
Additional details will be shared once the agenda is finalized. We hope to see you all in person.
Best Regards, Andrey, Kelsey, Johann and the rest of the DAOS team.
-- Andrey Kudryavtsev, DAOS Product Manager Intel Corp.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
JiangYu
Thanks Lei, we didn't try this, we are considering to update our hardware.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
[DUG'22] Announcement and Agenda
Kudryavtsev, Andrey O <andrey.o.kudryavtsev@...>
Dear DAOS community, Following the email I sent earlier, DAOS team is proud to announce DUG'22 details and the agenda.
Date: November 14th, 9:00am-1:00pm CT Event Location: Venetian Room, Fairmont Hotel (1717 N Akard St, Dallas, TX 75201)
Based on the feedback you provided, we are going to make it hybrid. We will be glad to see many of you in person and welcome others to join remotely who can’t make SC this year. The details for remote connection will be shared later.
Agenda:
* agenda may have some changes later.
Please, also take a moment to stop by other DAOS session during workshop, tutorials and official SC program. We have the large presence this year in many of those, including with our partners.
SC22 Tutorial, Workshop and Program:
· SC'22 Tutorial (Nov 14 at 8:30am CST)
Emerging Storage Interfaces: DAOS and PMDK · SuperCheck-SC'22 (Nov 14 at 8:35am CST)
DAOS: Nextgen Storage Stack for HPC and AI · PDSW (Nov 14 at 3:30pm CST) Performance Comparison of DAOS and Lustre for Object Data Storage Approaches http://www.pdsw.org/index.shtml Nicolau Manubens Gil (ECMWF) Simon Smart (ECMWF) Tiago Quintino (ECMWF) Adrian Jackson (EPCC) · SC'22 BoF (Nov 16 at 5:15pm CST)
DAOS Storage Community BoF · SC'22 BoF (Nov 17 at 12:15pm CST)
The Storage Tower of Babel? ... Not! Actually, maybe?
SC22 Exhibition:
· Intel booth presentations at SC22 Showcase
Panel: Google
Cloud Platform (GCP) and Intel DAOS Further HPC Data Pipeline Optimization (Nov
15 at 3:30pm CST) Dean Hildebrand (Google) Kelsey Prantis (Intel) Tech Talk: Aurora DAOS Storage Innovation at Argonne National Laboratory (Nov 16 at 3:30pm CST) Kevin Harms (ANL) Tech Talk: Cambridge University is Tackling Tomorrow’s Problems Today (Nov 16 at 11:00am CST) Paul Calleja (UoC) · Google booth at SC22 Showcase (all time) DAOS Storage live demo in GCP environment Margaret Lawson (Google) · Croit booth at SC22 Showcase (all time) DAOS live demo running Block and NFS interface with Croit.io Denis Nuja (Croit)
All the best, DAOS team.
-- Andrey Kudryavtsev, DAOS Product Manager Intel Corp.
From: Andrey O Kudryavtsev <andrey.o.kudryavtsev@...>
Greetings DAOS Community!
SC22 is around the corner and it means we have a special event coming again. The Intel DAOS team invites you to join us for the 6th annual DAOS User Group (DUG22). This will be the first in-person user group since the pandemic.
The agenda is not yet finalized and we’re inviting the community members to submit their presentation proposals. Please, send brief submissions to daos-info@daos.groups.io and keep me copied. If you have any feedback to share, what you want to see the most, type of presentations, areas to cover and others to listen, - don’t hesitate to contact me directly. This is the event we make for you!
The event will take place on November 14th from 9am until 1pm. We did our best to avoid overlaps with other activities and that’s why Monday was selected. We hope it fits your plans and the agenda and doesn’t overlap with other workshops and tutorials that day.
Event Location: Venetian Room, Fairmont Hotel (1717 N Akard St, Dallas, TX 75201), which is within one mile from the Kay Bailey Hutchison Convention Center.
Additional details will be shared once the agenda is finalized. We hope to see you all in person.
Best Regards, Andrey, Kelsey, Johann and the rest of the DAOS team.
-- Andrey Kudryavtsev, DAOS Product Manager Intel Corp.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
Huang, Lei
Did you revise spdk_arch in site_scons/components/__init__.py before compiling? Right. Using newer CPU could avoid such problem.
-lei From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of
JiangYu
Thank you lei,
[root@Rocky-1 yum.repos.d]# vim /etc/yum.repos.d/Rocky-PowerTools.repo enabled=1
[root@Rocky-3 ~]# yum install -y python2 gcc gcc-c++ libunwind-devel epel-release
[root@Rocky-1 daos]# yum makecache
[root@Rocky-1 daos]# dnf --enablerepo=powertools install python3-scons
[root@Rocky-1 daos]# pip3 install distro
[root@Rocky-1 daos]# git checkout -b local-v2.2.0 v2.2.0 [root@Rocky-1 daos]# ./utils/scripts/install-el8.sh [root@Rocky-1 daos]# scons-3 --build-deps=yes
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
JiangYu
Thank you lei,
I tried compiling, but the problem still exists, I will try gdb as you said. Maybe if I use the new CPU architecture there won't be this problem. [root@Rocky-1 yum.repos.d]# vim /etc/yum.repos.d/Rocky-PowerTools.repo
enabled=1
[root@Rocky-3 ~]# yum install -y python2 gcc gcc-c++ libunwind-devel epel-release
[root@Rocky-1 daos]# yum makecache
[root@Rocky-1 daos]# dnf --enablerepo=powertools install python3-scons
[root@Rocky-1 daos]# pip3 install distro
[root@Rocky-1 daos]# git checkout -b local-v2.2.0 v2.2.0
[root@Rocky-1 daos]# ./utils/scripts/install-el8.sh
[root@Rocky-1 daos]# scons-3 --build-deps=yes
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
JiangYu
I'm using an RPM built and distributed by the DAOS project team.
So I need to adjust the compiler optimization to compile the daos binary to run it? Can you tell me where I need to modify the compiler optimizations? How do I compile it? Thank you very much! [root@Rocky-1 ~]# rpm -qa | grep daos
daos-client-2.2.0-4.el8.x86_64
daos-2.2.0-4.el8.x86_64
daos-server-2.2.0-4.el8.x86_64
daos-admin-2.2.0-4.el8.x86_64
[root@Rocky-1 ~]# rpm -qa | grep spdk
spdk-tools-22.01.1-2.el8.noarch
spdk-22.01.1-2.el8.x86_64
[root@Rocky-1 ~]# rpm -qa | grep dpdk
dpdk-21.11.1-1.el8.x86_64
[root@Rocky-1 ~]# cat /etc/yum.repos.d/daos-packages.repo
[daos-packages]
name=DAOS v2.2.0 Packages Packages
baseurl=https://packages.daos.io/private/v2.2.0/EL8/packages/x86_64
enabled=1
gpgcheck=1
protect=1
gpgkey="https://packages.daos.io/RPM-GPG-KEY"
[root@Rocky-1 ~]# cat /etc/os-release
NAME="Rocky Linux"
VERSION="8.6 (Green Obsidian)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="8.6"
PLATFORM_ID="platform:el8"
PRETTY_NAME="Rocky Linux 8.6 (Green Obsidian)"
ANSI_COLOR="0;32"
CPE_NAME="cpe:/o:rocky:rocky:8:GA"
HOME_URL="https://rockylinux.org/"
BUG_REPORT_URL="https://bugs.rockylinux.org/"
ROCKY_SUPPORT_PRODUCT="Rocky Linux"
ROCKY_SUPPORT_PRODUCT_VERSION="8"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="8"
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
Murrell, Brian
On Wed, 2022-11-02 at 20:25 -0700, lnsyyj@... wrote:
ERROR: /usr/bin/daos_admin SIGILL: illegal instructionAre you using the RPMs that the DAOS project team builds and distributes or did you build your own from source? If the latter, you might have built with compiler optimizations set to aggressively target the CPU of the build system and then tried to use the binaries produced there on a different system with a lesser-capable CPU. You will have to reduce the optimization level of your build if you wish to make more portable binaries. Cheers, b.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
Huang, Lei
E5-2680 v2 is Ivy Bridge. I guess some packages (maybe spdk) was compiled to run on haswell or newer architecture. You may use gdb to run “daos_admin”. Gdb will stop when cpu runs into an unsupported instruction. With “bt” and “info proc mappings” in gdb, you can find out which module/library contains unsupported instruction. You need to compile your library from source targeting your own CPU and install it.
Or you can compile daos and its dependent libraries from scratch. https://github.com/daos-stack/daos/blob/release/2.2/site_scons/components/__init__.py#L348-L355 You may need to replace this part with spdk_arch = 'nehalem'
Not sure whether there are other places to fix the compiling flags for CPU optimizations.
-lei
From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of
JiangYu
Thanks, the CPU information is as follows, how can I choose the CPU? Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 40 On-line CPU(s) list: 0-39 Thread(s) per core: 2 Core(s) per socket: 10 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel BIOS Vendor ID: Intel CPU family: 6 Model: 62 Model name: Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz BIOS Model name: Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz Stepping: 4 CPU MHz: 3600.000 CPU max MHz: 3600.0000 CPU min MHz: 1200.0000 BogoMIPS: 5599.96 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 256K L3 cache: 25600K NUMA node0 CPU(s): 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38 NUMA node1 CPU(s): 1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31,33,35,37,39 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm cpuid_fault pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear flush_l1d
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: DAOS server start failed(NVMe Scan Failed: privileged binary execution failed)
JiangYu
Thanks, the CPU information is as follows, how can I choose the CPU?
[root@Rocky-1 ~]# lscpu Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 40
On-line CPU(s) list: 0-39
Thread(s) per core: 2
Core(s) per socket: 10
Socket(s): 2
NUMA node(s): 2
Vendor ID: GenuineIntel
BIOS Vendor ID: Intel
CPU family: 6
Model: 62
Model name: Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
BIOS Model name: Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
Stepping: 4
CPU MHz: 3600.000
CPU max MHz: 3600.0000
CPU min MHz: 1200.0000
BogoMIPS: 5599.96
Virtualization: VT-x
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 25600K
NUMA node0 CPU(s): 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38
NUMA node1 CPU(s): 1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31,33,35,37,39
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm cpuid_fault pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear flush_l1d
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|