Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK


Mannthey, Keith
 

I built DAOS a few weeks ago but this week I seem to have challenges.
Centos 7.x (updated a few weeks ago)

I have tried Master branch and remotes/origin/DAOS-4368 following https://daos-stack.github.io/admin/installation/ instructions

#git submodule init
#git submodule update
#scons --config=force --build-deps=yes install

<snip>
gcc -o build/src/utils/daos_hdlr.o -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DDAOS_HAS_VALGRIND -Isrc/include/daos -Isrc/include -Iinstall/include src/utils/daos_hdlr.c gcc -o build/src/client/dfs/duns.os -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DLUSTRE_INCLUDE -fPIC -DDAOS_HAS_VALGRIND -DFUSE_USE_VERSION=32 -Isrc/include/daos -Isrc/include -Iinstall/include src/client/dfs/duns.c
src/client/dfs/duns.c: In function 'duns_resolve_lustre_path':
src/client/dfs/duns.c:202:24: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)
lfm->lfm_type != LU_FOREIGN_TYPE_SYMLINK ||
^
src/client/dfs/duns.c:202:24: note: each undeclared identifier is reported only once for each function it appears in
src/client/dfs/duns.c: In function 'duns_create_lustre_path':
src/client/dfs/duns.c:482:8: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)
LU_FOREIGN_TYPE_SYMLINK, 0xda05, str);
^
scons: *** [build/src/client/dfs/duns.os] Error 1
scons: building terminated because of errors.
-----

Any suggestions?


Thanks,
Keith


Lombardi, Johann
 

Hi Keith,

 

You probably have the lustre headers installed on the node which is causing the DAOS/Lustre integration to be enabled. This integration relies on the foreign layout feature which is only available on the Lustre’s master branch and not in any official Lustre releases yet.

 

It sounds like we need to revisit how to auto-detect & enable the Lustre integration and check for LU_FOREIGN_TYPE_SYMLINK. Bruno, could you please look into that? Is there a way for force-disable the Lustre integration to unblock Keith? Thanks in advance.

 

Cheers,

Johann

 

From: <daos@daos.groups.io> on behalf of "Mannthey, Keith" <keith.mannthey@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 24 March 2020 at 06:15
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

I built DAOS a few weeks ago but this week I seem to have challenges.

Centos 7.x (updated a few weeks ago)

 

I have tried Master branch  and  remotes/origin/DAOS-4368 following https://daos-stack.github.io/admin/installation/ instructions

 

#git submodule init

#git submodule update

#scons --config=force --build-deps=yes install

 

<snip>

gcc -o build/src/utils/daos_hdlr.o -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DDAOS_HAS_VALGRIND -Isrc/include/daos -Isrc/include -Iinstall/include src/utils/daos_hdlr.c gcc -o build/src/client/dfs/duns.os -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DLUSTRE_INCLUDE -fPIC -DDAOS_HAS_VALGRIND -DFUSE_USE_VERSION=32 -Isrc/include/daos -Isrc/include -Iinstall/include src/client/dfs/duns.c

src/client/dfs/duns.c: In function 'duns_resolve_lustre_path':

src/client/dfs/duns.c:202:24: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

       lfm->lfm_type != LU_FOREIGN_TYPE_SYMLINK ||

                        ^

src/client/dfs/duns.c:202:24: note: each undeclared identifier is reported only once for each function it appears in

src/client/dfs/duns.c: In function 'duns_create_lustre_path':

src/client/dfs/duns.c:482:8: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

        LU_FOREIGN_TYPE_SYMLINK, 0xda05, str);

        ^

scons: *** [build/src/client/dfs/duns.os] Error 1

scons: building terminated because of errors.

-----

 

Any suggestions?

 

 

Thanks,

Keith

 

 

 

 

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.


Faccini, Bruno
 

Hello Keith,

It has been quite a long time !

Concerning your problem it definitely looks like a known packaging issue that should be fixed soon but associated patch has still not landed.

Just to do double-check, do you install Lustre from RPMs ? And what is the installed Lustre version ?

If the version is >= '2.12.57' can you give a try to the change in src/client/dfs/SConscript detailed at “https://github.com/daos-stack/daos/pull/1942/files” ?

Anyway, as a quick and dirty fix you can simply remove the piece of python code, the full try/except construct under “If Lustre installed use its headers“ comment, in src/client/dfs/SConscript.

Let me know if this works for you? Sorry about the inconvenience, cheers,

Bruno.

 

From: Johann Lombardi <johann.lombardi@...>
Date: Tuesday 24 March 2020 at 13:15
To: "daos@daos.groups.io" <daos@daos.groups.io>, Bruno Faccini <bruno.faccini@...>
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

Hi Keith,

 

You probably have the lustre headers installed on the node which is causing the DAOS/Lustre integration to be enabled. This integration relies on the foreign layout feature which is only available on the Lustre’s master branch and not in any official Lustre releases yet.

 

It sounds like we need to revisit how to auto-detect & enable the Lustre integration and check for LU_FOREIGN_TYPE_SYMLINK. Bruno, could you please look into that? Is there a way for force-disable the Lustre integration to unblock Keith? Thanks in advance.

 

Cheers,

Johann

 

From: <daos@daos.groups.io> on behalf of "Mannthey, Keith" <keith.mannthey@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 24 March 2020 at 06:15
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

I built DAOS a few weeks ago but this week I seem to have challenges.

Centos 7.x (updated a few weeks ago)

 

I have tried Master branch  and  remotes/origin/DAOS-4368 following https://daos-stack.github.io/admin/installation/ instructions

 

#git submodule init

#git submodule update

#scons --config=force --build-deps=yes install

 

<snip>

gcc -o build/src/utils/daos_hdlr.o -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DDAOS_HAS_VALGRIND -Isrc/include/daos -Isrc/include -Iinstall/include src/utils/daos_hdlr.c gcc -o build/src/client/dfs/duns.os -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DLUSTRE_INCLUDE -fPIC -DDAOS_HAS_VALGRIND -DFUSE_USE_VERSION=32 -Isrc/include/daos -Isrc/include -Iinstall/include src/client/dfs/duns.c

src/client/dfs/duns.c: In function 'duns_resolve_lustre_path':

src/client/dfs/duns.c:202:24: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

       lfm->lfm_type != LU_FOREIGN_TYPE_SYMLINK ||

                        ^

src/client/dfs/duns.c:202:24: note: each undeclared identifier is reported only once for each function it appears in

src/client/dfs/duns.c: In function 'duns_create_lustre_path':

src/client/dfs/duns.c:482:8: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

        LU_FOREIGN_TYPE_SYMLINK, 0xda05, str);

        ^

scons: *** [build/src/client/dfs/duns.os] Error 1

scons: building terminated because of errors.

-----

 

Any suggestions?

 

 

Thanks,

Keith

 

 

 

 

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.


Mannthey, Keith
 

Yea long time no chat it is good to be working with DAOS in the lab.

 

These nodes do have Lustre header packages installed.  I will remove them.

 

Thanks for the help!

 

Keith

 

From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of Faccini, Bruno
Sent: Tuesday, March 24, 2020 6:11 AM
To: daos@daos.groups.io
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

Hello Keith,

It has been quite a long time !

Concerning your problem it definitely looks like a known packaging issue that should be fixed soon but associated patch has still not landed.

Just to do double-check, do you install Lustre from RPMs ? And what is the installed Lustre version ?

If the version is >= '2.12.57' can you give a try to the change in src/client/dfs/SConscript detailed at “https://github.com/daos-stack/daos/pull/1942/files” ?

Anyway, as a quick and dirty fix you can simply remove the piece of python code, the full try/except construct under “If Lustre installed use its headers …“ comment, in src/client/dfs/SConscript.

Let me know if this works for you? Sorry about the inconvenience, cheers,

Bruno.

 

From: Johann Lombardi <johann.lombardi@...>
Date: Tuesday 24 March 2020 at 13:15
To: "daos@daos.groups.io" <daos@daos.groups.io>, Bruno Faccini <bruno.faccini@...>
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

Hi Keith,

 

You probably have the lustre headers installed on the node which is causing the DAOS/Lustre integration to be enabled. This integration relies on the foreign layout feature which is only available on the Lustre’s master branch and not in any official Lustre releases yet.

 

It sounds like we need to revisit how to auto-detect & enable the Lustre integration and check for LU_FOREIGN_TYPE_SYMLINK. Bruno, could you please look into that? Is there a way for force-disable the Lustre integration to unblock Keith? Thanks in advance.

 

Cheers,

Johann

 

From: <daos@daos.groups.io> on behalf of "Mannthey, Keith" <keith.mannthey@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 24 March 2020 at 06:15
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

I built DAOS a few weeks ago but this week I seem to have challenges.

Centos 7.x (updated a few weeks ago)

 

I have tried Master branch  and  remotes/origin/DAOS-4368 following https://daos-stack.github.io/admin/installation/ instructions

 

#git submodule init

#git submodule update

#scons --config=force --build-deps=yes install

 

<snip>

gcc -o build/src/utils/daos_hdlr.o -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DDAOS_HAS_VALGRIND -Isrc/include/daos -Isrc/include -Iinstall/include src/utils/daos_hdlr.c gcc -o build/src/client/dfs/duns.os -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DLUSTRE_INCLUDE -fPIC -DDAOS_HAS_VALGRIND -DFUSE_USE_VERSION=32 -Isrc/include/daos -Isrc/include -Iinstall/include src/client/dfs/duns.c

src/client/dfs/duns.c: In function 'duns_resolve_lustre_path':

src/client/dfs/duns.c:202:24: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

       lfm->lfm_type != LU_FOREIGN_TYPE_SYMLINK ||

                        ^

src/client/dfs/duns.c:202:24: note: each undeclared identifier is reported only once for each function it appears in

src/client/dfs/duns.c: In function 'duns_create_lustre_path':

src/client/dfs/duns.c:482:8: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

        LU_FOREIGN_TYPE_SYMLINK, 0xda05, str);

        ^

scons: *** [build/src/client/dfs/duns.os] Error 1

scons: building terminated because of errors.

-----

 

Any suggestions?

 

 

Thanks,

Keith

 

 

 

 

 

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.


Mannthey, Keith
 

FYI:

 

I got DAOS building again. I didn’t have Lustre-headers installed and in the end I got things working by removing the Lustre  Kmod* packages. This system has/had Lustre 2.13 Ldiskfs  software installed on it.

 

Thanks,

Keith

 

From: Mannthey, Keith
Sent: Tuesday, March 24, 2020 7:44 AM
To: daos@daos.groups.io
Subject: RE: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

Yea long time no chat it is good to be working with DAOS in the lab.

 

These nodes do have Lustre header packages installed.  I will remove them.

 

Thanks for the help!

 

Keith

 

From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of Faccini, Bruno
Sent: Tuesday, March 24, 2020 6:11 AM
To: daos@daos.groups.io
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

Hello Keith,

It has been quite a long time !

Concerning your problem it definitely looks like a known packaging issue that should be fixed soon but associated patch has still not landed.

Just to do double-check, do you install Lustre from RPMs ? And what is the installed Lustre version ?

If the version is >= '2.12.57' can you give a try to the change in src/client/dfs/SConscript detailed at “https://github.com/daos-stack/daos/pull/1942/files” ?

Anyway, as a quick and dirty fix you can simply remove the piece of python code, the full try/except construct under “If Lustre installed use its headers …“ comment, in src/client/dfs/SConscript.

Let me know if this works for you? Sorry about the inconvenience, cheers,

Bruno.

 

From: Johann Lombardi <johann.lombardi@...>
Date: Tuesday 24 March 2020 at 13:15
To: "daos@daos.groups.io" <daos@daos.groups.io>, Bruno Faccini <bruno.faccini@...>
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

Hi Keith,

 

You probably have the lustre headers installed on the node which is causing the DAOS/Lustre integration to be enabled. This integration relies on the foreign layout feature which is only available on the Lustre’s master branch and not in any official Lustre releases yet.

 

It sounds like we need to revisit how to auto-detect & enable the Lustre integration and check for LU_FOREIGN_TYPE_SYMLINK. Bruno, could you please look into that? Is there a way for force-disable the Lustre integration to unblock Keith? Thanks in advance.

 

Cheers,

Johann

 

From: <daos@daos.groups.io> on behalf of "Mannthey, Keith" <keith.mannthey@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 24 March 2020 at 06:15
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

I built DAOS a few weeks ago but this week I seem to have challenges.

Centos 7.x (updated a few weeks ago)

 

I have tried Master branch  and  remotes/origin/DAOS-4368 following https://daos-stack.github.io/admin/installation/ instructions

 

#git submodule init

#git submodule update

#scons --config=force --build-deps=yes install

 

<snip>

gcc -o build/src/utils/daos_hdlr.o -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DDAOS_HAS_VALGRIND -Isrc/include/daos -Isrc/include -Iinstall/include src/utils/daos_hdlr.c gcc -o build/src/client/dfs/duns.os -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DLUSTRE_INCLUDE -fPIC -DDAOS_HAS_VALGRIND -DFUSE_USE_VERSION=32 -Isrc/include/daos -Isrc/include -Iinstall/include src/client/dfs/duns.c

src/client/dfs/duns.c: In function 'duns_resolve_lustre_path':

src/client/dfs/duns.c:202:24: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

       lfm->lfm_type != LU_FOREIGN_TYPE_SYMLINK ||

                        ^

src/client/dfs/duns.c:202:24: note: each undeclared identifier is reported only once for each function it appears in

src/client/dfs/duns.c: In function 'duns_create_lustre_path':

src/client/dfs/duns.c:482:8: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

        LU_FOREIGN_TYPE_SYMLINK, 0xda05, str);

        ^

scons: *** [build/src/client/dfs/duns.os] Error 1

scons: building terminated because of errors.

-----

 

Any suggestions?

 

 

Thanks,

Keith

 

 

 

 

 

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.


Faccini, Bruno
 

Thx for your feedback Keith!

But definitely patch at https://github.com/daos-stack/daos/pull/1942/files” should fix this issue and we expect to land it soon now.

Cheers,

Bruno.

 

From: <daos@daos.groups.io> on behalf of "Mannthey, Keith" <keith.mannthey@...>
Reply to: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 24 March 2020 at 17:39
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

FYI:

 

I got DAOS building again. I didn’t have Lustre-headers installed and in the end I got things working by removing the Lustre  Kmod* packages. This system has/had Lustre 2.13 Ldiskfs  software installed on it.

 

Thanks,

Keith

 

From: Mannthey, Keith
Sent: Tuesday, March 24, 2020 7:44 AM
To: daos@daos.groups.io
Subject: RE: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

Yea long time no chat it is good to be working with DAOS in the lab.

 

These nodes do have Lustre header packages installed.  I will remove them.

 

Thanks for the help!

 

Keith

 

From: daos@daos.groups.io <daos@daos.groups.io> On Behalf Of Faccini, Bruno
Sent: Tuesday, March 24, 2020 6:11 AM
To: daos@daos.groups.io
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

Hello Keith,

It has been quite a long time !

Concerning your problem it definitely looks like a known packaging issue that should be fixed soon but associated patch has still not landed.

Just to do double-check, do you install Lustre from RPMs ? And what is the installed Lustre version ?

If the version is >= '2.12.57' can you give a try to the change in src/client/dfs/SConscript detailed at “https://github.com/daos-stack/daos/pull/1942/files” ?

Anyway, as a quick and dirty fix you can simply remove the piece of python code, the full try/except construct under “If Lustre installed use its headers …“ comment, in src/client/dfs/SConscript.

Let me know if this works for you? Sorry about the inconvenience, cheers,

Bruno.

 

From: Johann Lombardi <johann.lombardi@...>
Date: Tuesday 24 March 2020 at 13:15
To: "daos@daos.groups.io" <daos@daos.groups.io>, Bruno Faccini <bruno.faccini@...>
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

Hi Keith,

 

You probably have the lustre headers installed on the node which is causing the DAOS/Lustre integration to be enabled. This integration relies on the foreign layout feature which is only available on the Lustre’s master branch and not in any official Lustre releases yet.

 

It sounds like we need to revisit how to auto-detect & enable the Lustre integration and check for LU_FOREIGN_TYPE_SYMLINK. Bruno, could you please look into that? Is there a way for force-disable the Lustre integration to unblock Keith? Thanks in advance.

 

Cheers,

Johann

 

From: <daos@daos.groups.io> on behalf of "Mannthey, Keith" <keith.mannthey@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 24 March 2020 at 06:15
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

 

I built DAOS a few weeks ago but this week I seem to have challenges.

Centos 7.x (updated a few weeks ago)

 

I have tried Master branch  and  remotes/origin/DAOS-4368 following https://daos-stack.github.io/admin/installation/ instructions

 

#git submodule init

#git submodule update

#scons --config=force --build-deps=yes install

 

<snip>

gcc -o build/src/utils/daos_hdlr.o -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DDAOS_HAS_VALGRIND -Isrc/include/daos -Isrc/include -Iinstall/include src/utils/daos_hdlr.c gcc -o build/src/client/dfs/duns.os -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DLUSTRE_INCLUDE -fPIC -DDAOS_HAS_VALGRIND -DFUSE_USE_VERSION=32 -Isrc/include/daos -Isrc/include -Iinstall/include src/client/dfs/duns.c

src/client/dfs/duns.c: In function 'duns_resolve_lustre_path':

src/client/dfs/duns.c:202:24: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

       lfm->lfm_type != LU_FOREIGN_TYPE_SYMLINK ||

                        ^

src/client/dfs/duns.c:202:24: note: each undeclared identifier is reported only once for each function it appears in

src/client/dfs/duns.c: In function 'duns_create_lustre_path':

src/client/dfs/duns.c:482:8: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

        LU_FOREIGN_TYPE_SYMLINK, 0xda05, str);

        ^

scons: *** [build/src/client/dfs/duns.os] Error 1

scons: building terminated because of errors.

-----

 

Any suggestions?

 

 

Thanks,

Keith

 

 

 

 

 

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.