From: <daos@daos.groups.io> on behalf of "Mannthey, Keith" <keith.mannthey@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 24 March 2020 at 06:15
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

I built DAOS a few weeks ago but this week I seem to have challenges.

Centos 7.x (updated a few weeks ago)

I have tried Master branch  and  remotes/origin/DAOS-4368 following https://daos-stack.github.io/admin/installation/ instructions

#git submodule init

#git submodule update

#scons --config=force --build-deps=yes install

<snip>

gcc -o build/src/utils/daos_hdlr.o -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DDAOS_HAS_VALGRIND -Isrc/include/daos -Isrc/include -Iinstall/include src/utils/daos_hdlr.c gcc -o build/src/client/dfs/duns.os -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DLUSTRE_INCLUDE -fPIC -DDAOS_HAS_VALGRIND -DFUSE_USE_VERSION=32 -Isrc/include/daos -Isrc/include -Iinstall/include src/client/dfs/duns.c

src/client/dfs/duns.c: In function 'duns_resolve_lustre_path':

src/client/dfs/duns.c:202:24: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

       lfm->lfm_type != LU_FOREIGN_TYPE_SYMLINK ||

                        ^

src/client/dfs/duns.c:202:24: note: each undeclared identifier is reported only once for each function it appears in

src/client/dfs/duns.c: In function 'duns_create_lustre_path':

src/client/dfs/duns.c:482:8: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

        LU_FOREIGN_TYPE_SYMLINK, 0xda05, str);

        ^

scons: *** [build/src/client/dfs/duns.os] Error 1

scons: building terminated because of errors.

-----

Any suggestions?

Thanks,

Keith

From: Johann Lombardi <johann.lombardi@...>
Date: Tuesday 24 March 2020 at 13:15
To: "daos@daos.groups.io" <daos@daos.groups.io>, Bruno Faccini <bruno.faccini@...>
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

From: <daos@daos.groups.io> on behalf of "Mannthey, Keith" <keith.mannthey@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 24 March 2020 at 06:15
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

I built DAOS a few weeks ago but this week I seem to have challenges.

Centos 7.x (updated a few weeks ago)

I have tried Master branch  and  remotes/origin/DAOS-4368 following https://daos-stack.github.io/admin/installation/ instructions

#git submodule init

#git submodule update

#scons --config=force --build-deps=yes install

<snip>

gcc -o build/src/utils/daos_hdlr.o -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DDAOS_HAS_VALGRIND -Isrc/include/daos -Isrc/include -Iinstall/include src/utils/daos_hdlr.c gcc -o build/src/client/dfs/duns.os -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DLUSTRE_INCLUDE -fPIC -DDAOS_HAS_VALGRIND -DFUSE_USE_VERSION=32 -Isrc/include/daos -Isrc/include -Iinstall/include src/client/dfs/duns.c

src/client/dfs/duns.c: In function 'duns_resolve_lustre_path':

src/client/dfs/duns.c:202:24: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

       lfm->lfm_type != LU_FOREIGN_TYPE_SYMLINK ||

                        ^

src/client/dfs/duns.c:202:24: note: each undeclared identifier is reported only once for each function it appears in

src/client/dfs/duns.c: In function 'duns_create_lustre_path':

src/client/dfs/duns.c:482:8: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

        LU_FOREIGN_TYPE_SYMLINK, 0xda05, str);

        ^

scons: *** [build/src/client/dfs/duns.os] Error 1

scons: building terminated because of errors.

-----

Any suggestions?

Thanks,

Keith

From: Johann Lombardi <johann.lombardi@...>
Date: Tuesday 24 March 2020 at 13:15
To: "daos@daos.groups.io" <daos@daos.groups.io>, Bruno Faccini <bruno.faccini@...>
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

From: <daos@daos.groups.io> on behalf of "Mannthey, Keith" <keith.mannthey@...>
Reply-To: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 24 March 2020 at 06:15
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

I built DAOS a few weeks ago but this week I seem to have challenges.

Centos 7.x (updated a few weeks ago)

I have tried Master branch  and  remotes/origin/DAOS-4368 following https://daos-stack.github.io/admin/installation/ instructions

#git submodule init

#git submodule update

#scons --config=force --build-deps=yes install

<snip>

gcc -o build/src/utils/daos_hdlr.o -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DDAOS_HAS_VALGRIND -Isrc/include/daos -Isrc/include -Iinstall/include src/utils/daos_hdlr.c gcc -o build/src/client/dfs/duns.os -c -Werror -g -Wshadow -Wall -Wno-missing-braces -fpic -D_GNU_SOURCE -DD_LOG_V2 -O2 -DDAOS_VERSION=\"1.1.0\" -DAPI_VERSION=\"0.9.0\" -DCMOCKA_FILTER_SUPPORTED=0 -D_FORTIFY_SOURCE=2 -Wframe-larger-than=4096 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -fstack-clash-protection -DLUSTRE_INCLUDE -fPIC -DDAOS_HAS_VALGRIND -DFUSE_USE_VERSION=32 -Isrc/include/daos -Isrc/include -Iinstall/include src/client/dfs/duns.c

src/client/dfs/duns.c: In function 'duns_resolve_lustre_path':

src/client/dfs/duns.c:202:24: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

       lfm->lfm_type != LU_FOREIGN_TYPE_SYMLINK ||

                        ^

src/client/dfs/duns.c:202:24: note: each undeclared identifier is reported only once for each function it appears in

src/client/dfs/duns.c: In function 'duns_create_lustre_path':

src/client/dfs/duns.c:482:8: error: 'LU_FOREIGN_TYPE_SYMLINK' undeclared (first use in this function)

        LU_FOREIGN_TYPE_SYMLINK, 0xda05, str);

        ^

scons: *** [build/src/client/dfs/duns.os] Error 1

scons: building terminated because of errors.

-----

Any suggestions?

Thanks,

Keith

Yea long time no chat it is good to be working with DAOS in the lab.

These nodes do have Lustre header packages installed.  I will remove them.

Thanks for the help!

Keith

Hello Keith,

It has been quite a long time !

Concerning your problem it definitely looks like a known packaging issue that should be fixed soon but associated patch has still not landed.

Just to do double-check, do you install Lustre from RPMs ? And what is the installed Lustre version ?

If the version is >= '2.12.57' can you give a try to the change in src/client/dfs/SConscript detailed at “https://github.com/daos-stack/daos/pull/1942/files” ?

Anyway, as a quick and dirty fix you can simply remove the piece of python code, the full try/except construct under “If Lustre installed use its headers …“ comment, in src/client/dfs/SConscript.

Let me know if this works for you? Sorry about the inconvenience, cheers,

Bruno.

Hi Keith,

You probably have the lustre headers installed on the node which is causing the DAOS/Lustre integration to be enabled. This integration relies on the foreign layout feature which is only available on the Lustre’s master branch and not in any official Lustre releases yet.

It sounds like we need to revisit how to auto-detect & enable the Lustre integration and check for LU_FOREIGN_TYPE_SYMLINK. Bruno, could you please look into that? Is there a way for force-disable the Lustre integration to unblock Keith? Thanks in advance.

Cheers,

Johann

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.

From: <daos@daos.groups.io> on behalf of "Mannthey, Keith" <keith.mannthey@...>
Reply to: "daos@daos.groups.io" <daos@daos.groups.io>
Date: Tuesday 24 March 2020 at 17:39
To: "daos@daos.groups.io" <daos@daos.groups.io>
Subject: Re: [daos] Centos 7.x DAOS build issue: LU_FOREIGN_TYPE_SYMLINK

Yea long time no chat it is good to be working with DAOS in the lab.

These nodes do have Lustre header packages installed.  I will remove them.

Thanks for the help!

Keith

Hello Keith,

It has been quite a long time !

Concerning your problem it definitely looks like a known packaging issue that should be fixed soon but associated patch has still not landed.

Just to do double-check, do you install Lustre from RPMs ? And what is the installed Lustre version ?

If the version is >= '2.12.57' can you give a try to the change in src/client/dfs/SConscript detailed at “https://github.com/daos-stack/daos/pull/1942/files” ?

Anyway, as a quick and dirty fix you can simply remove the piece of python code, the full try/except construct under “If Lustre installed use its headers …“ comment, in src/client/dfs/SConscript.

Let me know if this works for you? Sorry about the inconvenience, cheers,

Bruno.

Hi Keith,

You probably have the lustre headers installed on the node which is causing the DAOS/Lustre integration to be enabled. This integration relies on the foreign layout feature which is only available on the Lustre’s master branch and not in any official Lustre releases yet.

It sounds like we need to revisit how to auto-detect & enable the Lustre integration and check for LU_FOREIGN_TYPE_SYMLINK. Bruno, could you please look into that? Is there a way for force-disable the Lustre integration to unblock Keith? Thanks in advance.

Cheers,

Johann

---------------------------------------------------------------------
Intel Corporation SAS (French simplified joint stock company)
Registered headquarters: "Les Montalets"- 2, rue de Paris,
92196 Meudon Cedex, France
Registration Number:  302 456 199 R.C.S. NANTERRE
Capital: 4,572,000 Euros

This e-mail and any attachments may contain confidential material for
the sole use of the intended recipient(s). Any review or distribution
by others is strictly prohibited. If you are not the intended
recipient, please contact the sender and delete all copies.