Error when installing MET-12.0.0-beta6 when compiling NetCDF-C

[jinfanti]

Hello!
I am installing an updated version of MET (MET-12.0.0-beta6) on one of our CPC systems, and have run into an error at the step where NetCDF-C compiles. This looks like the error noted in this discussion: #2010, but I have tried a number of the solutions in that discussion and the error persists. The error from the configure.log file is

configure: error: curl required for remote access. Install curl or build with --disable-dap.
And from the output in my terminal:

Compiling NetCDF-C at Wed Nov  6 21:26:17 UTC 2024
cd /cpc/met/MET11/MET-12.0.0-beta6/external_libs/netcdf/netcdf-c-4.7.4
./configure --prefix=/cpc/met/MET11/MET-12.0.0-beta6/external_libs CFLAGS=-fPIC CXXFLAGS=-fPIC LDFLAGS=-L/cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib CPPFLAGS=-I/cpc/met/MET11/MET-12.0.0-beta6/external_libs/include > configure.log 2>&1
configure returned with non-zero (1) status

My attempts at solving included (1) pointing to our internal install of curl by setting CURL_LIB_DIR and CURL_INC_DIR in install_met_env_cpc_clean.txt (see below), and modifying the corresponding line in the compile shell script. (2) Installing curl under external_libs and compiling (using the standard compile script with no modifications), (3) pointing to this new install of curl by setting CURL_LIB_DIR and CURL_INC_DIR and modifying the corresponding line in the compile shell script.

I attached a number of files, including my install script, an example of the compile script with the CURL_LIB_DIR and CULR_INC_DIR included, and the configure.log and config.log files found in the netcdf-c-4.7.4 directory. I would appreciate any help!!! Thank you!! Please let me know if I can provide any additional information. I have a number of other compile/install scripts I tried as well.

config.log
configure.log
install_met_env_cpc_clean.txt
compile_MET_all.new.curltest2.sh.txt

[jprestop]

Hi @jinfanti. Thanks for this information and for sending the files.

Can you please send the directory listing output of the following directories? (e.g. ls /cpc/prod/cpcfcst/software/miniconda-rh7/lib)

export CURL_LIB_DIR=/cpc/prod/cpcfcst/software/miniconda-rh7/lib
export CURL_INC_DIR=/cpc/prod/cpcfcst/software/miniconda-rh7/include

Also, I noticed you had previously set the following and then commented it out. Did you install curl in those locations also? If so, please send the directory listing output of those directories as well?

#export CURL_LIB_DIR=/cpc/met/MET11/MET-12.0.0-beta6/external_libs
#export CURL_INC_DIR=/cpc/met/MET11/MET-12.0.0-beta6/external_libs/include

Thanks!

[jinfanti]

Hi Julie! Thanks for the response.

1. Output from directories (I am just including output for curl since the directory listing is very long, but let me know if you want more information.

ls /cpc/prod/cpcfcst/software/miniconda-rh7/lib/*curl*
/cpc/prod/cpcfcst/software/miniconda-rh7/lib/libcurl.a   /cpc/prod/cpcfcst/software/miniconda-rh7/lib/libcurl.so.4
/cpc/prod/cpcfcst/software/miniconda-rh7/lib/libcurl.so  /cpc/prod/cpcfcst/software/miniconda-rh7/lib/libcurl.so.4.6.0

ls /cpc/prod/cpcfcst/software/miniconda-rh7/include/*curl*
curl.h  curlver.h  easy.h  mprintf.h  multi.h  stdcheaders.h  system.h  typecheck-gcc.h  urlapi.h

2. Yes I did install and test curl in that directory. I tested the compile with that install in a few ways, just a plain compile without explicitly pointing to the directories, and with explicit pointing. I have it commented out since I was trying to get it to point to our typical install instead of the one I did. Here is the output from these dirs. I may need to set these to /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/ and second one to /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include? But I'm also possibly not understanding.

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs
bin  bufrlib  curl  g2clib  gsl  hdf5  include  jasper  lib  libpng  man  netcdf  share  zlib

And just in the curl dir:

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0
acinclude.m4  buildconf.bat  CMakeLists.txt  config.log     configure     curl-config     docs        lib            libtool    MacOSX-Framework  Makefile.in  packages  README         src          winbuild
aclocal.m4    CHANGES        compile         config.status  configure.ac  curl-config.in  include     libcurl.pc     ltmain.sh  Makefile          maketgz      plan9     RELEASE-NOTES  test-driver
buildconf     CMake          config.guess    config.sub     COPYING       depcomp         install-sh  libcurl.pc.in  m4         Makefile.am       missing      projects  scripts        tests

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/include/
drstemplates.h   H5Apublic.h   H5Epublic.h   H5FDlog.h     H5FDros3.h      H5Gpublic.h   H5MMpublic.h  H5Ppublic.h   H5TBpublic.h              H5VLpassthru.h  libpng16        zlib.h
grib2.h          H5Cpublic.h   H5ESpublic.h  H5FDmirror.h  H5FDsec2.h      H5IMpublic.h  H5Mpublic.h   H5PTpublic.h  H5Tpublic.h               H5VLpublic.h    pdstemplates.h
gridtemplates.h  H5DOpublic.h  H5FDcore.h    H5FDmpi.h     H5FDsplitter.h  H5Ipublic.h   H5Opublic.h   H5pubconf.h   H5version.h               H5Zpublic.h     pngconf.h
gsl              H5Dpublic.h   H5FDdirect.h  H5FDmpio.h    H5FDstdio.h     H5LDpublic.h  H5overflow.h  H5public.h    H5VLconnector.h           hdf5.h          png.h
H5ACpublic.h     H5DSpublic.h  H5FDfamily.h  H5FDmulti.h   H5FDwindows.h   H5Lpublic.h   H5PLextern.h  H5Rpublic.h   H5VLconnector_passthru.h  hdf5_hl.h       pnglibconf.h
H5api_adpt.h     H5Epubgen.h   H5FDhdfs.h    H5FDpublic.h  H5Fpublic.h     H5LTpublic.h  H5PLpublic.h  H5Spublic.h   H5VLnative.h              jasper          zconf.h

[jprestop]

Thank you for this information.

Could you also please send the output of the directory listing for the following?

• /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib
• /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/
• /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include

Thank you! I will be out of the office tomorrow, just FYI.

[jinfanti]

Sure!! See below and have a great day off and weekend :)

/cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib

 ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib
libbufr.a       libgslcblas.so        libgsl.so.19      libhdf5_hl.so          libhdf5.so          libpng16.a           libpng.a   libz.so.1.2.11
libgrib2c.a     libgslcblas.so.0      libgsl.so.19.0.0  libhdf5_hl.so.200      libhdf5.so.200      libpng16.la          libpng.la  pkgconfig
libgsl.a        libgslcblas.so.0.0.0  libhdf5.a         libhdf5_hl.so.200.1.0  libhdf5.so.200.2.0  libpng16.so          libpng.so
libgslcblas.a   libgsl.la             libhdf5_hl.a      libhdf5.la             libjasper.a         libpng16.so.16       libz.so
libgslcblas.la  libgsl.so             libhdf5_hl.la     libhdf5.settings       libjasper.la        libpng16.so.16.37.0  libz.so.1

/cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/
acinclude.m4   CMake           config.status  curl-config     install-sh     ltmain.sh         Makefile.in  projects       test-driver
aclocal.m4     CMakeLists.txt  config.sub     curl-config.in  lib            m4                maketgz      README         tests
buildconf      compile         configure      depcomp         libcurl.pc     MacOSX-Framework  missing      RELEASE-NOTES  winbuild
buildconf.bat  config.guess    configure.ac   docs            libcurl.pc.in  Makefile          packages     scripts
CHANGES        config.log      COPYING        include         libtool        Makefile.am       plan9        src

/cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include
curl  Makefile  Makefile.am  Makefile.in  README.md

And just in case ....
/cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include/curl/

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include/curl/
curl.h     easy.h    Makefile     Makefile.in  multi.h    stdcheaders.h  typecheck-gcc.h  websockets.h
curlver.h  header.h  Makefile.am  mprintf.h    options.h  system.h       urlapi.h