Skip to content
This repository was archived by the owner on Apr 6, 2026. It is now read-only.

Fixes to scopflow to run larger number of contigencies#206

Closed
nkoukpaizan wants to merge 9 commits into
developfrom
nicholson/testing-cmake-scopflow-fix
Closed

Fixes to scopflow to run larger number of contigencies#206
nkoukpaizan wants to merge 9 commits into
developfrom
nicholson/testing-cmake-scopflow-fix

Conversation

@nkoukpaizan

@nkoukpaizan nkoukpaizan commented Mar 4, 2026

Copy link
Copy Markdown
Collaborator

Merge request type

  • New feature
  • Resolves bug
  • Documentation
  • Other

Relates to

  • OPFLOW
  • SOPFLOW
  • SCOPFLOW
  • TCOPFLOW
  • CMake build system
  • Spack configuration
  • Manual
  • Web docs
  • Other

This MR updates

  • Header files
  • Source code
  • CMake build system
  • Spack configuration
  • Web docs
  • Manual
  • Other

Summary

  • Similar to Do not create SOPFLOW vectors and matrices when solver is HIOP. #204, only create global solution vectors when using IPOPT as scopflow_solver. Without this, the code crashes past a certain number of subproblems with EMPAR.
  • Attempts to enable running with DCOPF as the scopflow_subproblem_solver -- Needs review
  • Minor fixes in CMake for test dependencies

Linked Issue(s)

@nkoukpaizan nkoukpaizan requested a review from pelesh March 4, 2026 16:39
@nkoukpaizan nkoukpaizan self-assigned this Mar 4, 2026
@nkoukpaizan nkoukpaizan added bug Something isn't working scopflow labels Mar 4, 2026
@nkoukpaizan nkoukpaizan force-pushed the nicholson/testing-cmake-scopflow-fix branch from 5e3632a to 3db2e2b Compare March 4, 2026 16:41
@nkoukpaizan nkoukpaizan changed the title Nicholson/testing cmake scopflow fix Fixes to scopflow to run larger number of contigencies Mar 4, 2026

@pelesh pelesh left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On Mac platform with GCC 13.4 from MacPorts test 12 fails:

test 12
    Start 12: OPFLOW_LINEFLOW_PENALTY

12: Test command: /opt/local/bin/mpiexec "-n" "1" "/Users/55y/src/tmp/build/applications/opflow" "-netfile" "/Users/55y/src/tmp/ExaGO/datafiles/case_ACTIVSg200.m" "-opflow_solver" "IPOPT" "-opflow_model" "POWER_BALANCE_POLAR" "-opflow_initialization" "ACPF" "-opflow_allow_lineflow_violation" "-opflow_lineflowviolation_penalty" "100"
12: Working Directory: /Users/55y/src/tmp/ExaGO
12: Test timeout computed to be: 10000000
12: [0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
12: [0]PETSC ERROR: Argument out of range
12: [0]PETSC ERROR: Column too large: col 966 max 965
12: [0]PETSC ERROR: See https://petsc.org/release/faq/ for trouble shooting.
12: [0]PETSC ERROR: PETSc Development Git Revision: v3.24.0-47-g0e30de3c618 Git Date: 2025-10-08 01:09:10 -0500
12: [0]PETSC ERROR: /Users/55y/src/tmp/build/applications/opflow with 1 MPI process(es) and PETSC_ARCH arch-darwin-c-opt on mac150403 by 55y Sun Mar  8 21:55:33 2026
12: [0]PETSC ERROR: Configure options: --with-debugging=0 COPTFLAGS="-g -O2" CXXOPTFLAGS="-g -O2" FOPTFLAGS="-g -O2" --with-mpi-dir=/opt/local --with-blaslapack-lib=/opt/local/lib/libopenblas.dylib
12: [0]PETSC ERROR: #1 MatSetValues_SeqAIJ() at /Users/55y/src/petsc/petsc/src/mat/impls/aij/seq/aij.c:426
12: [0]PETSC ERROR: #2 MatSetValues() at /Users/55y/src/petsc/petsc/src/mat/interface/matrix.c:1601
12: [0]PETSC ERROR: #3 OPFLOWComputeInequalityConstraintJacobian_PBPOL() at /Users/55y/src/tmp/ExaGO/src/opflow/model/power_bal_polar/pbpol.cpp:1390
12: [0]PETSC ERROR: #4 OPFLOWSolverSetUp_IPOPT() at /Users/55y/src/tmp/ExaGO/src/opflow/solver/ipopt/opflow_ipopt.cpp:489
12: [0]PETSC ERROR: #5 OPFLOWSetUp() at /Users/55y/src/tmp/ExaGO/src/opflow/interface/opflow.cpp:1957
12: terminate called after throwing an instance of 'ExaGOError'
12:   what():  Argument out of rangeColumn too large: col 966 max 965
12: 
12: ===================================================================================
12: =   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
12: =   PID 34866 RUNNING AT mac150403
12: =   EXIT CODE: 6
12: =   CLEANING UP REMAINING PROCESSES
12: =   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
12: ===================================================================================
12: YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Abort trap: 6 (signal 6)
12: This typically refers to a problem with your application.
12: Please see the FAQ page for debugging suggestions
1/1 Test #12: OPFLOW_LINEFLOW_PENALTY ..........***Failed    0.19 sec

0% tests passed, 1 tests failed out of 1

Total Test time (real) =   0.20 sec

The following tests FAILED:
         12 - OPFLOW_LINEFLOW_PENALTY (Failed)
Run command: perl /Users/55y/src/tmp/ExaGO/tests/functionality/scripts/post_test.pl /Users/55y/src/tmp/build/tests/functionality
Errors while running CTest

The same test passes on develop branch with the same setting. It would be good to find out what change in the PR has caused this test to fail.

@pelesh

pelesh commented Mar 9, 2026

Copy link
Copy Markdown
Collaborator

On Frontier tests 36 and 37, which are passing on develop branch are now failing:

The following tests FAILED:
         ...
         36 - FUNCTIONALITY_TEST_SCOPFLOW_HIOP_PBHIOP_TESTSUITE (Failed)
         37 - FUNCTIONALITY_TEST_SCOPFLOW_HIOP_PBHIOP_MPI_TESTSUITE (Failed)
         ...

Error log of FUNCTIONALITY_TEST_SCOPFLOW_HIOP_PBHIOP_TESTSUITE:

Details
test 36
    Start 36: FUNCTIONALITY_TEST_SCOPFLOW_HIOP_PBHIOP_TESTSUITE

36: Test command: /usr/bin/srun "-n" "1" "/ccs/home/peles/src/exago/build/tests/functionality/scopflow/test_scopflow_functionality" "/ccs/home/peles/src/exago/ExaGO/tests/functionality/scopflow/hiop_cont_pbhiop.toml"
36: Working Directory: /ccs/home/peles/src/exago/build/tests/functionality/scopflow
36: Test timeout computed to be: 10000000
36: Test Description: case9mod.m with HIOP solver/HIOP subproblem solver/9 contingencies
36: [0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
36: [0]PETSC ERROR: No support for this operation for this object type
36: [0]PETSC ERROR: OPFLOW solver IPOPT incompatible with model POWER_BALANCE_HIOP
36: [0]PETSC ERROR: See https://petsc.org/release/faq/ for trouble shooting.
36: [0]PETSC ERROR: Petsc Release Version 3.22.1, Oct 28, 2024 
36: [0]PETSC ERROR: /ccs/home/peles/src/exago/build/tests/functionality/scopflow/test_scopflow_functionality with 1 MPI process(es) and PETSC_ARCH  on frontier09114 by peles Sun Mar  8 22:51:59 2026
36: [0]PETSC ERROR: Configure options: --prefix=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/petsc-3.22.1-krpsfilhn6vzspkcy2fr55jsjok5co3z --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 --with-make-exec=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/gmake-4.4.1-jqumzocgd77u52c2j4q5jydy5fudpevo/bin/make --with-cc=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpicc --with-cxx=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpicxx --with-fc=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpif90 --with-precision=double --with-scalar-type=real --with-shared-libraries=1 --with-debugging=0 --with-openmp=0 --with-64-bit-indices=0 --with-blaslapack-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/gcc-14.2/openblas-0.3.20-dqkevi2sbdkwcbowvnedcnqgmb5ek3fz/lib/libopenblas.so --with-x=0 --with-sycl=0 --with-clanguage=C --with-cuda=0 --with-hip=0 --with-metis=1 --with-metis-include=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/metis-5.1.0-xxxrqjarlepqlm7imt7euzks5mxeuieh/include --with-metis-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/metis-5.1.0-xxxrqjarlepqlm7imt7euzks5mxeuieh/lib/libmetis.so --with-hypre=0 --with-parmetis=1 --with-parmetis-include=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/parmetis-4.0.3-amlsqtxr6fucwh6kgc7buw64ertnficn/include --with-parmetis-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/parmetis-4.0.3-amlsqtxr6fucwh6kgc7buw64ertnficn/lib/libparmetis.so --with-kokkos=0 --with-kokkos-kernels=0 --with-superlu_dist=0 --with-ptscotch=0 --with-suitesparse=0 --with-hdf5=0 --with-zlib=0 --with-mumps=0 --with-trilinos=0 --with-fftw=0 --with-valgrind=0 --with-gmp=0 --with-libpng=0 --with-giflib=0 --with-mpfr=0 --with-netcdf=0 --with-pnetcdf=0 --with-moab=0 --with-random123=0 --with-exodusii=0 --with-cgns=0 --with-memkind=0 --with-p4est=0 --with-saws=0 --with-yaml=0 --with-hwloc=0 --with-libjpeg=0 --with-scalapack=0 --with-strumpack=0 --with-mmg=0 --with-parmmg=0 --with-tetgen=0 --with-zoltan=0
36: [0]PETSC ERROR: #1 OPFLOWCheckModelSolverCompatibility() at /ccs/home/peles/src/exago/ExaGO/src/opflow/interface/opflow.cpp:3226
36: [0]PETSC ERROR: #2 OPFLOWSetUp() at /ccs/home/peles/src/exago/ExaGO/src/opflow/interface/opflow.cpp:1718
36: [0]PETSC ERROR: #3 SCOPFLOWSetUp() at /ccs/home/peles/src/exago/ExaGO/src/scopflow/interface/scopflow.cpp:727
36: terminate called after throwing an instance of 'ExaGOError'
36:   what():  No support for this operation for this object typeOPFLOW solver IPOPT incompatible with model POWER_BALANCE_HIOP
36: srun: error: frontier09114: task 0: Aborted (core dumped)
36: srun: Terminating StepId=4187125.177
1/1 Test #36: FUNCTIONALITY_TEST_SCOPFLOW_HIOP_PBHIOP_TESTSUITE ...***Failed    5.94 sec

0% tests passed, 1 tests failed out of 1

Total Test time (real) =   5.99 sec

The following tests FAILED:
         36 - FUNCTIONALITY_TEST_SCOPFLOW_HIOP_PBHIOP_TESTSUITE (Failed)

Error log of FUNCTIONALITY_TEST_SCOPFLOW_HIOP_PBHIOP_MPI_TESTSUITE:

Details
test 37
    Start 37: FUNCTIONALITY_TEST_SCOPFLOW_HIOP_PBHIOP_MPI_TESTSUITE

37: Test command: /usr/bin/srun "-n" "3" "/ccs/home/peles/src/exago/build/tests/functionality/scopflow/test_scopflow_functionality" "/ccs/home/peles/src/exago/ExaGO/tests/functionality/scopflow/hiop_cont_mpi_pbhiop.toml"
37: Working Directory: /ccs/home/peles/src/exago/build/tests/functionality/scopflow
37: Test timeout computed to be: 10000000
37: Test Description: case_ACTIVSg200.m with HIOP solver/4 contingencies/run with MPI
37: [0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
37: [0]PETSC ERROR: No support for this operation for this object type
37: [0]PETSC ERROR: OPFLOW solver IPOPT incompatible with model POWER_BALANCE_HIOP
37: [0]PETSC ERROR: See https://petsc.org/release/faq/ for trouble shooting.
37: [0]PETSC ERROR: Petsc Release Version 3.22.1, Oct 28, 2024 
37: [0]PETSC ERROR: /ccs/home/peles/src/exago/build/tests/functionality/scopflow/test_scopflow_functionality with 3 MPI process(es) and PETSC_ARCH  on frontier09114 by peles Sun Mar  8 22:59:43 2026
37: [0]PETSC ERROR: Configure options: --prefix=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/petsc-3.22.1-krpsfilhn6vzspkcy2fr55jsjok5co3z --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 --with-make-exec=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/gmake-4.4.1-jqumzocgd77u52c2j4q5jydy5fudpevo/bin/make --with-cc=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpicc --with-cxx=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpicxx --with-fc=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpif90 --with-precision=double --with-scalar-type=real --with-shared-libraries=1 --with-debugging=0 --with-openmp=0 --with-64-bit-indices=0 --with-blaslapack-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/gcc-14.2/openblas-0.3.20-dqkevi2sbdkwcbowvnedcnqgmb5ek3fz/lib/libopenblas.so --with-x=0 --with-sycl=0 --with-clanguage=C --with-cuda=0 --with-hip=0 --with-metis=1 --with-metis-include=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/metis-5.1.0-xxxrqjarlepqlm7imt7euzks5mxeuieh/include --with-metis-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/metis-5.1.0-xxxrqjarlepqlm7imt7euzks5mxeuieh/lib/libmetis.so --with-hypre=0 --with-parmetis=1 --with-parmetis-include=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/parmetis-4.0.3-amlsqtxr6fucwh6kgc7buw64ertnficn/include --with-parmetis-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/parmetis-4.0.3-amlsqtxr6fucwh6kgc7buw64ertnficn/lib/libparmetis.so --with-kokkos=0 --with-kokkos-kernels=0 --with-superlu_dist=0 --with-ptscotch=0 --with-suitesparse=0 --with-hdf5=0 --with-zlib=0 --with-mumps=0 --with-trilinos=0 --with-fftw=0 --with-valgrind=0 --with-gmp=0 --with-libpng=0 --with-giflib=0 --with-mpfr=0 --with-netcdf=0 --with-pnetcdf=0 --with-moab=0 --with-random123=0 --with-exodusii=0 --with-cgns=0 --with-memkind=0 --with-p4est=0 --with-saws=0 --with-yaml=0 --with-hwloc=0 --with-libjpeg=0 --with-scalapack=0 --with-strumpack=0 --with-mmg=0 --with-parmmg=0 --with-tetgen=0 --with-zoltan=0
37: [0]PETSC ERROR: #1 OPFLOWCheckModelSolverCompatibility() at /ccs/home/peles/src/exago/ExaGO/src/opflow/interface/opflow.cpp:3226
37: [0]PETSC ERROR: #2 OPFLOWSetUp() at /ccs/home/peles/src/exago/ExaGO/src/opflow/interface/opflow.cpp:1718
37: [0]PETSC ERROR: #3 SCOPFLOWSetUp() at /ccs/home/peles/src/exago/ExaGO/src/scopflow/interface/scopflow.cpp:727
37: terminate called after throwing an instance of 'ExaGOError'
37:   what():  No support for this operation for this object typeOPFLOW solver IPOPT incompatible with model POWER_BALANCE_HIOP
37: [1]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
37: [1]PETSC ERROR: No support for this operation for this object type
37: [1]PETSC ERROR: OPFLOW solver IPOPT incompatible with model POWER_BALANCE_HIOP
37: [1]PETSC ERROR: See https://petsc.org/release/faq/ for trouble shooting.
37: [1]PETSC ERROR: Petsc Release Version 3.22.1, Oct 28, 2024 
37: [1]PETSC ERROR: /ccs/home/peles/src/exago/build/tests/functionality/scopflow/test_scopflow_functionality with 3 MPI process(es) and PETSC_ARCH  on frontier09114 by peles Sun Mar  8 22:59:43 2026
37: [1]PETSC ERROR: Configure options: --prefix=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/petsc-3.22.1-krpsfilhn6vzspkcy2fr55jsjok5co3z --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 --with-make-exec=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/gmake-4.4.1-jqumzocgd77u52c2j4q5jydy5fudpevo/bin/make --with-cc=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpicc --with-cxx=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpicxx --with-fc=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpif90 --with-precision=double --with-scalar-type=real --with-shared-libraries=1 --with-debugging=0 --with-openmp=0 --with-64-bit-indices=0 --with-blaslapack-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/gcc-14.2/openblas-0.3.20-dqkevi2sbdkwcbowvnedcnqgmb5ek3fz/lib/libopenblas.so --with-x=0 --with-sycl=0 --with-clanguage=C --with-cuda=0 --with-hip=0 --with-metis=1 --with-metis-include=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/metis-5.1.0-xxxrqjarlepqlm7imt7euzks5mxeuieh/include --with-metis-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/metis-5.1.0-xxxrqjarlepqlm7imt7euzks5mxeuieh/lib/libmetis.so --with-hypre=0 --with-parmetis=1 --with-parmetis-include=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/parmetis-4.0.3-amlsqtxr6fucwh6kgc7buw64ertnficn/include --with-parmetis-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/parmetis-4.0.3-amlsqtxr6fucwh6kgc7buw64ertnficn/lib/libparmetis.so --with-kokkos=0 --with-kokkos-kernels=0 --with-superlu_dist=0 --with-ptscotch=0 --with-suitesparse=0 --with-hdf5=0 --with-zlib=0 --with-mumps=0 --with-trilinos=0 --with-fftw=0 --with-valgrind=0 --with-gmp=0 --with-libpng=0 --with-giflib=0 --with-mpfr=0 --with-netcdf=0 --with-pnetcdf=0 --with-moab=0 --with-random123=0 --with-exodusii=0 --with-cgns=0 --with-memkind=0 --with-p4est=0 --with-saws=0 --with-yaml=0 --with-hwloc=0 --with-libjpeg=0 --with-scalapack=0 --with-strumpack=0 --with-mmg=0 --with-parmmg=0 --with-tetgen=0 --with-zoltan=0
37: [1]PETSC ERROR: #1 OPFLOWCheckModelSolverCompatibility() at /ccs/home/peles/src/exago/ExaGO/src/opflow/interface/opflow.cpp:3226
37: [1]PETSC ERROR: #2 OPFLOWSetUp() at /ccs/home/peles/src/exago/ExaGO/src/opflow/interface/opflow.cpp:1718
37: [1]PETSC ERROR: #3 SCOPFLOWSetUp() at /ccs/home/peles/src/exago/ExaGO/src/scopflow/interface/scopflow.cpp:727
37: terminate called after throwing an instance of 'ExaGOError'
37:   what():  No support for this operation for this object typeOPFLOW solver IPOPT incompatible with model POWER_BALANCE_HIOP
37: [2]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
37: [2]PETSC ERROR: No support for this operation for this object type
37: [2]PETSC ERROR: OPFLOW solver IPOPT incompatible with model POWER_BALANCE_HIOP
37: [2]PETSC ERROR: See https://petsc.org/release/faq/ for trouble shooting.
37: [2]PETSC ERROR: Petsc Release Version 3.22.1, Oct 28, 2024 
37: [2]PETSC ERROR: /ccs/home/peles/src/exago/build/tests/functionality/scopflow/test_scopflow_functionality with 3 MPI process(es) and PETSC_ARCH  on frontier09114 by peles Sun Mar  8 22:59:43 2026
37: [2]PETSC ERROR: Configure options: --prefix=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/petsc-3.22.1-krpsfilhn6vzspkcy2fr55jsjok5co3z --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 --with-make-exec=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/gmake-4.4.1-jqumzocgd77u52c2j4q5jydy5fudpevo/bin/make --with-cc=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpicc --with-cxx=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpicxx --with-fc=/opt/cray/pe/mpich/8.1.31/ofi/amd/6.0/bin/mpif90 --with-precision=double --with-scalar-type=real --with-shared-libraries=1 --with-debugging=0 --with-openmp=0 --with-64-bit-indices=0 --with-blaslapack-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/gcc-14.2/openblas-0.3.20-dqkevi2sbdkwcbowvnedcnqgmb5ek3fz/lib/libopenblas.so --with-x=0 --with-sycl=0 --with-clanguage=C --with-cuda=0 --with-hip=0 --with-metis=1 --with-metis-include=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/metis-5.1.0-xxxrqjarlepqlm7imt7euzks5mxeuieh/include --with-metis-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/metis-5.1.0-xxxrqjarlepqlm7imt7euzks5mxeuieh/lib/libmetis.so --with-hypre=0 --with-parmetis=1 --with-parmetis-include=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/parmetis-4.0.3-amlsqtxr6fucwh6kgc7buw64ertnficn/include --with-parmetis-lib=/lustre/orion/stf006/world-shared/nkouk/exago-05-2025/spack-install/linux-sles15-zen3/rocmcc-6.3.1/parmetis-4.0.3-amlsqtxr6fucwh6kgc7buw64ertnficn/lib/libparmetis.so --with-kokkos=0 --with-kokkos-kernels=0 --with-superlu_dist=0 --with-ptscotch=0 --with-suitesparse=0 --with-hdf5=0 --with-zlib=0 --with-mumps=0 --with-trilinos=0 --with-fftw=0 --with-valgrind=0 --with-gmp=0 --with-libpng=0 --with-giflib=0 --with-mpfr=0 --with-netcdf=0 --with-pnetcdf=0 --with-moab=0 --with-random123=0 --with-exodusii=0 --with-cgns=0 --with-memkind=0 --with-p4est=0 --with-saws=0 --with-yaml=0 --with-hwloc=0 --with-libjpeg=0 --with-scalapack=0 --with-strumpack=0 --with-mmg=0 --with-parmmg=0 --with-tetgen=0 --with-zoltan=0
37: [2]PETSC ERROR: #1 OPFLOWCheckModelSolverCompatibility() at /ccs/home/peles/src/exago/ExaGO/src/opflow/interface/opflow.cpp:3226
37: [2]PETSC ERROR: #2 OPFLOWSetUp() at /ccs/home/peles/src/exago/ExaGO/src/opflow/interface/opflow.cpp:1718
37: [2]PETSC ERROR: #3 SCOPFLOWSetUp() at /ccs/home/peles/src/exago/ExaGO/src/scopflow/interface/scopflow.cpp:727
37: terminate called after throwing an instance of 'ExaGOError'
37:   what():  No support for this operation for this object typeOPFLOW solver IPOPT incompatible with model POWER_BALANCE_HIOP
37: srun: error: frontier09114: tasks 0-2: Aborted (core dumped)
37: srun: Terminating StepId=4187125.178
1/1 Test #37: FUNCTIONALITY_TEST_SCOPFLOW_HIOP_PBHIOP_MPI_TESTSUITE ...***Failed    2.04 sec

0% tests passed, 1 tests failed out of 1

Total Test time (real) =   2.09 sec

The following tests FAILED:
         37 - FUNCTIONALITY_TEST_SCOPFLOW_HIOP_PBHIOP_MPI_TESTSUITE (Failed)

Comment thread src/scopflow/interface/scopflow.cpp Outdated
Comment on lines +697 to +698
/* Base-case problem model should be POWER_BALANCE_POLAR */
ierr = OPFLOWSetModel(scopflow->opflow0, OPFLOWMODEL_PBPOL);
ierr = OPFLOWSetModel(scopflow->opflow0, scopflow->subproblem_model);

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe this is the reason why tests 36 and 37 on Frontier fail. The base-case problem is solved with Ipopt and needs Ipopt compatible model. If the subproblem model is incompatible, the two level optimization tests will fail.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reverted in 20c8a49. This will require more thought if we want to run everything with DCOPF.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would naively think that the solution for DCOPF is straightforward. The failing tests here were caused because we were trying to use deprecated HiOp mixed dense-sparse models with Ipopt. DCOPF, on the other hand can be and is solved with Ipopt.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Right, the question is how to support both. My previous change allowed me to run with DCOPF. But as long as we're using those tests, this will not work. The tests are written with the assumption that the base solver and model are silently set here.

@nkoukpaizan

Copy link
Copy Markdown
Collaborator Author

On Mac platform with GCC 13.4 from MacPorts test 12 fails:

test 12
    Start 12: OPFLOW_LINEFLOW_PENALTY

The same test passes on `develop` branch with the same setting. It would be good to find out what change in the PR has caused this test to fail.

See #169. That test should always be failing. It was not being built on develop. I removed the build constraint on HIOP, which is not needed, so it now builds and fails.

@nkoukpaizan

Copy link
Copy Markdown
Collaborator Author

Closing here. Will continue development at https://github.com/ORNL/ExaGO.

@nkoukpaizan nkoukpaizan closed this Mar 9, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

bug Something isn't working scopflow

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants