Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pspw_md QA tests returning NaN when running on more than 24 processors #825

Open
edoapra opened this issue Jul 11, 2023 · 4 comments
Open
Assignees
Labels

Comments

@edoapra
Copy link
Collaborator

edoapra commented Jul 11, 2023

Describe the bug
The pspw_md QA tests returning NaN when using more than 24 processors on tahoma using the current master branch ccc2e41

Describe settings used
ARMCI_NETWORK=MPI-TS
FC=gfortran
Singularity image
oras://ghcr.io/edoapra/nwchem/nwchem-dev.mpi-ts.ompi41x:20230710_233358

The hotfix/release-7-2-0 branch is not affected by this bug
pspw_md.output.239354.txt

Attach log files

diff -u pspw_md.ok.out.nwparse pspw_md.out.nwparse
--- pspw_md.ok.out.nwparse	2023-07-11 03:28:56.000000000 -0700
+++ pspw_md.out.nwparse	2023-07-11 03:28:56.000000000 -0700
@@ -1,13 +1,13 @@
 Effective nuclear repulsion energy (a.u.) 85.91
-Total PSPW energy : -13.56964
+Total PSPW energy : nan
 == 0.000 0.000 0.000 
-Total PSPW energy : -13.74176
+Total PSPW energy : nan
 == 0.000 0.000 0.000 
-Total PSPW energy : -13.74176
+Total PSPW energy : nan
 == 0.000 0.000 0.000 
-Total PSPW energy : -14.32395
+Total PSPW energy : nan
 Effective nuclear repulsion energy (a.u.) 85.91
-Total PSPW energy : -14.27678
-Total PSPW energy : -14.33590
-Total PSPW energy : -14.25267
-Total PSPW energy : -14.38971
+Total PSPW energy : nan
+Total PSPW energy : nan
+Total PSPW energy : nan
+Total PSPW energy : nan
@ebylaska
Copy link
Collaborator

Ok, I'll try to figure out a fix.

@edoapra
Copy link
Collaborator Author

edoapra commented Jul 21, 2023

Commit 3355e82 fixes this issue

@edoapra edoapra closed this as completed Jul 21, 2023
@edoapra
Copy link
Collaborator Author

edoapra commented Jul 21, 2023

Unfortunately, the bug is still present in the master branch at this time

@edoapra edoapra reopened this Jul 21, 2023
@ebylaska
Copy link
Collaborator

I fixed another bug I found while working on this...Hopefully, have a solution soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants