Using device 5 (rank 5, local rank 5, local size 6) : Tesla K80 Using device 3 (rank 3, local rank 3, local size 6) : Tesla K80 Using device 1 (rank 1, local rank 1, local size 6) : Tesla K80 Using device 2 (rank 2, local rank 2, local size 6) : Tesla K80 Using device 4 (rank 4, local rank 4, local size 6) : Tesla K80 Using device 0 (rank 0, local rank 0, local size 6) : Tesla K80 running on 6 total cores distrk: each k-point on 6 cores, 1 groups distr: one band on 1 cores, 6 groups ******************************************************************************* You are running the GPU port of VASP! When publishing results obtained with this version, please cite: - M. Hacene et al., http://dx.doi.org/10.1002/jcc.23096 - M. Hutchinson and M. Widom, http://dx.doi.org/10.1016/j.cpc.2012.02.017 in addition to the usual required citations (see manual). GPU developers: A. Anciaux-Sedrakian, C. Angerer, and M. Hutchinson. ******************************************************************************* ----------------------------------------------------------------------------- | | | W W AA RRRRR N N II N N GGGG !!! | | W W A A R R NN N II NN N G G !!! | | W W A A R R N N N II N N N G !!! | | W WW W AAAAAA RRRRR N N N II N N N G GGG ! | | WW WW A A R R N NN II N NN G G | | W W A A R R N N II N N GGGG !!! | | | | Please note that VASP has recently been ported to GPU by means of | | OpenACC. You are running the CUDA-C GPU-port of VASP, which is | | deprecated and no longer actively developed, maintained, or | | supported. In the near future, the CUDA-C GPU-port of VASP will be | | dropped completely. We encourage you to switch to the OpenACC | | GPU-port of VASP as soon as possible. | | | ----------------------------------------------------------------------------- vasp.6.2.1 16May21 (build Apr 11 2022 11:03:26) complex MD_VERSION_INFO: Compiled 2022-04-11T18:25:55-UTC in devlin.sd.materialsdesign. com:/home/medea2/data/build/vasp6.2.1/16685/x86_64/src/src/build/gpu from svn 1 6685 This VASP executable licensed from Materials Design, Inc. POSCAR found type information on POSCAR SnO H POSCAR found : 3 types and 22 ions NWRITE = 1 NWRITE = 1 NWRITE = 1 NWRITE = 1 NWRITE = 1 NWRITE = 1 ----------------------------------------------------------------------------- | | | W W AA RRRRR N N II N N GGGG !!! | | W W A A R R NN N II NN N G G !!! | | W W A A R R N N N II N N N G !!! | | W WW W AAAAAA RRRRR N N N II N N N G GGG ! | | WW WW A A R R N NN II N NN G G | | W W A A R R N N II N N GGGG !!! | | | | For optimal performance we recommend to set | | NCORE = 2 up to number-of-cores-per-socket | | NCORE specifies how many cores store one orbital (NPAR=cpu/NCORE). | | This setting can greatly improve the performance of VASP for DFT. | | The default, NCORE=1 might be grossly inefficient on modern | | multi-core architectures or massively parallel machines. Do your | | own testing! More info at https://www.vasp.at/wiki/index.php/NCORE | | Unfortunately you need to use the default for GW and RPA | | calculations (for HF NCORE is supported but not extensively tested | | yet). | | | ----------------------------------------------------------------------------- LDA part: xc-table for Pade appr. of Perdew WARNING: The GPU port of VASP has been extensively tested for: ALGO=Normal, Fast, and VeryFast. Other algorithms may produce incorrect results or yield suboptimal performance. Handle with care! ----------------------------------------------------------------------------- | | | W W AA RRRRR N N II N N GGGG !!! | | W W A A R R NN N II NN N G G !!! | | W W A A R R N N N II N N N G !!! | | W WW W AAAAAA RRRRR N N N II N N N G GGG ! | | WW WW A A R R N NN II N NN G G | | W W A A R R N N II N N GGGG !!! | | | | The distance between some ions is very small. Please check the | | nearest-neighbor list in the OUTCAR file. | | I HOPE YOU KNOW WHAT YOU ARE DOING! | | | ----------------------------------------------------------------------------- POSCAR, INCAR and KPOINTS ok, starting setup creating 32 CUDA streams... creating 32 CUDA streams... creating 32 CUDA streams... creating 32 CUDA streams... creating 32 CUDA streams... creating 32 CUDA streams... creating 32 CUFFT plans with grid size 90 x 24 x 24... creating 32 CUFFT plans with grid size 90 x 24 x 24... creating 32 CUFFT plans with grid size 90 x 24 x 24... creating 32 CUFFT plans with grid size 90 x 24 x 24... creating 32 CUFFT plans with grid size 90 x 24 x 24... creating 32 CUFFT plans with grid size 90 x 24 x 24... FFT: planning ... WAVECAR not read entering main loop N E dE d eps ncg rms rms(c) DAV: 1 0.262308169412E+04 0.26231E+04 -0.71732E+04 1200 0.190E+03 DAV: 2 0.622299186915E+03 -0.20008E+04 -0.19227E+04 1164 0.624E+02 DAV: 3 0.168925328543E+03 -0.45337E+03 -0.43701E+03 1176 0.252E+02 DAV: 4 0.128121527414E+03 -0.40804E+02 -0.39799E+02 1236 0.856E+01 DAV: 5 0.126301875064E+03 -0.18197E+01 -0.18002E+01 1380 0.168E+01 0.567E+02 DAV: 6 0.157035709572E+03 0.30734E+02 -0.15174E+02 1608 0.922E+01 0.320E+02 DAV: 7 -0.398707209368E+03 -0.55574E+03 -0.39868E+03 1860 0.157E+02 0.111E+02 CUDA Error in hamil.cu, line 577: uncorrectable ECC error encountered Failed to copy from device to host! ***************************** Error running VASP parallel with MPI #!/bin/bash cd "/home/user/MD/TaskServer/Tasks/140.123.79.184-32000-task43342" export PATH="/home/user/MD/Linux-x86_64/IntelMPI5/bin:$PATH" export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/home/user/MD/Linux-x86_64/IntelMPI5/lib:/home/user/MD/TaskServer/Tools/vasp-gpu6.2.1/Linux-x86_64" "/home/user/MD/Linux-x86_64/IntelMPI5/bin/mpirun" -r ssh -np 6 "/home/user/MD/TaskServer/Tools/vasp-gpu6.2.1/Linux-x86_64/vasp_gpu" forrtl: severe (174): SIGSEGV, segmentation fault occurred Image PC Routine Line Source vasp_gpu 0000000005445AD4 Unknown Unknown Unknown libpthread-2.22.s 00007F2FEBD20C70 Unknown Unknown Unknown vasp_gpu 0000000005403F45 Unknown Unknown Unknown vasp_gpu 0000000000EFF7A7 Unknown Unknown Unknown vasp_gpu 0000000000F844A5 Unknown Unknown Unknown vasp_gpu 0000000001813C76 Unknown Unknown Unknown vasp_gpu 000000000043FC9E Unknown Unknown Unknown libc-2.22.so 00007F2FDC246725 __libc_start_main Unknown Unknown vasp_gpu 000000000043FB29 Unknown Unknown Unknown forrtl: error (69): process interrupted (SIGINT) Image PC Routine Line Source vasp_gpu 0000000005445D70 Unknown Unknown Unknown libpthread-2.22.s 00007FD8E31B7C70 Unknown Unknown Unknown libmpi.so.12 00007FD8D3FBCFFB PMPIDI_CH3I_Progr Unknown Unknown libmpi.so.12 00007FD8D415C745 Unknown Unknown Unknown libmpi.so.12 00007FD8D41582F2 Unknown Unknown Unknown libmpi.so.12 00007FD8D3F6F033 Unknown Unknown Unknown libmpi.so.12 00007FD8D3F710BF MPI_Alltoall Unknown Unknown libmpifort.so.12 00007FD8D4BED42E mpi_alltoall__ Unknown Unknown vasp_gpu 00000000004A4641 Unknown Unknown Unknown vasp_gpu 0000000000649C4F Unknown Unknown Unknown vasp_gpu 0000000000EFFD7C Unknown Unknown Unknown vasp_gpu 0000000000F844A5 Unknown Unknown Unknown vasp_gpu 0000000001813C76 Unknown Unknown Unknown vasp_gpu 000000000043FC9E Unknown Unknown Unknown libc-2.22.so 00007FD8D36DD725 __libc_start_main Unknown Unknown vasp_gpu 000000000043FB29 Unknown Unknown Unknown forrtl: error (69): process interrupted (SIGINT) Image PC Routine Line Source vasp_gpu 0000000005445D70 Unknown Unknown Unknown libpthread-2.22.s 00007FD1BDA7CC70 Unknown Unknown Unknown libmpi.so.12 00007FD1AE882002 PMPIDI_CH3I_Progr Unknown Unknown libmpi.so.12 00007FD1AEA21745 Unknown Unknown Unknown libmpi.so.12 00007FD1AEA1D2F2 Unknown Unknown Unknown libmpi.so.12 00007FD1AE834033 Unknown Unknown Unknown libmpi.so.12 00007FD1AE8360BF MPI_Alltoall Unknown Unknown libmpifort.so.12 00007FD1AF4B242E mpi_alltoall__ Unknown Unknown vasp_gpu 00000000004A4641 Unknown Unknown Unknown vasp_gpu 0000000000649C4F Unknown Unknown Unknown vasp_gpu 0000000000EFFD7C Unknown Unknown Unknown vasp_gpu 0000000000F844A5 Unknown Unknown Unknown vasp_gpu 0000000001813C76 Unknown Unknown Unknown vasp_gpu 000000000043FC9E Unknown Unknown Unknown libc-2.22.so 00007FD1ADFA2725 __libc_start_main Unknown Unknown vasp_gpu 000000000043FB29 Unknown Unknown Unknown forrtl: error (69): process interrupted (SIGINT) Image PC Routine Line Source vasp_gpu 0000000005445D70 Unknown Unknown Unknown libpthread-2.22.s 00007F89F346AC70 Unknown Unknown Unknown libmpi.so.12 00007F89E4270002 PMPIDI_CH3I_Progr Unknown Unknown libmpi.so.12 00007F89E440F745 Unknown Unknown Unknown libmpi.so.12 00007F89E440B2F2 Unknown Unknown Unknown libmpi.so.12 00007F89E4222033 Unknown Unknown Unknown libmpi.so.12 00007F89E42240BF MPI_Alltoall Unknown Unknown libmpifort.so.12 00007F89E4EA042E mpi_alltoall__ Unknown Unknown vasp_gpu 00000000004A4641 Unknown Unknown Unknown vasp_gpu 0000000000649C4F Unknown Unknown Unknown vasp_gpu 0000000000EFFD7C Unknown Unknown Unknown vasp_gpu 0000000000F844A5 Unknown Unknown Unknown vasp_gpu 0000000001813C76 Unknown Unknown Unknown vasp_gpu 000000000043FC9E Unknown Unknown Unknown libc-2.22.so 00007F89E3990725 __libc_start_main Unknown Unknown vasp_gpu 000000000043FB29 Unknown Unknown Unknown forrtl: error (69): process interrupted (SIGINT) Image PC Routine Line Source vasp_gpu 0000000005445D70 Unknown Unknown Unknown libpthread-2.22.s 00007F99F4E8CC70 Unknown Unknown Unknown libmpi.so.12 00007F99E5C920C0 PMPIDI_CH3I_Progr Unknown Unknown libmpi.so.12 00007F99E5E31745 Unknown Unknown Unknown libmpi.so.12 00007F99E5E2D2F2 Unknown Unknown Unknown libmpi.so.12 00007F99E5C44033 Unknown Unknown Unknown libmpi.so.12 00007F99E5C460BF MPI_Alltoall Unknown Unknown libmpifort.so.12 00007F99E68C242E mpi_alltoall__ Unknown Unknown vasp_gpu 00000000004A4641 Unknown Unknown Unknown vasp_gpu 0000000000649C4F Unknown Unknown Unknown vasp_gpu 0000000000EFFD7C Unknown Unknown Unknown vasp_gpu 0000000000F844A5 Unknown Unknown Unknown vasp_gpu 0000000001813C76 Unknown Unknown Unknown vasp_gpu 000000000043FC9E Unknown Unknown Unknown libc-2.22.so 00007F99E53B2725 __libc_start_main Unknown Unknown vasp_gpu 000000000043FB29 Unknown Unknown Unknown forrtl: error (69): process interrupted (SIGINT) Image PC Routine Line Source vasp_gpu 0000000005445D70 Unknown Unknown Unknown libpthread-2.22.s 00007F745A680C70 Unknown Unknown Unknown libc-2.22.so 00007F744AC5BBF7 __sched_yield Unknown Unknown libmpi.so.12 00007F744B4862CF PMPIDI_CH3I_Progr Unknown Unknown libmpi.so.12 00007F744B625745 Unknown Unknown Unknown libmpi.so.12 00007F744B6212F2 Unknown Unknown Unknown libmpi.so.12 00007F744B438033 Unknown Unknown Unknown libmpi.so.12 00007F744B43A0BF MPI_Alltoall Unknown Unknown libmpifort.so.12 00007F744C0B642E mpi_alltoall__ Unknown Unknown vasp_gpu 00000000004A4641 Unknown Unknown Unknown vasp_gpu 0000000000649C4F Unknown Unknown Unknown vasp_gpu 0000000000EFFD7C Unknown Unknown Unknown vasp_gpu 0000000000F844A5 Unknown Unknown Unknown vasp_gpu 0000000001813C76 Unknown Unknown Unknown vasp_gpu 000000000043FC9E Unknown Unknown Unknown libc-2.22.so 00007F744ABA6725 __libc_start_main Unknown Unknown vasp_gpu 000000000043FB29 Unknown Unknown Unknown *****************************