CFDEM - CLUSTER

thank you very much for your answer. I am not sure if I have to get gcc, because the Openfoem package (CentFOAM) comes with gcc. However, it turned out that when I relink $WM_MPLIB I to any of the preinstalled openmpi directories on the cluster (I changed the OpnenFoam settings.sh) the cfdensystest (which mpc+) passes and I could start the LIGGGHTS compilation. Nevertheless, after that changed that Openfoam is no more running in parralel, means I can not use the mpirun command anymore and the LIGGGHTS compilatin also breaks down showing that error:
Compiling sub-libraries of LIGGGHTS now...
Please provide the libraries to be compiled in the //home/gerhard/CFDEM/CFDEMcoupling-PUBLIC-/src/lagrangian/cfdemParticle/etc/library-liggghts-list.txt file.
Libraries must be in the /home/gerhard/LIGGGHTS/LIGGGHTS-PUBLIC/src/../lib directory.
Any ideas?
In addition I was wondering because I do not have root acces in which folder should I compile the gcc compiler you suggest, also in the third party folder of Openfoam or somewhere else?
Thank you so much

first of all many thanks for your reply ... I am doing sth. right ...
1. so I just compilded LIGGGHTS, again and run the binary lmp_fedory_fpic, and It worked. I also tested one of the tutorials in parallel on one node, and they worked too even if I reset the paths of mpi as explained above. When it comes to compiling cfddemCompCFDEM, the compilation ran extreamly quick. So I was wondering if there is also a way to double check if the compilation was successful?

2. due to the fact that the compilation of OF takes ages and I am never 100% sure if it was succsessful that is why I use centFoam which runs just fine also in parallel. However, when I started to compile LIGGGHTS I always had that mpic++ issue described above. That is why I tried to link the settings.sh of OF to on other mpi folder which I found on the cluster insted of linking it to the third party directory of OF. The wired thing is that I after your reply I was able to run LIGGGHTS but Openfoam doesnt allow any mpirun anymore, which was working before I changed the mpi settings. When I change the settings back to origninal in the settings.sh OF works again using mpirun and liggghts doesnt ... At present I try to avoid a new compilation of OF because it took me ages to get it compilded and I only have accses to the cluster for a limited time...
Any ideas ?

thank you so much for your effort!!!!!!!!!!!!!!!!!!!!!! please find below my answers to your suggestions ...
- mpic++ wrapper complains about not finding a gcc executable in this case.
Yes that is the case the entire systemcheck seems fine but it doesnt find mpic++
- try to find the gcc- and g++ binaries in your cluster and add it to you local PATH (in .bashrc export PATH=$PATH:/path/to/gcc
I am sorry this command locate gcc | less to find gcc- and g++, however I did not understand the output, Just a long long list. Anyway I found gcc and g++ folders in the Third party directory. But dont you thin they are ok because they are recoginzed by the system test.
-did you compile g++ from third party directory and after that compiled OF ?
Actually I did not compile OpenFOAM, myself. I tried it many times but never succeded. Due to the fact that the cluster runs on centOs 6.5 it is possible to run a precompiled version of OpenFOAM which is called CentFOAM. It works great you can find it here: http://sourceforge.net/projects/centfoam/.
-did you compile g++ from third party directory and after that compiled OF ?
Yes I also tried that but it broke down and I got somewhat like a million error messages
-what is the output if which mpic++ (or mpcxx) and mpirun
the output wichout changeing the settings.sh in OpenFOAM is:
which mpic++ ==> ~/centFOAM/OpenFOAM/ThirdParty-2.3.x/platforms/linux64Gcc/openmpi-1.6.5/bin/mpic++ ...What I understand that mpic++ is there. I also tracked it down in the folder.
which mpirun ==> ~/centFOAM/OpenFOAM/ThirdParty-2.3.x/platforms/linux64Gcc/openmpi-1.6.5/bin/mpirun ... Which is in the same folder and it is recognized.
what is mpirun -V ==> mpirun (Open MPI) 1.6.5
what is mpic++ --version ==> When I test that I get the wrapper message again. That triggered me to change the settings.sh to another openmpi version which I found on the cluster.
By the way I changed the alis of OpenFoam to a permanent source because if I do not activate the alias the system findes nothing neither gcc or openmpi
Actually I have no more ideas how to get it running ... I think setting a path in the .bashrc might be the best option: However, I do not fully understand how to track its path?
What do you think
Thank you soooo much

haha well I also thought that it may not be so wise to mixup the mpi versions...
anyway I think we are gettling closer:
I just checked
- which g++ ==> ~/centFOAM/OpenFOAM/ThirdParty-2.3.x/platforms/linux64/gcc-4.8.2/bin/g++
- which gcc ==> ~/centFOAM/OpenFOAM/ThirdParty-2.3.x/platforms/linux64/gcc-4.8.2/bin/gcc

I tried that path in the .bashrc
export PATH=$PATH:/home/gerhard/centFOAM/OpenFOAM/ThirdParty-2.3.x/platforms/linux64/gcc-4.8.2/bin/gcc
however the systems test still complains about mpic++ wrapper ...
Did I set the path wrong ? ... sorry for bothering you ...

GUESS WHAT YOU where RIGHT!!! THERE IS NO MORE MPI WRAPPER message and the cfdemSysTest doesn't fail anymore.
So I went on to compile liggghts ... The compilation took some time and so I was pretty optimistic, well it truned out ... too early. I was not able to compile Liggghts. It seems that it can not write the lmp_fedora_fpic binary. All I found it a lmp_fedora_fpic.a arcive file which I can not open. I copied that error message from the terminal: Note It is somewhere in the compilation script
collect2: error: ld returned 1 exit status
make[1]: *** [../lmp_fedora_fpic] Error 1
make[1]: Leaving directory `/home/gerhard/LIGGGHTS/LIGGGHTS-PUBLIC/src/Obj_fedora_fpic'
make: *** [fedora_fpic] Error 2
make[1]: Entering directory `/home/gerhard/LIGGGHTS/LIGGGHTS-PUBLIC/src/Obj_fedora_fpic'
mpic++ -O2 -funroll-loops -fstrict-aliasing -Wall -Wno-uninitialized -fPIC -fPIC -DLAMMPS_GZIP -c universe.cpp

the end of the output is:
make[1]: Leaving directory `/home/gerhard/LIGGGHTS/LIGGGHTS-PUBLIC/src/Obj_fedora_fpic'

Compiling sub-libraries of LIGGGHTS now...
Please provide the libraries to be compiled in the //home/gerhard/CFDEM/CFDEMcoupling-PUBLIC-2.3.x/src/lagrangian/cfdemParticle/etc/library-liggghts-list.txt file.
Libraries must be in the /home/gerhard/LIGGGHTS/LIGGGHTS-PUBLIC/src/../lib directory.

Due to your earliey post I just checked I there was any binary. However, I could not fine one ...
Do you have any ideas ???
Thank you sooo much

well you were right again !!! I just checked a make fedora -j1 and that came out:
Do you have any idea how I can fix that ?

/usr/bin/ld: cannot find -lmpi
collect2: error: ld returned 1 exit status
make[1]: *** [../lmp_fedora] Error 1
make[1]: Leaving directory `/home/gerhard/LIGGGHTS/LIGGGHTS-PUBLIC/src/Obj_fedora'
make: *** [fedora] Error 2

Thank you sooooo much

Hi,
I am sorry I tried it the entire day but I still end up with this errror message ... This is soo wiered ... do you have any other suggestions ?

/usr/bin/ld: cannot find -lmpi
collect2: error: ld returned 1 exit status
make[1]: *** [../lmp_fedora_fpic] Error 1
make[1]: Leaving directory `/home/gerhard/LIGGGHTS/LIGGGHTS-PUBLIC/src/Obj_fedora_fpic'
make: *** [fedora_fpic] Error 2
make[1]: Entering directory `/home/gerhard/LIGGGHTS/LIGGGHTS-PUBLIC/src/Obj_fedora_fpic'
mpic++ -O2 -funroll-loops -fstrict-aliasing -Wall -Wno-uninitialized -fPIC -fPIC -DLAMMPS_GZIP -c universe.cpp
Thank you sooo much
G