Alineator

The System

• Model7: SuperMicro AS-1021M-T2+V (product link)
  • Server with 2x AMD 64bit Dual-Core 2218 Opteron working at 2,6 GHz (i.e. 4 cores)
  • Seagate 250 GB SATA II 7200 rpm + Seagate 450 GB SATA II 7200 rpm
  • 32GB DDR2 667 MHz buffered (registered) ECC SDRAM 72-bit, 240-pin gold-plated DIMMs
• Powered by Scientific Linux IFIC 4.4 (Beryllium) (based on SLC 4) in 64bit mode.
• Logo by Carmen Garcia ()

Using ScaLapack

• Login in tst01.ific.uv.es
• You have the compiled code in: /l/sanchezj/SCALAPACK/Scalapack_working_copy/ or /l/cescobar/ScaLapack/code
• You should copy it to your working directory in order to be able to edit the eigen.dat file (temporally procedure)
• Edit eigen.dat and you will see the following lines
  • $PATH/IterX_bigmatrix.bin (set the path for the input matrix)
  • $PATH/IterX_bigvector.bin (set the path for the input vector)
  • $PATH/IterX_scalapack_vtx.bin (set the path for the output matrix)
  • 2 (don't modify, parallel process configuration)
  • 2 (don't modify, parallel process configuration)
  • $DOF (set by hand DoF) (temporal)
  • 256 (don't modify, parallel process configuration)
• Ready to run (copy and paste):

            setenv PATH /opt/mpich2-1.0.4/bin:$PATH
            mpd --ncpus=4 &
            mpiexec -n 4 ./eigen
            mpdallexit

Number of DoFs and solving times according to geometry setup

• matrix size corresonds to triangular matrix size
• solving time corresponds to the approximative amount of time spent using Scalapack (Alineator) / Lapack (single PC)

Software

IPC

Files

• v1.1: Carlos Escobar, 26-11-2007 ()
• v1.0: Sergio Gonzalez, 29-10-2007 ()

Comments

• software suite required to run parallel processing athena/tst01
  • ipcmat.h
    • header file with struct MsgBuf
    • C++ #DEFINEs for different message types
  • ipcmatt.cxx
    • testing program (generates random matrices)
    • creates appropiate eigen.dat file for solving in Scalapack
  • ipcmatr.cxx
    • receiver program
• Change hardcoded filenames according to your preferences...
• Makefile provided:
  • make clean
  • make all
• to be compiled in 64-bits in tst01:
  • g++ (GCC) 3.4.6 20060404 (Red Hat 3.4.6-8)

Jacobian

v1.0: Sergio Gonzalez, 23-10-2007 ():

• ROOT macro to perform the projection of bigvector and bigmatrix.
• Reads jacobian, bigvector, bigmatrix and then computes:
  • J.T()*bigvector
  • J.T()*bigmatrix*J
• Stores output in both binary and text formats
• Provides some timing information
• To be compiled in 64-bits (use for example /l/segonzal/root/v5.17.02_amd64_gcc3.4 in tst01.ific.uv.es)
  • For csh or tcsh:
    • setenv ROOTSYS /l/segonzal/root/v5.17.02_amd64_gcc3.4
    • set PATH=($ROOTSYS/bin $PATH)
    • setenv LD_LIBRARY_PATH $LD_LIBRARY_PATH:$ROOTSYS/lib
  • For bash or zsh:
    • export ROOTSYS=/l/segonzal/root/v5.17.02_amd64_gcc3.4
    • export PATH=$PATH:$ROOTSYS/bin
    • export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$ROOTSYS/lib

-- CarlosEscobar - 11 Mar 2007