SEARCH
TOOLBOX
LANGUAGES
Forum Menu

Solved: ECCE using non-standard ssh ports -- port redirection.

From NWChem

You are viewing a single post from the thread title above
Jump to: navigation, search

Click here for full thread
Clicked A Few Times
Threads 3
Posts 12
SCP and submit solution
Hi Gary.
I turned on ECCE_RCOM_LOGMODE and managed to sort out the scp problem and with that got things running.
Thank you so much for pointing me in the right direction! It turns out that you made ECCE a bit too smart...

The original problems were
1. I can't copy the files to remote site/node and
2. No remote xterm opens

SCP problem: Turns out scp wants upper-case P and doesn't accept lower-case p. ssh of course want lower-case p and doesn't accept upper-case P.

This is from a succesful run on a local node using port 22
arg 0: scp
arg 1: -r
arg 2: /tmp/ecce_andy/jobs/water__8PsJsN/nwch.nw
arg 3: /tmp/ecce_andy/jobs/water__8PsJsN/submit__water
arg 4: /tmp/ecce_andy/jobs/water__8PsJsN/eccejobmonitor.conf
arg 5: /tmp/ecce_andy/jobs/water__8PsJsN/nwchem.desc
arg 6: /home/andy/.ecce/ecce-6.3/apps/scripts/eccejobmonitor
arg 7: andy@borax:/home/andy/mine/testing/old/water
end remote copy command


This is an unsuccesful run using a node via localhost -p 9999
with this in the ecce-6.3/apps/siteconfig/remote_shells.site file
ssh_p9999: ssh -p 9999

and this is what happens:
arg 0: scp
arg 1: -p
arg 2: 9999
arg 3: /tmp/ecce_andy/jobs/water__bLmRNx/nwch.nw
arg 4: /tmp/ecce_andy/jobs/water__bLmRNx/submit__water
arg 5: /tmp/ecce_andy/jobs/water__bLmRNx/eccejobmonitor.conf
arg 6: /tmp/ecce_andy/jobs/water__bLmRNx/nwchem.desc
arg 7: /home/andy/.ecce/ecce-6.3/apps/scripts/eccejobmonitor
arg 8: andy@localhost:/home/andy/jobs/testing/old/water


Forgetting about the -r switch for a second here, the latter command fails when I try:
scp -p 9999 /tmp/ecce_andy/jobs/water__bLmRNx/nwch.nw andy@localhost:/home/andy/jobs/testing/old/water
scp: /home/andy/jobs/testing/old/water: No such file or directory


which is true, there isn't on localhost (but should be on localhost -p 9999). That directory structure is on the remote node (runtime: /home/andy/jobs + testing/old/water) but for some reason the -p switch is completely ignored by scp (the files on the ecce workstation is on ~/.ecce/ecce-6.3/server/data/Ecce/users/andy/testing/old/water/).

However,
scp -P 9999 /tmp/ecce_andy/jobs/water__bLmRNx/nwch.nw andy@localhost:/home/andy/jobs/testing/old/water
nwch.nw                                                                                                                                                                                                    100%  476     0.5KB/s   00:00 

works.

The solution is thus to change to:
ssh_p9999: ssh -p 9999|scp -P 9999

I can now submit jobs to the remote debian node (p 9999)!




Getting the remote site to work for submission took a little longer and boiled down to a silly little thing (in addition to the -P issue):
I had qsub in the path name like this:
 NWChem: /opt/sw/nwchem-6.1/bin/nwchem
 Gaussian-03: /usr/local/bin/G09
 perlPath: /usr/bin/perl
 qmgrPath: /opt/n1ge62/bin/lx24-amd64/qsub

while it should really be
 NWChem: /opt/sw/nwchem-6.1/bin/nwchem
 Gaussian-03: /usr/local/bin/G09
 perlPath: /usr/bin
 qmgrPath: /opt/n1ge62/bin/lx24-amd64



On a related note, I'm not sure what corresponding lines I'm to look for when parsing the logging output from using "singleConnect: check", but it's not quite as relevant anymore.

See here for the full setup using port redirection:
[blog http://verahill.blogspot.com.au/2012/05/port-redirection-with-eccenwchem.html]



Remaining problem:
This really isn't that important anymore since I'm more concerned with launching jobs.

However, here it is for completeness:
I still can't open any remote terminals, and I've also tried with e.g.
' ssh_p9999: ssh -XC -p 9999|scp -P 9999


I'm not sure why, as running
xterm -title "oxygen" -bg "#b7b8ba" -fg "#000000" -sb -e csh -c "cd ~ && $SHELL"

opens a window as it is supposed to.

Creating remote shell:
machine (localhost)
remote shell (ssh_p9999)
local shell (csh)
user name (andy)
password is 0 characters
Remote shell command:
arg 0: ssh
arg 1: -XC
arg 2: -p
arg 3: 9999
arg 4: -v
arg 5: -o
arg 6: ForwardX11=yes
arg 7: -l
arg 8: andy
arg 9: localhost
arg 10: echo
arg 11: +hi+
arg 12: &&
arg 13: csh
arg 14: -i
End remote shell command
OpenSSH_5.9p1 Debian-5, OpenSSL 1.0.1c 10 May 2012
Authenticated to localhost ([127.0.0.1]:9999).
unalias precmd; set prompt=+go+; unset echo
+hi+
% Warning: no access to tty (Bad file descriptor).
Thus no job control in this shell.
+go+unalias *
+go+date; echo CMDSTAT=$status
Wed May 30 20:06:23 PDT 2012
CMDSTAT=0
+go+exit; echo GOODBYE
GOODBYE
+go+exit
Transferred: sent 2952, received 2576 bytes, in 1.1 seconds
Bytes per second: sent 2622.8, received 2288.7
Creating remote shell:
machine (localhost)
remote shell (ssh_p9999)
local shell (csh)
user name (andy)
password is 0 characters
Remote shell command:
arg 0: ssh
arg 1: -XC
arg 2: -p
arg 3: 9999
arg 4: -v
arg 5: -o
arg 6: ForwardX11=yes
arg 7: -l
arg 8: andy
arg 9: localhost
arg 10: echo
arg 11: +hi+
arg 12: &&
arg 13: csh
arg 14: -i
End remote shell command
OpenSSH_5.9p1 Debian-5, OpenSSL 1.0.1c 10 May 2012
Authenticated to localhost ([127.0.0.1]:9999).
unalias precmd; set prompt=+go+; unset echo
+hi+
% Warning: no access to tty (Bad file descriptor).
Thus no job control in this shell.
+go+unalias *
+go+if ($?PATH) setenv PATH /usr/bin/perl:/bin:/usr/sbin:/sbin:/usr/X11R6/bin:/usr/bin/X11:${PATH}
+go+if ($?PATH == 0) setenv PATH /usr/bin/perl:/bin:/usr/sbin:/sbin:/usr/X11R6/bin:/usr/bin/X11
+go+date; echo CMDSTAT=$status
Wed May 30 20:06:32 PDT 2012
CMDSTAT=0
+go+echo $DISPLAY; echo CMDSTAT=$status
localhost:11.0
CMDSTAT=0
+go+xset q; echo CMDSTAT=$status
Keyboard Control:
  auto repeat:  on    key click percent:  0    LED mask:  00000002
  XKB indicators:
    00: Caps Lock:   off    01: Num Lock:    on     02: Scroll Lock: off
    03: Compose:     off    04: Kana:        off    05: Sleep:       off
    06: Suspend:     off    07: Mute:        off    08: Misc:        off
    09: Mail:        off    10: Charging:    off    11: Shift Lock:  off
    12: Group 2:     off    13: Mouse Keys:  off
  auto repeat delay:  500    repeat rate:  33
  auto repeating keys:  00ffffffdffffbbf
                        fadfffeffffdffff
                        9fffffffffffffff
                        fff7ffffffffffff
  bell percent:  50    bell pitch:  400    bell duration:  100
Pointer Control:
  acceleration:  1/1    threshold:  5
Screen Saver:
  prefer blanking:  yes    allow exposures:  yes
  timeout:  0    cycle:  0
Colors:
  default colormap:  0x20    BlackPixel:  0    WhitePixel:  16777215
Font Path:
  /usr/share/fonts/X11/misc,/usr/share/fonts/X11/100dpi/:unscaled,/usr/share/fonts/X11/75dpi/:unscaled,/usr/share/fonts/X11/Type1,/usr/share/fonts/X11/100dpi,/usr/share/fonts/X11/75dpi,/var/lib/defoma/x-ttcidfont-conf.d/dirs/TrueType,built-ins,/usr/share/fonts/X11/misc,/usr/share/fonts/X11/100dpi/:unscaled,/usr/share/fonts/X11/75dpi/:unscaled,/usr/share/fonts/X11/Type1,/usr/share/fonts/X11/100dpi,/usr/share/fonts/X11/75dpi,/var/lib/defoma/x-ttcidfont-conf.d/dirs/TrueType,built-ins
DPMS (Energy Star):
  Standby: 0    Suspend: 0    Off: 0
  DPMS is Enabled
  Monitor is On
CMDSTAT=0
+go+echo $PATH; echo CMDSTAT=$status
/usr/bin/perl:/bin:/usr/sbin:/sbin:/usr/X11R6/bin:/usr/bin/X11:/usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/games
CMDSTAT=0
+go+if (-x  channel 1/xterm) echo TRUE
+go+if: Expression Syntax.
Creating remote shell:
machine (localhost)
remote shell (ssh_p9999)
local shell (csh)
user name (andy)
password is 0 characters
Remote shell command:
arg 0: ssh
arg 1: -XC
arg 2: -p
arg 3: 9999
arg 4: -v
arg 5: -o
arg 6: ForwardX11=yes
arg 7: -l
arg 8: andy
arg 9: localhost
arg 10: echo
arg 11: +hi+
arg 12: &&
arg 13: csh
arg 14: -i
End remote shell command
OpenSSH_5.9p1 Debian-5, OpenSSL 1.0.1c 10 May 2012
Authenticated to localhost ([127.0.0.1]:9999).
unalias precmd; set prompt=+go+; unset echo
+hi+
% Warning: no access to tty (Bad file descriptor).
Thus no job control in this shell.
+go+unalias *
+go+date; echo CMDSTAT=$status
Wed May 30 20:07:17 PDT 2012
CMDSTAT=0
+go+exit; echo GOODBYE
GOODBYE
+go+exit
Transferred: sent 2952, received 2592 bytes, in 1.1 seconds
Bytes per second: sent 2626.2, received 2305.9
Creating remote shell:
machine (localhost)
remote shell (ssh_p9999)
local shell (csh)
user name (andy)
password is 0 characters
Remote shell command:
arg 0: ssh
arg 1: -XC
arg 2: -p
arg 3: 9999
arg 4: -v
arg 5: -o
arg 6: ForwardX11=yes
arg 7: -l
arg 8: andy
arg 9: localhost
arg 10: echo
arg 11: +hi+
arg 12: &&
arg 13: csh
arg 14: -i
End remote shell command
Edited On 10:41:21 PM PDT - Wed, May 30th 2012 by Ohlincha


Who's here now Members 0 Guests 0 Bots/Crawler 0


AWC's: 2.5.10 MediaWiki - Stand Alone Forum Extension
Forum theme style by: AWC