iQ0dZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z m Z ddl mZmZmZmZmZejeZd dZGdd e ZdS) zKSSH remote execution environment with ControlMaster connection persistence.N)Path)BaseEnvironment _popen_bash)FileSyncManageriter_sync_filesquoted_mkdir_commandquoted_rm_commandunique_parent_dirsreturncLtjdstddS)z@Fail fast with a clear error when the SSH client is unavailable.sshzWSSH is not installed or not in PATH. Install OpenSSH client: apt install openssh-clientN)shutilwhich RuntimeError;/home/ubuntu/.hermes/hermes-agent/tools/environments/ssh.py_ensure_ssh_availablers3 <    e     rc $eZdZdZ d&dededed ed ed ef fd Zd'ded zdefdZdZ defdZ d(dZ dededd fdZ dee eefdd fdZdedd fdZdeedd fdZd(dZddd d d!ed"ed ed#ed zdejf d$Zd%ZxZS))SSHEnvironmentaRun commands on a remote machine over SSH. Spawn-per-call: every execute() spawns a fresh ``ssh ... bash -c`` process. Session snapshot preserves env vars across calls. CWD persists via in-band stdout markers. Uses SSH ControlMaster for connection reuse. ~<hostusercwdtimeoutportkey_pathc t|||_|_|_|_t tjdz _ j ddtj |d|d| dd}j |dz _t!_t+fd jjjj _jd dS) N)rrz hermes-sshT)parentsexist_ok@:z.sockc2tjdS)N/.hermes)r _remote_homeselfsrz)SSHEnvironment.__init__..EsD4E1O1O1O!P!Pr) get_files_fn upload_fn delete_fnbulk_upload_fnbulk_download_fn)force)super__init__rrrr rtempfile gettempdir control_dirmkdirhashlibsha256encode hexdigestcontrol_socketr_establish_connection_detect_remote_homer)_ensure_remote_dirsr _scp_upload _ssh_delete_ssh_bulk_upload_ssh_bulk_download _sync_managersync init_session) r+rrrrrr _socket_id __class__s ` rr4zSSHEnvironment.__init__)s S'222      3 5 566E td;;;^ # #d # #T # # * * , ,  )++crc #.J1E1E1EE ""$$$ 4466   """,PPPP&&0!4     d+++ rN extra_argsr cTdg}|dd|jg|ddg|ddg|ddg|ddg|ddg|jd kr)|d t|jg|jr|d |jg|r||||jd |j|S) Nr -o ControlPath=zControlMaster=autozControlPersist=300z BatchMode=yesz StrictHostKeyChecking=accept-newzConnectTimeout=10rz-p-ir$)extendr=rstrr appendrr)r+rJcmds r_build_ssh_commandz!SSHEnvironment._build_ssh_commandOs3g D>)<>>?@@@ D./000 D./000 D/*+++ D<=>>> D-./// 9?? JJc$)nn- . . . = . JJdm, - - -  # JJz " " " di--$)--... rc|}|d tj|ddd}|jdkrD|jp|j}td|dS#tj $r!td|j d|j d wxYw) Nz!echo 'SSH connection established'Tcapture_outputtextrrzSSH connection failed: zSSH connection to r$z timed out) rSrQ subprocessrun returncodestderrstripstdoutrTimeoutExpiredrr)r+rRresult error_msgs rr>z$SSHEnvironment._establish_connection`s%%'' 6777 W^C4QSTTTF A%%"M//11JV]5H5H5J5J "#HY#H#HIII&%( W W WUDIUU UUUVV V Ws A'B0Cc\ |}|dtj|ddd}|j}|r(|jdkrtd||Sn#t$rYnwxYw|j dkrdSd |j S) z(Detect the remote user's home directory.z echo $HOMET rVrzSSH: remote home = %srootz/rootz/home/) rSrQrYrZr^r]r[loggerdebug Exceptionr)r+rRr`homes rr?z"SSHEnvironment._detect_remote_homeks ))++C JJ| $ $ $^C4QSTTTF=&&((D )Q.. 4d;;;     D  9  7# ###sBB BBc|jd}||d|d|dg}|}|t|t j|ddddS) z?Create base ~/.hermes directory tree on remote in one SSH call.r(z/skillsz /credentialsz/cacheTrcrVN)r)rSrQrrYrZ)r+basedirsrRs rr@z"SSHEnvironment._ensure_remote_dirss#---&&&4(=(=(=$O%%'' '--...s4dBGGGGGGr host_path remote_pathctt|j}|}|dt j|tj|dddddd|j g}|j dkr)| d t|j g|j r| d |j g| ||j d |jd |gtj|ddd }|jdkr)t!d|jdS)z0Upload a single file via scp over ControlMaster.z mkdir -p TrcrVscprLrMrz-PrNr$r%rz scp failed: N)rPrparentrSrQshlexquoterYrZr=rrOr rrr[rr\r])r+rlrmrq mkdir_cmdscp_cmdr`s rrAzSSHEnvironment._scp_uploadsUT+&&-..++-- :U[%8%8::;;;yD"MMMM$ Dt/B D DE 9?? NND#di..1 2 2 2 = 2 NND$-0 1 1 1 di#K#K$)#K#Kk#K#KLMMM4QSTTT   ! !Efm.A.A.C.CEEFF F " !rfilesc |sdSt|}|r|}|t|t j|ddd}|jdkr)td|j tj d5}|D]\}}tj ||d }tjtj |d tjtj ||d d d d|dg} |} | dt j| tjtj} t j| | jtjtj} n7#t.$r*| | wxYw| j | d\} }d}| | d\} }n"| jr| jnd}nr#tj$r`| | | | tdwxYw| jdkr@td| jd|d | jdkr@td| jd|d  dddn #1swxYwYt@!dtE|dS)aUpload many files in a single tar-over-SSH stream. Pipes ``tar c`` on the local side through an SSH connection to ``tar x`` on the remote, transferring all files in one TCP stream instead of spawning a subprocess per file. Directory creation is batched into a single ``mkdir -p`` call beforehand. Typical improvement: ~580 files goes from O(N) scp round-trips to a single streaming transfer. NTrprVrzremote mkdir failed: zhermes-ssh-bulk-)prefix/)r#tarz-chf-z-C.z tar xf - --no-overwrite-dir -C /)r^r\)stdinr^r\x)rrrczSSH bulk upload timed outztar create failed (rc=z): replaceerrorsz tar extract over SSH failed (rc=z*SSH: bulk-uploaded %d file(s) via tar pipe)#r rSrQrrYrZr[rr\r]r5TemporaryDirectoryospathjoinlstripmakedirsdirnamesymlinkabspathPopenPIPEr^rgkillwaitclose communicatepollreadr_decodererflen)r+rvr"rRr`stagingrlrmstagedtar_cmdssh_cmdtar_procssh_proc_ ssh_stderrtar_stderr_raws rrCzSSHEnvironment._ssh_bulk_uploads)  F$U++  T))++C JJ+G44 5 5 5^C4QSTTTF A%%"#R6=;N;N;P;P#R#RSSS (0B C C C7 w*/ ? ?& ;g{/A/A#/F/FGG BGOOF33dCCCC 27??955v>>>>fc4#>G--//G NN= > > >!'  H %+8?:?%?       O ! ! # # # @ ( 4 4S 4 A A :"%==??*(0(<(???  @"a''"IX-@II%,,I,>>DDFFII"a''"Ex7JEE!(( (::@@BBEE(g7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 r  A3u::NNNNNsF-C=N/+1GN/4HN/.A+JN/A/L  BN//N36N3destc|jdd}|}|dt j|t |d5}tj||tj d}dddn #1swxYwY|j dkr=td |j d dS) z*Download remote .hermes/ as a tar archive.r(ryztar cf - -C / wbr~)r^r\rNrzSSH bulk download failed: rr)r)rrSrQrrrsopenrYrZrr[rr\rr])r+rrel_baserfr`s rrDz!SSHEnvironment._ssh_bulk_downloads3'11188==))++? H(=(=??@@@ $   \^GAjoWZ[[[F \ \ \ \ \ \ \ \ \ \ \ \ \ \ \   ! !lFM ? ? ?3 +++rc|jr3td|j|jr ddd|jdd|jd|jg}tj |dd n#ttj f$rYnwxYw |j dS#t$rYdSwxYwdS) Nz"SSH: syncing files from sandbox...r rLrMz-Oexitr$T)rWr) rEreinfo sync_backr=existsrrrYrZOSErrorSubprocessErrorunlink)r+rRs rcleanupzSSHEnvironment.cleanups   + KK< = = =   ( ( * * *   % % ' '  d$H43F$H$HV %?%?DI%?%?As4CCCCCZ78     #**,,,,,      s$6B B%$B%)C CC)rrrr)Nr N)__name__ __module__ __qualname____doc__rPintr4listrSr>r?r@rAtuplerCrrDrBrboolrYrrr __classcell__)rIs@rrr s,9A$$$$$$LTD[D" W W W$S$$$$(HHHHGSGsGtGGGG"POd5c?&;POPOPOPOPOd nt n n n n nMS MdMMMM"""";@!$+/ , , ,C ,4 , ,!Dj ,4>4D , , , ,rrr)rr9loggingrrrrrYr5pathlibrtools.environments.baserrtools.environments.file_syncrrrr r getLoggerrrerrrrrrs#QQ @@@@@@@@  8 $ $    CCCCC_CCCCCr