iVxUdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlZddlmZmZmZmZmZddlmZddlmZddlmZddlmZddlmZ dd lm Z n#e!$rd Z YnwxYw dd l"m#Z$n#e!$rd Z$YnwxYwdd l%m&Z&ddl'm(Z(ddl)m*Z*ddl+m,Z,ddl-m.Z. ddl/m0Z1n#e2$rdZ1YnwxYwej3e4Z5dZ6ej78e6Z9ej:dde;ee<fdZ?dde<deZfd?Zgd@erLst) is_safe_urlcdSNFrrs rrrQur)CloudBrowserProvider)BrowserbaseProvider)BrowserUseProvider)FirecrawlProvider) normalize_browser_cloud_provider)is_camofox_modecdSrrrrrrr^rr) z#/data/data/com.termux/files/usr/binz$/data/data/com.termux/files/usr/sbinz/opt/homebrew/binz/opt/homebrew/sbinz/usr/local/sbinz/usr/local/binz /usr/sbinz/usr/binz/sbinz/bin)maxsizereturn.cg}d}tj|st|S tj|D]r}|dr[|dkrUtj||d}tj|r||sn#t$rYnwxYwt|S)a+Find Homebrew versioned Node.js bin directories (e.g. node@20, node@24). When Node is installed via ``brew install node@24`` and NOT linked into /opt/homebrew/bin, agent-browser isn't discoverable on the default PATH. This function finds those directories so they can be prepended. z/opt/homebrew/optnodebin) ospathisdirtuplelistdir startswithjoinappendOSError)dirs homebrew_optentrybin_dirs r_discover_homebrew_node_dirsr4tsD&L 7== & &T{{ Z -- ) )E'' )EVOO',,|UEBB7==)))KK(((  )      ;;sBB<< C C ct}t|dz dz }|gtttS)zMReturn ordered browser CLI PATH candidates shared by discovery and execution.r%r&)r strlistr4_SANE_PATH_DIRS) hermes_homehermes_node_bins r_browser_candidate_path_dirsr;sF!##K+.677O  Ud#?#A#ABB U_ UUr existing_pathc^d|pdtjD}t|}g}t D]A}|r||vs||vr tj|r||Btj||zS)zLPrepend browser-specific PATH fallbacks without reordering existing entries.cg|]}||Srr).0ps r z'_merge_browser_path..sJJJJ!JJJrr<) splitr'pathsepsetr;r(r)r.r-)r= path_partsexisting_parts prefix_partsparts r_merge_browser_pathrJsJJm1r88DDJJJJ__N L,..&& t~--1E1E  7==   &    % % % :??<*4 5 55r_last_screenshot_cleanup_by_dir@closerecord_EMPTY_OK_COMMANDS_cached_command_timeoutFc trtSdat} ddlm}|}t |dd}|t t|d}n2#t$r%}t d|Yd}~nd}~wwxYw|a|S) aReturn the configured browser command timeout from config.yaml. Reads ``config["browser"]["command_timeout"]`` and falls back to ``DEFAULT_COMMAND_TIMEOUT`` (30s) if unset or unreadable. Result is cached after the first call and cleared by ``cleanup_all_browsers()``. Trread_raw_configbrowsercommand_timeoutNz.Could not read command_timeout from config: %s) _command_timeout_resolvedrQDEFAULT_COMMAND_TIMEOUThermes_cli.configrTr maxint Exceptionloggerdebug)resultrTcfgvales r_get_command_timeoutrds!'&& $ $FJ555555oc9&788 ?S1%%F JJJ EqIIIIIIIIJ$ MsAA B $BB cTtjddpdS)u>Model for browser_vision (screenshot analysis — multimodal).AUXILIARY_VISION_MODELr<Nr'getenvstriprrr_get_vision_modelrjs& 9-r 2 2 8 8 : : BdBrcTtjddpdS)uCModel for page snapshot text summarization — same as web_extract.AUXILIARY_WEB_EXTRACT_MODELr<Nrgrrr_get_extraction_modelrms& 92B 7 7 = = ? ? G4Grcdp_urlcP|pd}|sdS|}d|vr|S|}|dr|ddkr|ddddrUd|dddvr7|d rd nd |d ddz}n|S|d r|}n|dd z} tj |d}| | }n6#t$r)}td||||cYd}~Sd}~wwxYwt!| dpd}|rtd|||Std||S)aNormalize a user-supplied CDP endpoint into a concrete connectable URL. Accepts: - full websocket endpoints: ws://host:port/devtools/browser/... - HTTP discovery endpoints: http://host:port or http://host:port/json/version - bare websocket host:port values like ws://host:port For discovery-style endpoints we fetch /json/version and return the webSocketDebuggerUrl so downstream tools always receive a concrete browser websocket instead of an ambiguous host:port URL. r<z/devtools/browser/)ws://zwss://:/r!rpzhttp://zhttps://z://z /json/version timeoutz,Failed to resolve CDP endpoint %s via %s: %sNwebSocketDebuggerUrlzResolved CDP endpoint %s -> %szKCDP discovery at %s did not return webSocketDebuggerUrl; using raw endpoint)rilowerr,countrstriprsplitisdigitrCendswithrequestsgetraise_for_statusjsonr]r^warningr6info) rnrawlowered discovery_url version_urlresponsepayloadexcws_urls r_resolve_cdp_overriders9 =b   ! !C riikkGw&& M-.. 99S>>Q  3::c??#9#9#q#A#A"#E#M#M#O#O TW_b_h_hilno_p_pqs_tTtTt*1*<*E?? F2 F-'F2-F2ctjdd}|rt |S ddlm}|}|di}t|tr2t t|ddpdSn2#t$r%}t d|Yd}~nd}~wwxYwdS) a|Return a normalized CDP URL override, or empty string. Precedence is: 1. ``BROWSER_CDP_URL`` env var (live override from ``/browser connect``) 2. ``browser.cdp_url`` in config.yaml (persistent config) When either is set, we skip both Browserbase and the local headless launcher and connect directly to the supplied Chrome DevTools Protocol endpoint. BROWSER_CDP_URLr<rrSrUrnz.Could not read browser.cdp_url from config: %sN) r'environrrirrZrT isinstancedictr6r]r^r_) env_overriderTra browser_cfgrcs r_get_cdp_overriders:>>"3R88>>@@L3$\222J555555oggi,, k4 ( ( T([__Y-K-K-Qr)R)RSS S T JJJ EqIIIIIIIIJ 2sA,B33 C"=CC"cddlm}m}m} ddlm}|}t |tr|dini}t |ts||fSt|dp|}||vrt d||}|d} |t|n|}|dkr|}n#ttf$r|}YnwxYw||fS#t$r||fcYSwxYw)zRead ``browser.dialog_policy`` + ``browser.dialog_timeout_s`` from config. Returns a ``(policy, timeout_s)`` tuple, falling back to the supervisor's defaults when keys are absent or invalid. r)DEFAULT_DIALOG_POLICYDEFAULT_DIALOG_TIMEOUT_S_VALID_POLICIESrSrU dialog_policyz/Invalid browser.dialog_policy=%r; using defaultdialog_timeout_s)tools.browser_supervisorrrrrZrTrrrr6r^r_float TypeError ValueErrorr]) rrrrTrarpolicy timeout_raw timeout_ss r_get_dialog_policy_configr$s ?555555o0:30E0EMcggi,,,2 +t,, C(*BB B[___55N9NOO  ( ( LLJF S S S*F!oo&899  1.9.Ek***KcIA~~4 :& 1 1 10III 1y  ???$&>>>>>?s=AC6"AC6=CC6C/,C6.C//C66DDtask_idct}|sot5t|i}dddn #1swxYwYt |dpd}|rt |}|sdS ddlm}t\}}| ||||dS#t$r'}t d||Yd}~dSd}~wwxYw)u~Start a CDP supervisor for ``task_id`` if an endpoint is reachable. Idempotent — delegates to ``SupervisorRegistry.get_or_start`` which skips when a supervisor for this ``(task_id, cdp_url)`` already exists and tears down + restarts on URL change. Safe to call on every ``browser_navigate`` / ``/browser connect`` without worrying about double-attach. Resolves the CDP URL in this order: 1. ``BROWSER_CDP_URL`` / ``browser.cdp_url`` — covers ``/browser connect`` and config-set overrides. 2. ``_active_sessions[task_id]["cdp_url"]`` — covers Browserbase + any other cloud provider whose ``create_session`` returns a raw CDP URL. Swallows all errors — failing to attach the supervisor must not break the browser session itself. The agent simply won't see ``pending_dialogs`` / ``frame_tree`` fields in snapshots. Nrnr<rSUPERVISOR_REGISTRY)rrnrrz8CDP supervisor attach for task=%s failed (non-fatal): %s) r _cleanup_lock_active_sessionsrr6rrrr get_or_startr]r^r_)rrn session_infomayberrrrs r_ensure_cdp_supervisorrHs& !!G 3 = =+//<>>%7 %E%G%G " III DaHHHHHHHHI%/00  * * , , ;%6 " " 3 5 5  ..00 ;):& !!sA+B?B C)C  C) is_termuxc&trdSdS)Nz5npm install -g agent-browser && agent-browser installzAnpm install -g agent-browser && agent-browser install --with-deps)_is_termux_environmentrrr_browser_install_hintrsGFF N Nr browser_cmdcjto%to|dkS)Nnpx agent-browser)r_is_local_moderi)rs r%_requires_real_termux_browser_installrs0 ! # # g(8(8 g[=N=N=P=PTg=ggrc$dtS)NzqLocal browser automation on Termux cannot rely on the bare npx fallback. Install agent-browser explicitly first: )rrrr_termux_browser_install_errorrs" M3H3J3J M MrcBtrdStduS)zCReturn True when the browser tool will use a local browser backend.FN)rrrrrrrs&u  D ((rc>tptduS)uReturn True when the browser runs locally (no cloud provider). SSRF protection is only meaningful for cloud backends (Browserbase, BrowserUse) where the agent could reach internal resources on a remote machine. For local backends — Camofox, or the built-in headless Chromium without a cloud provider — the user already has full terminal and network access on the same machine, so the check adds no security value. N)_is_camofox_moderrrr_is_local_backendrs!    >!4!6!6$!>>rT#_cached_auto_local_for_private_urlscZtrtSda ddlm}|}|di}t |t r&d|vr"t|dan2#t$r%}t d|Yd}~nd}~wwxYwtS)a$Return whether a cloud-configured install should auto-spawn a local Chromium for LAN/localhost URLs. Reads ``browser.auto_local_for_private_urls`` once (default ``True``) and caches it for the process lifetime. When enabled, ``browser_navigate`` routes URLs whose host resolves to a private/loopback/LAN address to a local headless Chromium sidecar even when a cloud provider (Browserbase / Browser-Use / Firecrawl) is configured globally. Public URLs continue to use the cloud provider in the same conversation. TrrSrUauto_local_for_private_urlsz:Could not read auto_local_for_private_urls from config: %sN) %_auto_local_for_private_urls_resolvedrrZrTrrrboolr]r^r_rTrarrcs r_auto_local_for_private_urlsrs-322,0) V555555oggi,, k4 ( ( -Jk-Y-Y26 =>>33 / VVV QSTUUUUUUUUV ..sA!A44 B#>BB#rc ddlm}ddl}ddl}||}|jpdd}|sdS ||}|j p$|j p|j p|| dvS#t$rYnwxYw|dvs|d rd S|d s*|d s|d rd S ||d|j|j}n#|j$rYdSwxYw|D]d\}}}}} || d}n#t$rY1wxYw|j s%|j s|j s|| dvrd SedS#t&$r'} t(d|| Yd} ~ dSd} ~ wwxYw)uReturn True when the URL's host resolves to a private/LAN/loopback address. Reuses ``tools.url_safety.is_safe_url`` as the oracle — if the SSRF check would reject the URL, we treat it as "private" for routing purposes. DNS resolution failures are treated as NOT private (fall through to whatever backend is configured, which will surface the DNS error naturally). r)urlparseNr<.Fz 100.64.0.0/10) localhostz .localhostTz.localz.lanz .internalz#URL-privacy check failed for %s: %s) urllib.parser ipaddresssockethostnameriryr{ ip_address is_private is_loopback is_link_local ip_networkrr~ getaddrinfo AF_UNSPEC SOCK_STREAMgaierrorr]r^r_) rrrrparsedrip addr_info_sockaddrrs r_url_is_privater s0 *))))) #O)r002288::AA#FF 5 %%h//B ?>?#?--o>>>       D  ~ % %):):<)H)H %4   X & & (*;*;F*C*C xGXGXYdGeGe 4 **8T6;KVM_``II   55 $-   Aq!Q ))(1+66      > # --o>>>>tt?u  :CEEEuuuuusAF+ AB!! B.+F+-B..F+ ?F+"D10F+1 D?;F+>D?? F+ E)(F+) E63F+5E660F+(F++ G5GGc|d}tr|Str|St|Sts|St |s|S|t S)aPick the session key that should handle ``url`` for ``task_id``. Returns the bare task_id unless ALL of these are true: 1. A cloud provider is configured (``_get_cloud_provider()`` is not None). 2. Auto-local routing is enabled (``browser.auto_local_for_private_urls``, default True). 3. The URL resolves to a private/LAN/loopback address. 4. A CDP override is not active (that path owns the whole session). 5. Camofox mode is not active (Camofox is already local-only). When all are true, returns ``f"{task_id}::local"`` so the hybrid-routing path spawns a local Chromium sidecar while the cloud session (if any) continues to serve public URLs. Ndefault)rrrrr _LOCAL_SUFFIX)rrs r_navigation_session_keyrDs~$ ' ) ) 3   &} & &&r session_keyc6|tS)zCReturn True when ``session_key`` is a hybrid-routing local sidecar.)r~r)rs r_is_local_sidecar_keyrbs    . ..rc@|d}t||S)aKReturn the session key to use for a non-nav browser tool call. If a previous ``browser_navigate`` on this task_id set a last-active key, use it so snapshot/click/fill/etc. hit the same session. Otherwise fall back to the bare task_id (matches original behavior for tasks that never triggered hybrid routing). Nr)_last_active_session_keyrrs r_last_session_keyrgs$ # ' ' 9 99rcZtrtSdada ddlm}|}|di}t |t r$t|ddan2#t$r%}t d|Yd }~nd }~wwxYwtS) zReturn whether the browser is allowed to navigate to private/internal addresses. Reads ``config["browser"]["allow_private_urls"]`` once and caches the result for the process lifetime. Defaults to ``False`` (SSRF protection active). TFrrSrUallow_private_urlsrz1Could not read allow_private_urls from config: %sN) _allow_private_urls_resolvedrrZrTrrrr r]r^r_rs r_allow_private_urlsrts$*))#' !& M555555oggi,, k4 ( ( )8 455u*** & MMM H!LLLLLLLLM %%sAA44 B#>BB#cLtjdkrdStjS)ueReturn a short temp directory path suitable for Unix domain sockets. macOS sets ``TMPDIR`` to ``/var/folders/xx/.../T/`` (~51 chars). When we append ``agent-browser-hermes_…`` the resulting socket path exceeds the 104-byte macOS limit for ``AF_UNIX`` addresses, causing agent-browser to fail with "Failed to create socket directory" or silent screenshot failures. Linux ``tempfile.gettempdir()`` already returns ``/tmp``, so this is a no-op there. On macOS we bypass ``TMPDIR`` and use ``/tmp`` directly (symlink to ``/private/tmp``, sticky-bit protected, always available). darwinz/tmp)sysplatformtempfile gettempdirrrr_socket_safe_tmpdirrs% |xv    rr_recording_sessionsrz::localBROWSER_INACTIVITY_TIMEOUT300_session_last_activitycBtrdSdatrItdt t t n2#t $r%}td|Yd}~nd}~wwxYwt5t t t dddn #1swxYwYno#t5t t t dddw#1swxYwYwxYw tdS#t $r&}t d|Yd}~dSd}~wwxYw)ue Emergency cleanup of all active browser sessions. Called on process exit or interrupt to prevent orphaned sessions. Also runs the orphan reaper to clean up daemons left behind by previously crashed hermes processes — this way every clean hermes exit sweeps accumulated orphans, not just ones that actively used the browser tool. NTz2Emergency cleanup: closing %s active session(s)...zEmergency cleanup error: %szOrphan reap on exit failed: %s) _cleanup_donerr^rlencleanup_all_browsersr]errorrclearrr_reap_orphaned_browser_sessionsr_)rcs r_emergency_cleanup_all_sessionsrs&M , H()) + + + , " " " " ; ; ; LL6 : : : : : : : : ; , , &&(((&,,...#))+++ , , , , , , , , , , , , , , , , , &&(((&,,...#))+++ , , , , , , , , , , , , , , , ,:'))))) ::: 5q999999999:sAC. BA;6C.;BC. A C""C&)C&.E6A E EE EE EE.. F8FFctj}g}t5ttD](\}}||z t kr||) dddn #1swxYwY|D]} t|t||z }t d||t|t5|tvrt|=dddn #1swxYwY#t$r&}t d||Yd}~d}~wwxYwdS)a7 Clean up browser sessions that have been inactive for longer than the timeout. This function is called periodically by the background cleanup thread to automatically close sessions that haven't been used recently, preventing orphaned sessions (local or Browserbase) from accumulating. NzA> AD'D9 DD D D D ED<<E socket_dir session_namecn tj||d}t|d5}|t tjddddS#1swxYwYdS#t$r'}t d||Yd}~dSd}~wwxYw)uRecord the current hermes PID as the owner of a browser socket dir. Written atomically to ``/.owner_pid`` so the orphan reaper can distinguish daemons owned by a live hermes process (don't reap) from daemons whose owner crashed (reap). Best-effort — an OSError here just falls back to the legacy ``tracked_names`` heuristic in the reaper. .owner_pidwNz)Could not write owner_pid file for %s: %s) r'r(r-openwriter6getpidr/r^r_)rrr(frs r_write_owner_pidr"s(w||J<(C(C(CDD $__ & GGC $$ % % % & & & & & & & & & & & & & & & & & & ((( @!3 ( ( ( ( ( ( ( ( ((s:3B4A6) B6A::B=A:>B B4 B//B4cddl}t}tj|d}||}||tj|dz }||tj|dz }|sdSt 5dt D}dddn #1swxYwYd}|D]}tj|}| d}|s:tj||d} d} tj | r tt|  } tj| dd } n#t $rd } Ynt"$rd } YnwxYwn#t$t&f$rd} YnwxYw| d ur| ||vrtj||d } tj | st)j|d y tt|  } n.#t$t&f$rt)j|d YwxYw tj| dn3#t $rt)j|d Y#t"$rY/wxYw tj| t,jt0d | ||dz }n#t t"t&f$rYnwxYwt)j|d |rt0d|dSdS)uhScan for orphaned agent-browser daemon processes from previous runs. When the Python process that created a browser session exits uncleanly (SIGKILL, crash, gateway restart), the in-memory ``_active_sessions`` tracking is lost but the node + Chromium processes keep running. This function scans the tmp directory for ``agent-browser-*`` socket dirs left behind by previous runs, reads the daemon PID files, and kills any daemons whose owning hermes process is no longer alive. Ownership detection priority: 1. ``.owner_pid`` file (written by current code) — if the referenced hermes PID is alive, leave the daemon alone regardless of whether it's in *this* process's ``_active_sessions``. This is cross-process safe: two concurrent hermes instances won't reap each other's daemons. 2. Fallback for daemons that predate owner_pid: check ``_active_sessions`` in the current process. If not tracked here, treat as orphan (legacy behavior). Safe to call from any context — atexit, cleanup thread, or on demand. rNzagent-browser-h_*zagent-browser-cdp_*zagent-browser-hermes_*cbh|],}|d|d-S)r)r)r@rs r z2_reap_orphaned_browser_sessions..PsF   xx'' HH^ $ $   ragent-browser-rTF.pid ignore_errorsz2Reaped orphaned browser daemon PID %d (session %s)r!z:Reaped %d orphaned browser session(s) from previous run(s))globrr'r(r-rrvaluesbasename removeprefixisfiler\r read_textrikillProcessLookupErrorPermissionErrorrr/shutilrmtreesignalSIGTERMr^r)r*tmpdirpattern socket_dirs tracked_namesreapedrdir_namerowner_pid_file owner_alive owner_pidpid_file daemon_pids rr r *s_.KKK " "Fgll6#677G))G$$K499RW\\&2GHHIIIK499RW\\&2JKKLLLK      (//11                  F!E6E6 7##J//,,-=>>   j\2M2M2MNN&* 7>>. ) ) # #^ 4 4 > > @ @ F F H HII 'GIq)))"&KK)((("'KKK&'''#'KKK'( # # #"  # $     },,7<< |,A,A,ABBw~~h''  M*D 9 9 9 9  T(^^5577==??@@JJG$    M*D 9 9 9 9 H    GJ " " " "!    M*D 9 9 9 9 H    H    GJ / / / KKL"L 2 2 2 aKFF"OW=    D   j55555 Z PRXYYYYYZZs?$C//C36C3=AG6>GG6 G2"G6$ G2/G61G22G66H  H 8AJ99'K$#K$(K>> L.! L.-L.2AM33N  N c tn2#t$r%}td|Yd}~nd}~wwxYwtrz t n2#t$r%}td|Yd}~nd}~wwxYwt dD]}tsntjd txdSdS)a* Background thread that periodically cleans up inactive browser sessions. Runs every 30 seconds and checks for sessions that haven't been used within the BROWSER_SESSION_INACTIVITY_TIMEOUT period. On first run, also reaps orphaned sessions from previous process lifetimes. zOrphan reap error: %sNzCleanup thread error: %srLr!) r r]r^r_cleanup_runningrrangersleep)rcrs r_browser_cleanup_thread_workerrFs 3')))) 333.222222223   : . 0 0 0 0 : : : NN5q 9 9 9 9 9 9 9 9 :r  A#  JqMMMM      s* A;A A B $BB c4t5ttsWdat jt ddatt dtddddS#1swxYwYdS)z;Start the background cleanup thread if not already running.NTzbrowser-cleanup)targetdaemonnamez0Started inactivity cleanup thread (timeout: %ss)) r_cleanup_threadis_aliverC threadingThreadrFstartr^rrrrr_start_browser_cleanup_threadrPs  p p  "/*B*B*D*D "# '.5&O  ! ! # # # KKJLn o o o p p p p p p p p p p p p p p p p p psA8B  BBcRdattddSdS)z#Stop the background cleanup thread.FNrWrv)rCrKr-rrr_stop_browser_cleanup_threadrRs5"Q'''''#"rc|t5tjt|<ddddS#1swxYwYdS)z1Update the last activity timestamp for a session.N)rrrrs r_update_session_activityrTs} 66*.)++w'666666666666666666s 155browser_navigateuNavigate to a URL in the browser. Initializes the session and loads the page. Must be called before other browser tools. For simple information retrieval, prefer web_search or web_extract (faster, cheaper). For plain-text endpoints — URLs ending in .md, .txt, .json, .yaml, .yml, .csv, .xml, raw.githubusercontent.com, or any documented API endpoint — prefer curl via the terminal tool or web_extract; the browser stack is overkill and much slower for these. Use browser tools when you need to interact with a page (click, fill forms, dynamic content). Returns a compact page snapshot with interactive elements and ref IDs — no need to call browser_snapshot separately after navigating.objectstringz4The URL to navigate to (e.g., 'https://example.com'))type description)rX propertiesrequired)rJrY parametersbrowser_snapshotuGet a text-based snapshot of the current page's accessibility tree. Returns interactive elements with ref IDs (like @e1, @e2) for browser_click and browser_type. full=false (default): compact view with interactive elements. full=true: complete page content. Snapshots over 8000 chars are truncated or LLM-summarized. Requires browser_navigate first. Note: browser_navigate already returns a compact snapshot — use this to refresh after interactions that change the page, or with full=true for complete content.fullbooleanzpIf true, returns complete page content. If false (default), returns compact view with interactive elements only.)rXrYr browser_clickzClick on an element identified by its ref ID from the snapshot (e.g., '@e5'). The ref IDs are shown in square brackets in the snapshot output. Requires browser_navigate and browser_snapshot to be called first.refz=The element reference from the snapshot (e.g., '@e5', '@e12') browser_typezType text into an input field identified by its ref ID. Clears the field first, then types the new text. Requires browser_navigate and browser_snapshot to be called first.z5The element reference from the snapshot (e.g., '@e3')zThe text to type into the field)ratextrcbrowser_scrollzScroll the page in a direction. Use this to reveal more content that may be below or above the current viewport. Requires browser_navigate to be called first. directionupdownzDirection to scroll)rXenumrY browser_backzdNavigate back to the previous page in browser history. Requires browser_navigate to be called first. browser_presszPress a keyboard key. Useful for submitting forms (Enter), navigating (Tab), or keyboard shortcuts. Requires browser_navigate to be called first.keyz:Key to press (e.g., 'Enter', 'Tab', 'Escape', 'ArrowDown')browser_get_imageszGet a list of all images on the current page with their URLs and alt text. Useful for finding images to analyze with the vision tool. Requires browser_navigate to be called first.browser_visionaTake a screenshot of the current page and analyze it with vision AI. Use this when you need to visually understand what's on the page - especially useful for CAPTCHAs, visual verification challenges, complex layouts, or when the text snapshot doesn't capture important visual information. Returns both the AI analysis and a screenshot_path that you can share with the user by including MEDIA: in your response. Requires browser_navigate to be called first.zYWhat you want to know about the page visually. Be specific about what you're looking for.zIf true, overlay numbered [N] labels on interactive elements. Each [N] maps to ref @eN for subsequent browser commands. Useful for QA and spatial reasoning about page layout.)rXrrY)questionannotaternbrowser_consoleuGet browser console output and JavaScript errors from the current page. Returns console.log/warn/error/info messages and uncaught JS exceptions. Use this to detect silent JavaScript errors, failed API calls, and application warnings. Requires browser_navigate to be called first. When 'expression' is provided, evaluates JavaScript in the page context and returns the result — use this for DOM inspection, reading page state, or extracting data programmatically.z0If true, clear the message buffers after readinguJavaScript expression to evaluate in the page context. Runs in the browser like DevTools console — full access to DOM, window, document. Return values are serialized to JSON. Example: 'document.title' or 'document.querySelectorAll("a").length')r  expressioncddl}d|jdd}td|||ddddidS)Nrh_ruz,Created local browser session %s for task %srTr bb_session_idrnfeaturesuuiduuid4hexr^r)rrxrs r_create_local_sessionr{}skKKK/ ("-//L KK>g'''%dO   rcddl}d|jdd}td||||d|ddidS) z?Create a session that connects to a user-supplied CDP endpoint.rNcdp_ruu1Created CDP browser session %s → %s for task %s cdp_overrideTrtrw)rrnrxrs r_create_cdp_sessionrsnKKK1$**,,*3B3/11L KKCgw000%#T*   rc |d}tt|t5|tvrt|cdddS dddn #1swxYwYt |}t }|r|st ||}n|rt|}nqt}|t|}nP | |}|rt|tstd|| dr4t|}tt|d|d<n#t $r}t#|j}t&d|||d t|}n,#t $r}t+d|d |d |d |d}~wwxYwt|tr+t|}d|d <t||d <||d<Yd}~nd}~wwxYwt5|tvrt|cdddS|t|<dddn #1swxYwY|st-||S)u Get or create session info for the given session key. In cloud mode, creates a Browserbase session with proxies enabled. In local mode, generates a session name for agent-browser --session. Also starts the inactivity cleanup thread and updates activity tracking. Thread-safe: multiple subagents can call this concurrently. Args: task_id: Session key. Normally the task_id as-is, but may carry the ``::local`` suffix for the hybrid-routing local sidecar — in that case the cloud provider is skipped even when one is configured, and a local Chromium session is created instead. Returns: Dict with session_name (always), bb_session_id + cdp_url (cloud only) Nrz)Cloud provider returned invalid session: rnzPCloud provider %s failed (%s); attempting fallback to local Chromium for task %sTexc_infozCloud provider z failed (z") and local fallback also failed ()fallback_from_cloudfallback_reasonr)rPrTrrrrrr{rcreate_sessionrrrrrr6r]rX__name__r^r RuntimeErrorr)r force_localr~rproviderrc provider_name local_errors r_get_session_infors$"###W%%% -- & & &#G,-------- &---------------(00K%&&L'FK'F*7LAA %F,W55 &((  099LL F'66w?? #c:lD+I+Ic$%aQ]%a%abbb##I..b$( #5#5L.CC U^H_D`D`.a.aL+ F F F $X 7 +!1g!  #8#A#ALL &@-@@!@@1<@@@ lD11F#' #5#5L:>L!6769!ffL!238EL!45) F, 11 & & &#G, 11111111 %1! 111111111111111 (w''' sgAA A BE H3HF"!H" G ,GG  AHH"I II"Icbtr-ttdtdtSt jd}|r|ada|St d}|rt jd|}|r|ada|Sttj j }|dz d z dz }| rt|adatSt jd }|s|rt jd |}|r d adatSdatd td) a@ Find the agent-browser CLI executable. Checks in order: current PATH, Homebrew/common bin dirs, Hermes-managed node, local node_modules/.bin/, npx fallback. Returns: Path to agent-browser executable Raises: FileNotFoundError: If agent-browser is not installed Nz7agent-browser CLI not found (cached). Install it with: zc Or run 'npm install' in the repo root to install locally. Or ensure npx is available in your PATH. agent-browserTr<)r( node_modulesz.binnpxrz.agent-browser CLI not found. Install it with: ) _agent_browser_resolvedrFileNotFoundErrorrr3whichrJr__file__parentexistsr6) which_result extended_path repo_root local_binnpx_paths r_find_agent_browserrs% (#;(**;;;  %$<00L ,"&(++M |O-HHH  $0 !&* # X%,IN*V3oEI% #I"&$$|E""H ; ;<M:::% 3"&$$#  3 " " 3 3 3  rc|sdSgd}|D]Y}tj||}|r@|dd}|r|cSZdS)zHExtract a screenshot file path from agent-browser human-readable output.N)z6Screenshot saved to ['\"](?P/[^'\"]+?\.png)['\"]z0Screenshot saved to (?P/\S+?\.png)(?:\s|$)z(?P/\S+?\.png)(?:\s|$)r(z'")researchgroupri)rcpatternsr8matchr(s r"_extract_screenshot_path_from_textrDs tH  '4((  ;;v&&,,..44U;;D  4rcommandargsrwc N|t}|pg} t}nD#t$r7}td|dt |dcYd}~Sd}~wwxYwt |r.t}td|d|dStrAts3trd}nd}td|d|dSd d l m }|rdd dS t|} nH#t$r;}td ||dd t |dcYd}~Sd}~wwxYw| dr d| dg} n d| dg} |dkrddgn|g} | | zd|gz|z} t jt'd| d} t!j| ddt+| | dtd||| t/| it j}t3|dd|d<| |d<d|vrt t4dz}||d<t j| d |}t j| d!|}t!j|t jt jzt jzd"}t!j|t jt jzt jzd"} t?j | ||t>j!|#}t!j"|t!j"|n-#t!j"|t!j"|wxYw |#|$nd#t>j$$rR|%|#td%|||| dd&|d'dcYSwxYwt7|d(5}|&}dddn #1swxYwYt7|d(5}|&}dddn #1swxYwY|j'}||fD]'} t!j(|#tR$rY$wxYw|ri|*rU|d kr tVj,n tVj-}t.|d)||*dd*|*}|s3|d kr-|t^vr$td+|dd,|d-dS|rp taj1|}|d.krp|d/r[|d0i}|d.s0|d1std2||S#t`j2$r|dd3}td4|||dd*|d5kr|pd*}d6d7||fD} tg| }!|!rFti|!5r%t6d8|!d|!|d9d:cYSdd;|d<|dcYSwxYw|d krE|r|*nd=|}"td>|||"dd?d|"dSdid:S#t$r:}td@||dAdt |dcYd}~Sd}~wwxYw)Ba Run an agent-browser CLI command using our pre-created Browserbase session. Args: task_id: Task identifier to get the right session command: The command to run (e.g., "open", "click") args: Additional arguments for the command timeout: Command timeout in seconds. ``None`` reads ``browser.command_timeout`` from config (default 30s). Returns: Parsed JSON response from agent-browser Nzagent-browser CLI not found: %sFsuccessr z%browser command blocked on Termux: %suChromium browser is missing. You're running in Docker — pull the latest image to get the bundled Chromium: docker pull ghcr.io/nousresearch/hermes-agent:latestzChromium browser is missing. Install it with: npx agent-browser install --with-deps (or: npx playwright install --with-deps chromium)zbrowser command blocked: %sr)is_interrupted Interruptedz0Failed to create browser session for task=%s: %sz"Failed to create browser session: rnz--cdpz --sessionrrrrz--jsonr&iT)modeexist_okz/browser cmd=%s task=%s socket_dir=%s (%d chars)PATHr<AGENT_BROWSER_SOCKET_DIRAGENT_BROWSER_IDLE_TIMEOUT_MSi_stdout__stderr_i)stdoutstderrstdinenvrvz9browser '%s' timed out after %ds (task=%s, socket_dir=%s)zCommand timed out after z secondsrzbrowser '%s' stderr: %sz)browser '%s' returned empty output (rc=0)zBrowser command 'z' returned no outputsnapshotrdatarefsz]snapshot returned empty content. Possible stale daemon or CDP connection issue. returncode=%sz1browser '%s' returned non-JSON output (rc=%s): %s screenshot c3K|]}||V dSrr)r@rIs r z'_run_browser_command..s;..!%t.......rzFFF 51111 3 5 51    G DD  4d;;; 4000......~: =999Z(11 ZZZI7TUVVV +XPSTUPVPV+X+XYYYYYYYYZ ""C i!89 $\.%AB .9*>*E*E*G*G  Z* (,(6'*%%   %YYYTWYY3 > ??*0^ 6^R\6^6^I NNBEEGGlK]^kKlKl $$Y/// 111!-000001sA0BB21B2 max_charsct||kr|S|d}g}d}|D]J}|t|zdz|dz krn+|||t|dzz }Kt|t|z }|dkr|d|dd|S)a{Structure-aware truncation for snapshots. Cuts at line boundaries so that accessibility tree elements are never split mid-line, and appends a note telling the agent how much was omitted. Args: snapshot_text: The snapshot text to truncate max_chars: Maximum characters to keep Returns: Truncated text with indicator if truncated rrr!Pz [... z= more lines truncated, use browser_snapshot for full content])r rCr.r-)rrlinesr`charsline remainings rrrus =Y&&    % %EF E 3t99 q 9r> 1 1 E d TQE S[[(I1}} h hhhiii 99V  rc ddl}ddlm}|j|}||s||rt jdddS|pd}t||}t|}ts6|s4ts&t|st jdddSt|}|r4t jd|d |d |d |d d dStrddlm} | ||S|rJt"d|t'r t)t'jndt-|} | dd} | rd| d<t1|t3|d|gt5t7d} |t8|<| dr$| di} | dd}| d|}tsR|sPtsB|r@||kr:t|s+t3|ddgdt jdddSd||d}gd }|t=fd!|Dr d"|d#|d$<| rId%| vrE| d%}d&|D}|d'sd(|d)<||d*< t3|d+d,g}|dr|di}|d+d}|d-i}tA|tBkrtE|}||d+<|rtA|nd|d.<n2#tF$r%}t"$d/|Yd}~nd}~wwxYwt j|d0St jd| d1d2dd0S)3a Navigate to a URL in the browser. Args: url: The URL to navigate to task_id: Task identifier for session isolation Returns: JSON string with navigation result (includes stealth features info on first nav) rN) _PREFIX_REFz_Blocked: URL contains what appears to be an API key or token. Secrets must not be sent in URLs.rrz2Blocked: URL targets a private or internal addressrhostrulesource)r r r )rr blocked_by_policy)camofox_navigatezbrowser_navigate: auto-routing %s to local Chromium sidecar (cloud provider %s stays on cloud for public URLs; set browser.auto_local_for_private_urls: false to disable)none _first_navTr<rvrrtitler<rz about:blankruz6Blocked: redirect landed on a private/internal address)rrr) z access deniedz#access to this page has been deniedblockedz bot detectedzverification requiredz please verifyzare you a robotcaptcha cloudflarezddos protectionzchecking your browserz just a momentzattention requiredc3 K|]}|vV dSrr)r@r8 title_lowers rrz#browser_navigate..s(FF'w+%FFFFFFrz Page title 'a0' suggests bot detection. The site may have blocked this request. Options: 1) Try adding delays between actions, 2) Access different pages first, 3) Enable advanced stealth (BROWSERBASE_ADVANCED_STEALTH=true, requires Scale plan), 4) Some sites have very aggressive bot detection that may be unavoidable.bot_detection_warningrvcg|] \}}|| Srr)r@kvs rrBz$browser_navigate..#s!CCCTQCqCCCrproxieszRunning WITHOUT residential proxies. Bot detection may be more aggressive. Consider upgrading Browserbase plan for proxy support.stealth_warningstealth_featuresr-cr element_countz'Auto-snapshot after navigate failed: %s ensure_asciir zNavigation failed)%rrr parseunquoterrdumpsrrrr _is_safe_urlr rtools.browser_camofoxrr^rrrXrrr_maybe_start_recordingrr[rdrryanyrr SNAPSHOT_SUMMARIZE_THRESHOLDrr]r_)rrurllibr  url_decodedeffective_task_idnav_session_keyauto_local_this_navrrr is_first_navr`rr final_urlrblocked_patternsrvactive_features snap_resultrrrrcrs @rrUrUs'''''',&&s++K !2!2;!?!? z9      ,9-.?EEO/@@     #  $%%  S!!  zI     #3''G zY'*1&/76?^efn^o!p!p     .::::::W---   I 4G4I4I UD$&& ' ' 0 0v    %_55L##L$77L0%* \"/// !/6C5#NbNdNdfhJiJi j j jF 3B./ zz)Ozz&"%%"%%HHUC(( "## ' ())  (3..|I7N7N. !&=/SU V V V V: Q       kkmm FFFF5EFFF F F \u\\\ , -  ;J,66#J/HCCX^^-=-=CCCO<< ** M*+,;H' ( G. TFSSKy)) E'OOFB77 ) j" = =  }}VR00}%%(DDD$6}$E$EM'4$9=,DCIII1) G G G LLBA F F F F F F F F Gz(7777zZZ)<==   s8B+O$$ P.PPctrddlm}||||St|pd}g}|s|dgt |d|}|drT|di}|dd}|d i} t|tkr|rt||}n't|tkrt|}d || rt| ndd } dd l m } | |} | B| } | jr'| | n2#t"$r%}t$d|Yd }~nd }~wwxYwt)j| dSt)jd|ddddS)ag Get a text-based snapshot of the current page's accessibility tree. Args: full: If True, return complete snapshot. If False, return compact view. task_id: Task identifier for session isolation user_task: The user's current task (for task-aware extraction) Returns: JSON string with page snapshot r)camofox_snapshotrr rrrr<rT)rrr!rNz$supervisor snapshot merge failed: %sFr"r zFailed to get snapshotr)rr(r7rextendrrr r+rrrrractiveupdateto_dictr]r^r_rr&)r^rrr7r.rr`rrrrr _supervisor_sv_snap_sv_excs rr]r]BsH :::::::gy999)'*>Y?? D  TF !"3Z F FF zz)#zz&"%%R00 xx## }   < < < <5mYOOMM   "> > >.}==M%*.5SYYYA   J D D D D D D-112CDDK&&//11?8OOH$4$4$6$6777 J J J LL? I I I I I I I I Jz(7777zZZ)ABB   s AF F/ F**F/cxtrddlm}|||St|pd}|dsd|}t |d|g}|drtjd|dd Stjd |d d |d d S)z Click on an element. Args: ref: Element reference (e.g., "@e5") task_id: Task identifier for session isolation Returns: JSON string with click result r) camofox_clickr@clickrT)rclickedFr"r zFailed to click r) rr(r@rr,rrrr&)rarr@r.r`s rr`r`s+777777}S'***)'*>Y?? >>#  #ii !"3Wse D DF zz) z    zZZ)AC)A)ABB   rc~trddlm}||||St|pd}|dsd|}t |d||g}|drtjd||dd Stjd |d d |d d S)z Type text into an input field. Args: ref: Element reference (e.g., "@e3") text: Text to type task_id: Task identifier for session isolation Returns: JSON string with type result r) camofox_typerrAfillrT)rtypedelementFr"r zFailed to type into r) rr(rErr,rrrr&)rarcrrEr.r`s rrbrbs0666666|Cw///)'*>Y?? >>#  #ii""3Vc4[ I IF zz) z     zZZ)E)E)EFF   rc|dvrtjdd|dddSd}tr*dd lm}d }d }t |D]}|||}|St |pd }t|d |t|g}| ds0tjd| dd|ddStjd|ddS)z Scroll the page. Args: direction: "up" or "down" task_id: Task identifier for session isolation Returns: JSON string with scroll result )rfrgFzInvalid direction 'z'. Use 'up' or 'down'.rr"rr)camofox_scrollrWNrscrollrr zFailed to scroll T)rscrolled) rr&rr(rJrDrrr6r)rer_SCROLL_PIXELSrJ_SCROLL_REPEATSr`rr.s rrdrdsc&&zL9LLL   N888888'' 8 8A#^Iw77FF )'*>Y?? !"3X 3~K^K^?_ ` `F ::i zZZ)HY)H)HII    :   rctrddlm}||St|pd}t |dg}|drC|di}t jd|dd d d St jd |d ddd S)z Navigate back in browser history. Args: task_id: Task identifier for session isolation Returns: JSON string with navigation result r) camofox_backrbackrrTrr<)rrFr"r zFailed to go backr)rr(rPrrrrr&)rrPr.r`rs rriris%666666|G$$$)'*>Y?? !"3VR @ @F zz) zz&"%%z88E2&&    zZZ)<==   rcDtrddlm}|||St|pd}t |d|g}|drt jd|dd St jd|d d |d d S) z Press a keyboard key. Args: key: Key to press (e.g., "Enter", "Tab") task_id: Task identifier for session isolation Returns: JSON string with key press result r) camofox_pressrpressrT)rpressedFr"r zFailed to press r)rr(rSrrrrr&)rkrrSr.r`s rrjrjs+777777}S'***)'*>Y?? !"3Wse D DF zz) z    zZZ)AC)A)ABB   rr rqc >|t||Strddlm}|||St |pd}|rdgng}|rdgng}t |d|}t |d|}g} |drn|d id gD]C} | | d d | d dddDg} |drY|d idgD].} | | dddd/tj d| | t| t| ddS)aaGet browser console messages and JavaScript errors, or evaluate JS in the page. When ``expression`` is provided, evaluates JavaScript in the page context (like the DevTools console) and returns the result. Otherwise returns console output (log/warn/error/info) and uncaught exceptions. Args: clear: If True, clear the message/error buffers after reading expression: JavaScript expression to evaluate in the page context task_id: Task identifier for session isolation Returns: JSON string with console messages/errors, or eval result Nr)camofox_consolerz--clearconsoleerrorsrrrrXrrcr<)rXrcr r exception)rr T)rconsole_messages js_errorstotal_messages total_errorsFr") _browser_evalrr(rWrrrr.rr&r ) r rqrrWr. console_args error_argsconsole_result errors_resultrmsgrYerrs rrprp<s Z111/999999ug...)'*>Y??"'/I;;RL %-)2J)*;Y UUN():HjQQMH)$$!%%fb1155j"EE  C OO..++#     F## $$VR0044XrBB  C MM779b11%     :$h--F      rctrt||St|pd}t|d|g}|dsb|ddt fddDrt jdd d St jdd S|d i}|d }|}t|tr2 t j |}n#t j tf$rYnwxYwt jd |t|jddtS)zKEvaluate a JavaScript expression in the page context and return the result.revalrr z eval failedc3DK|]}|vVdSr)ry)r@rres rrz _browser_eval..s0ttttsyy{{"ttttttr)zunknown commandz not supportedz not foundzno such commandFz@JavaScript evaluation is not supported by this browser backend. rrr`Trr` result_typer#r)r _camofox_evalrrrr*rr&rr6rrrrXr)rqrr.r`r raw_resultrres @rr_r_vs2Z111)'*>Y?? !"3Vj\ J JF ::i  jj-00 tttt/sttt t t : a\_aa z     ::fb ! !D(##JF*c"" Z ++FF$j1    D  :F||,3  ( ( ((s=DD+*D+c ddlm}m} ||pd}|dp|d}|d|d||dd  }t |t r|d n|}|}t |t r2 tj|}n#tj tf$rYnwxYwtj d |t|j d dt S#t$ra} t |  t fddDrtj dddcYd} ~ St! dcYd} ~ Sd} ~ wwxYw)zFEvaluate JS via Camofox's /tabs/{tab_id}/eval endpoint (if available).r) _ensure_tab_postrtab_ididz/tabs/z /evaluateuser_id)rquserId)bodyr`TriFrkc3 K|]}|vV dSrr)r@coders rrz _camofox_eval..s(CCTty CCCCCCr)404405501z|JavaScript evaluation is not supported by this Camofox server. Use browser_snapshot or browser_vision to inspect page state.rN)r)r(rorprrrr6rrrrr&rXrr]r* tool_error) rqrrorptab_inforqresprmrrcrs @rrlrls888888884;w3)44h''=8<<+=+=u/f///Z[cdm[n6o6oppp,6dD+A+AKTXXh'''t  j# & &  J//(*5    z<<0  s ,,, ,  4 4 4FF CCCC-BCCC C C : Y       )U333333333 4sOBD B54D5C D C4D E. AE) E.E)#E.)E.cbt5|tvr ddddS dddn #1swxYwY ddlm}t }|}t |ddd}|sdS|dz }|d d td tj d }|d|d|dddz }t|ddt|g}| drWt5t |dddn #1swxYwYtd||dStd| ddS#t"$r&} td| Yd} ~ dSd} ~ wwxYw)z@Start recording if browser.record_sessions is enabled in config.NrrSrUrecord_sessionsFrbrowser_recordingsTparentsrH max_age_hoursz %Y%m%d_%H%M%Ssession_rz.webmrOrOrz'Auto-recording browser session %s to %sz"Could not start auto-recording: %sr zAuto-recording setup failed: %s)rrrZrTr r mkdir_cleanup_old_recordingsrstrftimerr6raddr^rr_r]) rrTr9rarecord_enabledrecordings_dir timestamprecording_pathr`rcs rr)r)s  ) ) )  );555555%'' o i1BERRR  F$';;TD999b1111M/22 '*TY*T*T"*T*T*TT%gx'3~CVCV9WXX ::i  T 1 1#''000 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 KKA7N [ [ [ [ [ LL=vzz'?R?R S S S S S ;;; 6:::::::::;sT -113E>.BE>>D% E>%D))E>,D)-E>.E>> F.F))F.ct5|tvr ddddS dddn #1swxYwY t|ddg}|drF|didd}td||n3#t $r&}td ||Yd}~nd}~wwxYwt5t|ddddS#1swxYwYdS#t5t|dddw#1swxYwYwxYw) z1Stop recording if one is active for this session.NrOrrrr(r<z*Saved browser recording for session %s: %sz#Could not stop recording for %s: %s) rrrrr^rr]r_discard)rr`r(rcs r_maybe_stop_recordingrs?  - - -  - 1%gx&BB ::i  U::fb))--fb99D KKDgt T T T HHH :GQGGGGGGGGH 1 1  ' ' 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1] 1 1  ' ' 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1sr -11A-B'&D' C1C DCD!D  D D EE9 EE E E Ecntrddlm}||St|pd}d}t |d|g}|dr|di}|dd } t |trtj |}n|}tj d |t|d d S#tj $rtj d gdddd cYSwxYwtj d |dddd S)z Get all images on the current page. Args: task_id: Task identifier for session isolation Returns: JSON string with list of images (src and alt) r)camofox_get_imagesraJSON.stringify( [...document.images].map(img => ({ src: img.src, alt: img.alt || '', width: img.naturalWidth, height: img.naturalHeight })).filter(img => img.src && !img.src.startsWith('data:')) )rgrrr`z[]T)rimagesrzFr"zCould not parse image data)rrrzrr zFailed to get imagesr) rr(rrrrrr6rrr&r r)rrr.js_coder`rrmrs rrlrls+<<<<<<!!'***)'*>Y?? G""3VgY G GF zz)zz&"%%XXh--  #*c** $J//#: V" ### # # # # #:7  " ### # # # #zZZ)?@@   sAC*DDroc trddlm}||||Sddl}ddl}t |pd}ddlm}|dd}|d|j d z } | d d t|d g} |r| d| d| t| t|d| } | ds_| dd} t!} | dnd| d}t%jdd|d| ddS| did}|rt)|} | sJt!} | dnd| d}t%jdd| d|d ddS| }||d!}d"|}d#|d$}t3}t4d%t9|d&}d'} dd(lm}|}t?|d)d*i+}|d,}|tA|}|d-}|tA|}n#tB$rYnwxYwd*d.d/|d0d1d2|id3gd4gd5||d6}|r||d7< tEdKi|}n#tB$r}dd8l#m$}m%} m&}!||rt9||!krlt4'd9t9|d:z |!d:z | | d;<}||d=dd>d?d1d2<tEdKi|}nYd}~nd}~wwxYw|j(dj)j*pd@+}"ddAl,m-}#|#|"}"d |"pdBt| dC}$|r:| didDr| ddD|$dD<t%j|$dS#tB$r}}%t4.dE|%d FddGt|%d}&| rt| |&dH<dI|&dJ<t%j|&dcYd}%~%Sd}%~%wwxYw)La6 Take a screenshot of the current page and analyze it with vision AI. This tool captures what's visually displayed in the browser and sends it to Gemini for analysis. Useful for understanding visual content that the text-based snapshot may not capture (CAPTCHAs, verification challenges, images, complex layouts, etc.). The screenshot is saved persistently and its file path is returned alongside the analysis, so it can be shared with users via MEDIA: in the response. Args: question: What you want to know about the page visually annotate: If True, overlay numbered [N] labels on interactive elements task_id: Task identifier for session isolation Returns: JSON string with vision analysis results and screenshot_path r)camofox_visionNr)get_hermes_dirzcache/screenshotsbrowser_screenshotsbrowser_screenshot_z.pngTrrz --annotatez--fullrrr z Unknown errorrcloud (rFzFailed to take screenshot (z mode): rr"rr(z#Screenshot file was not created at z (z mode). This may indicate a socket path issue (macOS /var/folders/), a missing Chromium install ('agent-browser install'), or a stale daemon process.asciizdata:image/png;base64,zCYou are analyzing a screenshot of a web browser. User's question: a" Provide a detailed and helpful answer based on what you see in the screenshot. If there are interactive elements, describe them. If there are verification challenges or CAPTCHAs, describe what type they are and what action might be needed. Focus on answering the user's specific question.z/browser_vision: analysing screenshot (%d bytes)g^@r) load_config auxiliaryvisionrrwrrrc)rXrc image_urlr)rXrrr)rrrrrwr)_is_image_size_error_resize_image_for_vision_RESIZE_TARGET_BYTESzSVision API rejected screenshot (%.1f MB); auto-resizing to ~%.0f MB and retrying...iz image/png) mime_typerrr!r<rz$Vision analysis returned no content.)ranalysisscreenshot_path annotationszbrowser_vision failed: %srzError during vision analysis: rz\Screenshot was captured but vision analysis failed. You can still share it via MEDIA:.noter)/rr(rbase64rxrhermes_constantsrryrzr_cleanup_old_screenshotsr.r6rrrrrr&rr read_bytes b64encodedecoderjr^r_r rZrr rr]r tools.vision_toolsrrrrrrrrirrr)'rnrorrruuid_modr.rscreenshots_dirrscreenshot_argsr` error_detail_cpractual_screenshot_path_screenshot_bytes_screenshot_b64data_url vision_prompt vision_modelvision_timeoutvision_temperaturer_cfg _vision_cfg_vt_vtemprr_api_errrrrrr response_datarc error_infos' rrmrm+ s(;888888~h':::MMM)'*>Y??0/////$n%8:OPPO%(Xhnn>N>N>R(X(X(XXOQ:dT::: !CCCC  1  " "< 0 0 0x(((s?33444%      zz)$$ #!::g??L%''C!k77/O9J9J9L9L/O/O/OD: StSS\SS"### # "(FB!7!7!;!;F!C!C ! ;"#9::O%%'' #%''C!k77/O9J9J9L9L/O/O/OD: 2/22T222"### #,6688 **+<==DDWMM=O== @ ( @ @ @ )**  F*++ - - -    5 5 5 5 5 5;==D!$ XrJJJK//),,C!&s __]33F!%*6]]"    D #!'??!,E8;LMM -%    0#/K  ..+..HH             %$X.. H (<<< @MM[1(K8  43#{<<<OW J'*95a8EeL#22k22 &$Q'/7=2DDFF666666((22 J$J"?33   I 62..22=AA I+1&>-+HM- (z-e<<<<  : : : 2AEEE!&1ZRUVWRXRX1Z1Z[[  ! ! # # @,/,@,@J( )!Jv z*5999999999 :s.CB94C9B>>C C3 C..C3c|d}t|r!|g}|dtt }nM|g}|t}t5|tvr||dddn #1swxYwY|}|D]}t |t|st|ddSdS)a Clean up browser session(s) for a task. Called automatically when a task completes or when inactivity timeout is reached. Closes both the agent-browser/Browserbase session and Camofox sessions. When ``task_id`` is a bare task identifier (no ``::local`` suffix), reaps BOTH the cloud/primary session AND any hybrid-routing local sidecar that may have been spawned for LAN/localhost URLs in the same task. When ``task_id`` already carries a ``::local`` suffix (called from the inactivity cleanup loop against a specific session key), reaps only that one. Args: task_id: Task identifier (or explicit session key) Nr) rr rrrr._cleanup_single_browser_sessionrpop)r session_keys bare_task_id sidecar_keyrs rrr s5 W%% y 4#m"4"4!445 y  1-11  1 1...##K000 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 #55 ' 4444 ! ) )9 $$\48888899s A55A9<A9c t|trS ddlm}m}||s ||n3#t $r&}t d||Yd}~nd}~wwxYwt d|t dtt t5t |}dddn #1swxYwY|r| dd}t d ||t| t|d gd t d |n3#t $r&}t d||Yd}~nd}~wwxYwt5t|dt"|ddddn #1swxYwY|rYt%}|I ||n2#t $r%}t d|Yd}~nd}~wwxYw| dd}|rbt(jt/d|}t(j|rt(j||d} t(j| r t5t7| } t)j| t>j t d| |n>#tBtDtFtHf$rt d|YnwxYwtKj&|dt d|dSt d|dS)zAInternal: reap a single browser session by its exact session key.r) camofox_closecamofox_soft_cleanupzCamofox cleanup for task %s: %sNz&cleanup_browser called for task_id: %szActive sessions: %sruunknownz+Found session for task %s: bb_session_id=%srNrurvz1agent-browser close command completed for task %sz*agent-browser close failed for task %s: %sz)Could not close cloud browser session: %srr<r&r'zKilled daemon pid %s for %sz?Could not kill daemon pid for %s (already dead or inaccessible)Tr(z$Removed task %s from active sessionsz'No active session found for task_id: %s)'rrr(rrr]r^r_r7rkeysrrrrrrrr close_sessionr'r(r-rrr.r\rr/rir0r5r6r1rr2r/r3r4) rrrrcrrurrrr@rAs rrr7 s!!! H H Q Q Q Q Q Q Q Q''00 ' g&&& H H H LL:GQ G G G G G G G G H LL97CCC LL&-=-B-B-D-D(E(EFFF 55'++G44 555555555555555/I$(()DD  BG][[[ g&&& U '2r B B B B LLLg V V V V U U U NNGRS T T T T T T T T U 6 6  $ / / / " & &w 5 5 5 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6  S*,,H#S**=9999 SSSNN#NPQRRRRRRRRS$'';;  >&9&;&;=\l=\=\]]Jw~~j)) >7<< |4I4I4IJJ7>>(++vv%(h)A)A)C)C)I)I)K)K%L%L  FN;;; %BJP\]]]]. OWUvvv %fhtuuuuuv j==== ;WEEEEE >HHHHHs|> A.A))A.C99C=C= .E88 F(F##F(27G55G9<G9H)) I3IIA;N8N=<N=cVt5tt}dddn #1swxYwY|D]}t | ddlm}|n#t$rYnwxYwda da t da dadadS)zX Clean up all active browser sessions. Useful for cleanup on shutdown. NrrF)rr7rrrrrstop_allr]rrr4 cache_clearrQrX_cached_chromium_installed)task_idsrrs rr r  s 11(--//00111111111111111!!     @@@@@@$$&&&&      !# ,,..." %!%s';??A66 BBrcg}tjdd}|r|dkr||tjd}|tj|ddtj dkr5|tj|dd dtj d krstjd p tj|d d }|tj|d|S)uDirectories to scan for a Chromium / headless-shell build. Order mirrors what agent-browser and Playwright actually probe: 1. ``PLAYWRIGHT_BROWSERS_PATH`` when set (Docker image sets this to ``/opt/hermes/.playwright``). 2. ``~/.cache/ms-playwright`` — Playwright's default on Linux/macOS. 3. ``~/Library/Caches/ms-playwright`` — Playwright's default on macOS. 4. ``%USERPROFILE%\AppData\Local\ms-playwright`` — Playwright's default on Windows. PLAYWRIGHT_BROWSERS_PATHr<0~z.cachez ms-playwrightrLibraryCacheswin32 LOCALAPPDATAAppDataLocal) r'rrrir.r( expanduserr-rr)rootsenv_pathhomers r_chromium_search_rootsr s Ez~~8"==CCEEHHOO X 7  c " "D LLdHo>>??? |x RW\\$ 8_MMNNN |w ~.. "',, )W3 3   RW\\%99::: LrcBttStD]}|rtj|s$ tj|}n#t $rYFwxYw|D]2}|ds|drdadS3dadS)aReturn True when a usable Chromium (or headless-shell) build is on disk. agent-browser (0.26+) downloads Playwright's chromium / headless-shell builds into ``PLAYWRIGHT_BROWSERS_PATH`` and won't start without them. When the CLI is present but no browser build is, the first browser tool call hangs for the full command timeout (often ~30s each) before surfacing a useless error. Guarding the tool behind this check prevents advertising a capability that will fail at runtime. Nz chromium-zchromium_headless_shell-TF)rrr'r(r)r+r/r,)rootentriesr2s rrr s"-))&(( 27==..   j&&GG    H   E ,, 0@0@*11 .2*ttt   "' 5sA A$#A$ctjdrdS tdd5}d|vcdddS#1swxYwYdS#t $rYdSwxYw)zABest-effort detection of whether we're inside a Docker container.z /.dockerenvTz/proc/1/cgrouprtdockerNF)r'r(rrrr/)fps rrr s w~~m$$t "D ) ) )Rrwwyy( ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) uus4A#A A#AA#AA## A10A1ctrdS t}n#t$rYdSwxYwt|rdSt }||St sdSdS)a Check if browser tool requirements are met. In **local mode** (no cloud provider configured): the ``agent-browser`` CLI must be findable *and* a Chromium build must be installed on disk. In **cloud mode** (Browserbase, Browser Use, or Firecrawl): the CLI and the provider's required credentials must be present. The cloud provider hosts its own Chromium, so no local browser binary is needed. Returns: True if all requirements are met, False otherwise TF)rrrrrrr)rrs rcheck_browser_requirementsr st)++ uu-[99u#$$H%%'''  u 4s ! //__main__u🌐 Browser Tool Modulez(========================================rrrz Mode: u✅ All requirements metu❌ Missing requirements:z@ - bare npx fallback found (insufficient on Termux local mode)z Install: z& - Chromium browser binary not foundz, z(no candidate paths)z Searched: u\ Docker: pull the latest image — the current one predates the bundled Chromium installz; docker pull ghcr.io/nousresearch/hermes-agent:latestz Install it with:z, npx agent-browser install --with-depsz5 Or: npx playwright install --with-deps chromiumz - agent-browser CLI not foundz - z credentials not configuredzL Tip: set browser.cloud_provider to 'local' to use free local mode insteadu 📋 Available Browser Tools:u 🔹 rJz: rYrz...u 💡 Usage:zC from tools.browser_tool import browser_navigate, browser_snapshotzE result = browser_navigate('https://example.com', task_id='my_task')z0 snapshot = browser_snapshot(task_id='my_task'))registryr{c i|] }|d| S)rJr)r@ss r r\ sBBBqy!BBBrrUc rt|dd|dS)Nrr<r)rr)rUrrkws rrrb s2/DHHUB4G4GQSQWQWXaQbQbcccru🌐)rJtoolsetschemahandlercheck_fnemojic t|dd|d|dS)Nr^Frr)r^rr)r]rrs rrrj sG/ XXfe $ $bffY.?.?266R]K^K^ ` ` `ru📸c rt|dd|dS)Nrar<r)rar)r`rrs rrrs .}%1D1DbffU^N_N_```ru👆c t|dd|dd|dS)Nrar<rcr)rarcr)rbrrs rrr{ sC|0C0C$((SY[]J^J^hjhnhnoxhyhyzzzru⌨️c rt|dd|dS)Nrergr)rer)rdrrs rrr s1~f8U8U_a_e_efo_p_pqqqru📜c Ht|dSNrr)rirrs rrr s|BFF94E4EFFFru◀️c rt|dd|dS)Nrkr<r)rkr)rjrrs rrr rrc Ht|dSr )rlrrs rrr s1"&&:K:KLLLru🖼️c t|dd|dd|dS)Nrnr<roFr)rnror)rmrrs rrr sg~txx B7O7OZ^ZbZbcmotZuZu@B@F@FGP@Q@Q R R Rru👁️c t|dd|d|dS)Nr Frqr)r rqr)rprrs rrr s`TXXgu5M5MZ^ZbZbcoZpZpz|{A{ABK{L{L M M Mru🖥️)r<r)NN)rM)FNN)FN)r)r)r#N)__doc__atexit functoolsrrr'rr5rr3rrrMrrtypingrrrrrpathlibragent.auxiliary_clientr rr utilsr rZr tools.website_policyr r]tools.url_safetyrr'tools.browser_providers.baser#tools.browser_providers.browserbaser#tools.browser_providers.browser_user!tools.browser_providers.firecrawlrtools.tool_backend_helpersrr(rr ImportError getLoggerrr^r8rDr- _SANE_PATH lru_cacher*r6r4r7r;rJrKrr__annotations__rYr+ frozensetrPrQr\rXrdrjrmrrrrrrrXrrrrrrrrrrrrrrrrrrrrrrrrrrErrrrrrrrrKrCLockrrregisterrr"r rFrPrRrTBROWSER_TOOL_SCHEMASr{rrrrrrrrUr]r`rbrdrirjrpr_rlr)rrlrmrrrrr rrrrrprintrrrrsearchedrrrtools.registryrr{_BROWSER_SCHEMA_MAPrrrr)s000d     33333333333333++++++,,,,,,!!!!!!%%%%%%,9999999,,,++,%<<<<<<<%%%$$LLL%======CCCCCCBBBBBB??????GGGGGG %IIIIIII%%%$}%  8 $ $ Z___ - - QeCHo ,Vd3iVVVV 6 6s 6C 6 6 6 657c5j!1666 $!* 7H*= > >I>>>)-#---!c2C8C=CCCC Hx}HHHH .3.3....b38!?5e#4!?!?!?!?H- C- D- - - - `]#]$]]]]'%"''DdO :>!56=== $-1HTN111'+x}+++)"X&:;)")")")"XA@@@@@OsOOOO hshthhhhs))))) ?4 ? ? ? ?).%,0#T000/d////:888888v'S's's''''</s/t//// :s :s : : : :&T&&&&2!S!!!!4/1$sDcN*+000355S ,.$sCx.---  &)S8TV[)\)\%]%]",.S%Z(---   #:#:#:X/000TTT8((C(D(((($uZuZuZp6 p p p (((6c6666,---#N $#Y      #Z%$V$     k$#b      E%#Z %#D     &!x$!6N#8%     }   k$#_      %M  !s%#~ &$$T  $   ("j&$#U %$]    ASt 3 4S>      s tCH~    ``x}`S#X````HESEEEEPSXc]0! a3a3 a3 a3 s)a3c] a3  #s(^ a3a3a3a3L $515151}51 51515151pccSFgg#g gggggV!#@@ @ c]@}@ @@@@F  s Xc] c    F##c##x}#####L,,c,HSM,S,,,,^(3-3<sXc]cB7747Xc]7T\]`Ta7mp7777t%(%(c%(HSM%(S%(%(%(%(P44c4HSM4S4444D;C;;;;@131111"77 77777tr:r:Sr:Dr:8C=r:\_r:r:r:r:jGGGG0FFFF,&9&9Xc]&9d&9&9&9&9RIISIITIIIIIIIIX&&&&F.2HTN111S 8TDD*D****b z E $%%% E(OOO    Ck77'G1B1B1D1D'G'G'GD E d  "!##b ()))) )*** >--//K44[AA SXYYY@'<'<'>'>@@AAAA%8%8%:%:>???99%;%;%=%=>>XBX222333%%'' SE@EWXXXXE1222EHIIIEQRRR  > > > E4 5 5 5 E<#8#8#:#:<< = = = = = > ?3#4#4#6#6? EJ#++--JJJ K K K E` a a a E +,,,&KK IvII&*?*DIIIJJJJ E/ E OPPP E QRRR E <=== 0///////BB-ABBB   1 2 c c '     1 2 ` ` '     / ` ` '     ~ . z z '     / 0 q q '     ~ . F F '      / ` ` '     3 4 L L '     / 0 R R '     0 1 M M '  sI)A00A;:A;?BBB3B::CC6B=Z44&[[