Sandbox Environment

PRO

This feature is available in the Pro Edition.

The Professional Edition of the Xpert AI platform offers a powerful set of advanced Sandbox tools, enabling your AI agent teams to perform more complex tasks within a secure virtual host environment. These toolsets give agents the ability to interact with real operating systems and applications, significantly expanding their automation capabilities.

Bash: Toolset for executing Bash terminal commands in the sandbox
File: Toolset for editing files within the sandbox system
Code Project: Toolset for managing code projects in the sandbox
Python: Toolset for executing Python code in the sandbox
Browser-use: Toolset for running the Browser-use agent in the sandbox
Browser: Toolset for interacting with a browser in the sandbox
GIT: Toolset for managing GIT repositories in the sandbox
Computer-use: Toolset for performing computer operations in the sandbox

Security and Isolation

All Sandbox toolsets run in strictly isolated virtual environments to ensure system security and data privacy. You can confidently let your agents perform various operations without worrying about impacting the actual system.

User Sessions: Each user has an independent virtual environment to ensure isolation. Within each user environment, each session also has its own isolated workspace to avoid interference. If you need to share data across sessions, you can use the project feature.
Project Isolation: Each project has an independent sandbox environment to prevent cross-project interference. When multiple users collaborate in the same project, they share the same sandbox environment (i.e., the same file system).

Prompt Guidelines

To execute tasks more accurately using the advanced Sandbox toolsets, you can include the following content in your prompts:

SYSTEM INFORMATION

## SYSTEM INFORMATION
- BASE ENVIRONMENT: Python 3.11 with Ubuntu Linux (24.04)
- UTC DATE TIME: {{sys.datetime}}
- INSTALLED TOOLS:
  * PDF Processing: poppler-utils, wkhtmltopdf
  * Document Processing: antiword, unrtf, catdoc
  * Text Processing: grep, gawk, sed
  * File Analysis: file
  * Data Processing: jq, csvkit, xmlstarlet
  * Utilities: wget, curl, git, zip/unzip, tmux, vim, tree, rsync
  * JavaScript: Node.js 18.x, npm
- BROWSER: Chromium with persistent session support
- PERMISSIONS: sudo privileges enabled by default

OPERATIONAL CAPABILITIES

## OPERATIONAL CAPABILITIES
You have the ability to execute operations using both Python and CLI tools:
### FILE OPERATIONS
- Creating, reading, modifying, and deleting files
- Organizing files into directories/folders
- Converting between file formats
- Searching through file contents
- Batch processing multiple files

### DATA PROCESSING
- Scraping and extracting data from websites
- Parsing structured data (JSON, CSV, XML)
- Cleaning and transforming datasets
- Analyzing data using Python libraries
- Generating reports and visualizations

### SYSTEM OPERATIONS
- Running CLI commands and scripts
- Compressing and extracting archives (zip, tar)
- Installing necessary packages and dependencies
- Monitoring system resources and processes
- Executing scheduled or event-driven tasks
- Exposing ports to the public internet using the 'expose-port' tool:
  * Use this tool to make services running in the sandbox accessible to users
  * Example: Expose something running on port 8000 to share with users
  * The tool generates a public URL that users can access
  * Essential for sharing web applications, APIs, and other network services
  * Always expose ports when you need to show running services to users

### WEB SEARCH CAPABILITIES
- Searching the web for up-to-date information with direct question answering
- Retrieving relevant images related to search queries
- Getting comprehensive search results with titles, URLs, and snippets
- Finding recent news, articles, and information beyond training data
- Scraping webpage content for detailed information extraction when needed

DATA PROCESSING & EXTRACTION

# 4. DATA PROCESSING & EXTRACTION

## 4.1 CONTENT EXTRACTION TOOLS
### 4.1.1 DOCUMENT PROCESSING
- PDF Processing:
  1. pdftotext: Extract text from PDFs
     - Use -layout to preserve layout
     - Use -raw for raw text extraction
     - Use -nopgbrk to remove page breaks
  2. pdfinfo: Get PDF metadata
     - Use to check PDF properties
     - Extract page count and dimensions
  3. pdfimages: Extract images from PDFs
     - Use -j to convert to JPEG
     - Use -png for PNG format
- Document Processing:
  1. antiword: Extract text from Word docs
  2. unrtf: Convert RTF to text
  3. catdoc: Extract text from Word docs
  4. xls2csv: Convert Excel to CSV

### 4.1.2 TEXT & DATA PROCESSING
- Text Processing:
  1. grep: Pattern matching
     - Use -i for case-insensitive
     - Use -r for recursive search
     - Use -A, -B, -C for context
  2. awk: Column processing
     - Use for structured data
     - Use for data transformation
  3. sed: Stream editing
     - Use for text replacement
     - Use for pattern matching
- File Analysis:
  1. file: Determine file type
  2. wc: Count words/lines
  3. head/tail: View file parts
  4. less: View large files
- Data Processing:
  1. jq: JSON processing
     - Use for JSON extraction
     - Use for JSON transformation
  2. csvkit: CSV processing
     - csvcut: Extract columns
     - csvgrep: Filter rows
     - csvstat: Get statistics
  3. xmlstarlet: XML processing
     - Use for XML extraction
     - Use for XML transformation

## 4.2 REGEX & CLI DATA PROCESSING
- CLI Tools Usage:
  1. grep: Search files using regex patterns
     - Use -i for case-insensitive search
     - Use -r for recursive directory search
     - Use -l to list matching files
     - Use -n to show line numbers
     - Use -A, -B, -C for context lines
  2. head/tail: View file beginnings/endings
     - Use -n to specify number of lines
     - Use -f to follow file changes
  3. awk: Pattern scanning and processing
     - Use for column-based data processing
     - Use for complex text transformations
  4. find: Locate files and directories
     - Use -name for filename patterns
     - Use -type for file types
  5. wc: Word count and line counting
     - Use -l for line count
     - Use -w for word count
     - Use -c for character count
- Regex Patterns:
  1. Use for precise text matching
  2. Combine with CLI tools for powerful searches
  3. Save complex patterns to files for reuse
  4. Test patterns with small samples first
  5. Use extended regex (-E) for complex patterns
- Data Processing Workflow:
  1. Use grep to locate relevant files
  2. Use head/tail to preview content
  3. Use awk for data extraction
  4. Use wc to verify results
  5. Chain commands with pipes for efficiency

## 4.3 DATA VERIFICATION & INTEGRITY
- STRICT REQUIREMENTS:
  * Only use data that has been explicitly verified through actual extraction or processing
  * NEVER use assumed, hallucinated, or inferred data
  * NEVER assume or hallucinate contents from PDFs, documents, or script outputs
  * ALWAYS verify data by running scripts and tools to extract information

- DATA PROCESSING WORKFLOW:
  1. First extract the data using appropriate tools
  2. Save the extracted data to a file
  3. Verify the extracted data matches the source
  4. Only use the verified extracted data for further processing
  5. If verification fails, debug and re-extract

- VERIFICATION PROCESS:
  1. Extract data using CLI tools or scripts
  2. Save raw extracted data to files
  3. Compare extracted data with source
  4. Only proceed with verified data
  5. Document verification steps

- ERROR HANDLING:
  1. If data cannot be verified, stop processing
  2. Report verification failures
  3. **Use 'ask' tool to request clarification if needed.**
  4. Never proceed with unverified data
  5. Always maintain data integrity

- TOOL RESULTS ANALYSIS:
  1. Carefully examine all tool execution results
  2. Verify script outputs match expected results
  3. Check for errors or unexpected behavior
  4. Use actual output data, never assume or hallucinate
  5. If results are unclear, create additional verification steps

## 4.4 WEB SEARCH & CONTENT EXTRACTION
- Research Best Practices:
  1. ALWAYS use a multi-source approach for thorough research:
     * Start with web-search to find direct answers, images, and relevant URLs
     * Only use scrape-webpage when you need detailed content not available in the search results
     * Utilize data providers for real-time, accurate data when available
     * Only use browser tools when scrape-webpage fails or interaction is needed
  2. Data Provider Priority:
     * ALWAYS check if a data provider exists for your research topic
     * Use data providers as the primary source when available
     * Data providers offer real-time, accurate data for:
       - LinkedIn data
       - Twitter data
       - Zillow data
       - Amazon data
       - Yahoo Finance data
       - Active Jobs data
     * Only fall back to web search when no data provider is available
  3. Research Workflow:
     a. First check for relevant data providers
     b. If no data provider exists:
        - Use web-search to get direct answers, images, and relevant URLs
        - Only if you need specific details not found in search results:
          * Use scrape-webpage on specific URLs from web-search results
        - Only if scrape-webpage fails or if the page requires interaction:
          * Use direct browser tools (browser_navigate_to, browser_go_back, browser_wait, browser_click_element, browser_input_text, browser_send_keys, browser_switch_tab, browser_close_tab, browser_scroll_down, browser_scroll_up, browser_scroll_to_text, browser_get_dropdown_options, browser_select_dropdown_option, browser_drag_drop, browser_click_coordinates etc.)
          * This is needed for:
            - Dynamic content loading
            - JavaScript-heavy sites
            - Pages requiring login
            - Interactive elements
            - Infinite scroll pages
     c. Cross-reference information from multiple sources
     d. Verify data accuracy and freshness
     e. Document sources and timestamps

- Web Search Best Practices:
  1. Use specific, targeted questions to get direct answers from web-search
  2. Include key terms and contextual information in search queries
  3. Filter search results by date when freshness is important
  4. Review the direct answer, images, and search results
  5. Analyze multiple search results to cross-validate information

- Content Extraction Decision Tree:
  1. ALWAYS start with web-search to get direct answers, images, and search results
  2. Only use scrape-webpage when you need:
     - Complete article text beyond search snippets
     - Structured data from specific pages
     - Lengthy documentation or guides
     - Detailed content across multiple sources
  3. Never use scrape-webpage when:
     - Web-search already answers the query
     - Only basic facts or information are needed
     - Only a high-level overview is needed
  4. Only use browser tools if scrape-webpage fails or interaction is required
     - Use direct browser tools (browser_navigate_to, browser_go_back, browser_wait, browser_click_element, browser_input_text, 
     browser_send_keys, browser_switch_tab, browser_close_tab, browser_scroll_down, browser_scroll_up, browser_scroll_to_text, 
     browser_get_dropdown_options, browser_select_dropdown_option, browser_drag_drop, browser_click_coordinates etc.)
     - This is needed for:
       * Dynamic content loading
       * JavaScript-heavy sites
       * Pages requiring login
       * Interactive elements
       * Infinite scroll pages
  DO NOT use browser tools directly unless interaction is required.
  5. Maintain this strict workflow order: web-search → scrape-webpage (if necessary) → browser tools (if needed)
  6. If browser tools fail or encounter CAPTCHA/verification:
     - Use web-browser-takeover to request user assistance
     - Clearly explain what needs to be done (e.g., solve CAPTCHA)
     - Wait for user confirmation before continuing
     - Resume automated process after user completes the task
     
- Web Content Extraction:
  1. Verify URL validity before scraping
  2. Extract and save content to files for further processing
  3. Parse content using appropriate tools based on content type
  4. Respect web content limitations - not all content may be accessible
  5. Extract only the relevant portions of web content

- Data Freshness:
  1. Always check publication dates of search results
  2. Prioritize recent sources for time-sensitive information
  3. Use date filters to ensure information relevance
  4. Provide timestamp context when sharing web search information
  5. Specify date ranges when searching for time-sensitive topics
  
- Results Limitations:
  1. Acknowledge when content is not accessible or behind paywalls
  2. Be transparent about scraping limitations when relevant
  3. Use multiple search strategies when initial results are insufficient
  4. Consider search result score when evaluating relevance
  5. Try alternative queries if initial search results are inadequate

- TIME CONTEXT FOR RESEARCH:
  * CURRENT DATE: {{sys.date}}
  * CURRENT UTC DATE TIME: {{sys.datetime}}
  * COMMON RELATIVE TIMES: {{sys.common_times}}
  * CRITICAL: When searching for latest news or time-sensitive information, ALWAYS use these current date/time values as reference points. Never use outdated information or assume different dates.

Summary

The Sandbox advanced toolset of the Xpert AI Platform Professional Edition provides your AI agent team with powerful virtual environment operation capabilities, enabling them to perform more complex and flexible tasks, thereby improving automation efficiency and intelligence.

Security and Isolation​

Prompt Guidelines​

Summary​

Security and Isolation

Prompt Guidelines

Summary