{ "cells": [ { "cell_type": "markdown", "id": "dfd434e5", "metadata": {}, "source": [ "# Finding the Cheapest Airbnb with AI-Powered Web Automation\n", "\n", "This notebook demonstrates how to build an intelligent web automation agent that searches Airbnb, extracts prices, and finds the cheapest listing in Stockholm. You'll learn how to integrate **Playwright** with **Browser-Use** for powerful AI-driven automation.\n", "\n", "## What You'll Learn:\n", "1. **Playwright + Browser-Use Integration**: Combining browser management with AI automation\n", "2. **Vision-Based Price Extraction**: Let AI \"see\" and read prices from web pages\n", "3. **Structured Data Extraction**: Extract listing data with type-safe Pydantic models\n", "4. **Price Comparison Logic**: Find the cheapest option from multiple listings\n", "5. **Real-world Application**: Practical price comparison automation\n", "\n", "## Prerequisites:\n", "- Azure OpenAI deployment configured\n", "- Playwright installed (`pip install playwright`)\n", "- Understanding of async Python\n", "- Basic web automation concepts" ] }, { "cell_type": "markdown", "id": "6340fa32", "metadata": {}, "source": [ "## Understanding the Playwright + Browser-Use Architecture\n", "\n", "This notebook uses the **official Playwright integration** pattern from Browser-Use documentation.\n", "\n", "### Architecture Flow:\n", "```\n", "┌──────────────────┐\n", "│ Playwright │ ◄─── Manages browser lifecycle\n", "│ Browser Manager │ Handles CDP connection\n", "└────────┬─────────┘ Provides browser instance\n", " │\n", " │ playwright_browser parameter\n", " ▼\n", "┌──────────────────┐\n", "│ Browser-Use │ ◄─── AI-powered automation\n", "│ Browser Object │ Wraps Playwright browser\n", "└────────┬─────────┘ Provides Agent interface\n", " │\n", " │ uses\n", " ▼\n", "┌──────────────────┐\n", "│ Agent │ ◄─── Vision + Decision Making\n", "│ (with LLM) │ Structured output extraction\n", "└──────────────────┘ Natural language tasks\n", " │\n", " │ powered by\n", " ▼\n", "┌──────────────────┐\n", "│ Azure OpenAI │ ◄─── GPT-4 Vision\n", "│ (LLM + Vision) │ Analyzes screenshots\n", "└──────────────────┘ Extracts structured data\n", "```\n", "\n", "### Why This Approach?\n", "\n", "**Playwright provides:**\n", "- ✅ Robust browser lifecycle management\n", "- ✅ Full Chrome DevTools Protocol control\n", "- ✅ Stable page and context handling\n", "- ✅ Built-in waiting and synchronization\n", "\n", "**Browser-Use adds:**\n", "- ✅ AI-powered element finding (no CSS selectors needed!)\n", "- ✅ Vision-based page understanding\n", "- ✅ Structured output extraction with Pydantic\n", "- ✅ Natural language task execution\n", "\n", "**Together they enable:**\n", "- 🎯 \"Search for Stockholm Airbnb\" → Agent navigates\n", "- 👁️ Vision reads all prices on the page\n", "- 📊 Structured extraction → clean Python objects\n", "- 💰 Price comparison logic → find cheapest\n", "\n", "### Our Task Flow:\n", "1. **Playwright** launches Chrome browser\n", "2. **Browser-Use Agent** navigates to Airbnb.com\n", "3. **Agent searches** for \"Stockholm, Sweden\"\n", "4. **Vision model** reads and extracts all listing prices\n", "5. **Structured output** returns typed data (Pydantic models)\n", "6. **Python code** compares prices and finds cheapest\n", "7. **Display results** with rich formatting" ] }, { "cell_type": "code", "execution_count": null, "id": "e1449801", "metadata": {}, "outputs": [], "source": [ "%pip install browser_use langchain-openai playwright " ] }, { "cell_type": "code", "execution_count": 2, "id": "290efc2a", "metadata": {}, "outputs": [], "source": [ "!playwright install chromium" ] }, { "cell_type": "code", "execution_count": 12, "id": "ed8648b4", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "✅ All packages imported successfully\n" ] } ], "source": [ "import asyncio\n", "import os\n", "import re\n", "from typing import Optional, List\n", "from IPython.display import display, HTML, Markdown\n", "from dotenv import load_dotenv\n", "\n", "# Playwright imports\n", "from playwright.async_api import async_playwright\n", "\n", "# Browser-Use imports - USE BROWSER-USE'S AZURE OPENAI!\n", "# Changed from langchain_openai\n", "from browser_use import Agent, Browser, ChatAzureOpenAI\n", "from pydantic import BaseModel, Field\n", "\n", "print(\"✅ All packages imported successfully\")" ] }, { "cell_type": "code", "execution_count": 4, "id": "26f7e392", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "✅ Azure OpenAI Configuration:\n", " Endpoint: https://foundry-aiteam2510.cognitiveservices.azure.com/\n", " Deployment: gpt-5-mini\n", " API Version: 2024-12-01-preview\n" ] } ], "source": [ "# Load environment variables\n", "load_dotenv()\n", "\n", "# Azure OpenAI Configuration\n", "azure_openai_deployment = os.getenv(\"AZURE_OPENAI_CHAT_DEPLOYMENT_NAME\")\n", "azure_openai_endpoint = os.getenv(\"AZURE_OPENAI_ENDPOINT\")\n", "azure_openai_api_key = os.getenv(\"AZURE_OPENAI_API_KEY\")\n", "api_version = os.getenv(\"AZURE_OPENAI_API_VERSION\")\n", "\n", "# Verify configuration\n", "print(\"✅ Azure OpenAI Configuration:\")\n", "print(f\" Endpoint: {azure_openai_endpoint}\")\n", "print(f\" Deployment: {azure_openai_deployment}\")\n", "print(f\" API Version: {api_version}\")" ] }, { "cell_type": "markdown", "id": "70b80842", "metadata": {}, "source": [ "## Initialize Azure OpenAI LLM\n", "\n", "The LLM powers the Agent's decision-making and vision capabilities. We use:\n", "- **Temperature: 0.3** for consistent, predictable automation\n", "- **Vision capabilities** to \"see\" and understand page content\n", "- **Structured output** to extract data into Pydantic models" ] }, { "cell_type": "code", "execution_count": null, "id": "8ce29377", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "✅ LLM initialized successfully\n", " Model: gpt-5-mini\n", " Endpoint: https://foundry-aiteam2510.cognitiveservices.azure.com/\n", " Integration: Browser-Use ChatAzureOpenAI\n" ] } ], "source": [ "# Initialize Azure OpenAI with Browser-Use's ChatAzureOpenAI\n", "llm = ChatAzureOpenAI(\n", " # Your deployment name (e.g., 'gpt-5-mini')\n", " model=azure_openai_deployment,\n", " # Browser-Use reads these from environment variables automatically:\n", " # AZURE_OPENAI_ENDPOINT\n", " # AZURE_OPENAI_API_KEY\n", " # AZURE_OPENAI_API_VERSION (optional, defaults to latest)\n", ")\n", "\n", "print(\"✅ LLM initialized successfully\")\n", "print(f\" Model: {azure_openai_deployment}\")\n", "print(f\" Endpoint: {azure_openai_endpoint}\")\n", "print(f\" Integration: Browser-Use ChatAzureOpenAI\")" ] }, { "cell_type": "markdown", "id": "846bf74e", "metadata": {}, "source": [ "## Define Structured Output Models\n", "\n", "We use Pydantic models to extract structured data from Airbnb search results. The Agent will use GPT-4 Vision to read the page and extract data into these models automatically.\n", "\n", "This ensures type safety and validation of all extracted data." ] }, { "cell_type": "code", "execution_count": 26, "id": "5ff0e177", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "✅ Structured output models defined\n", " AirbnbListing: Individual listing data with clickable URLs\n", " SearchResult: Complete search results with price analysis\n" ] } ], "source": [ "# UPDATE THIS CELL - Add URL field to AirbnbListing\n", "class AirbnbListing(BaseModel):\n", " \"\"\"Single Airbnb listing with price information\"\"\"\n", " title: str = Field(description=\"Name/title of the listing\")\n", " price_per_night: float = Field(\n", " description=\"Price per night as a number (extract just the numeric value, ignore currency symbols)\")\n", " currency: str = Field(\n", " default=\"SEK\", description=\"Currency code (SEK for Swedish Krona)\")\n", " rating: Optional[float] = Field(\n", " default=None, description=\"Rating score if visible\")\n", " url: Optional[str] = Field(\n", " default=None, description=\"Full URL link to the listing page\") # ✅ NEW!\n", "\n", "\n", "class SearchResult(BaseModel):\n", " \"\"\"Complete search results from Airbnb\"\"\"\n", " location: str = Field(description=\"Search location (Stockholm, Sweden)\")\n", " total_listings_found: int = Field(\n", " description=\"Number of listings found on the page\")\n", " listings: List[AirbnbListing] = Field(\n", " description=\"List of all listings with prices extracted from the page\")\n", " cheapest_listing: AirbnbListing = Field(\n", " description=\"The listing with the lowest price per night\")\n", " average_price: float = Field(\n", " description=\"Average price per night across all listings\")\n", " price_range: str = Field(description=\"Price range as 'min - max SEK'\")\n", "\n", "\n", "print(\"✅ Structured output models defined\")\n", "print(\" AirbnbListing: Individual listing data with clickable URLs\")\n", "print(\" SearchResult: Complete search results with price analysis\")" ] }, { "cell_type": "markdown", "id": "c50e9241", "metadata": {}, "source": [ "## Helper Functions for Display\n", "\n", "These functions provide rich, educational output in the notebook with formatted HTML." ] }, { "cell_type": "markdown", "id": "61e58afe", "metadata": {}, "source": [] }, { "cell_type": "code", "execution_count": 27, "id": "86977630", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "✅ Structured output models defined\n", " ListingInfo: Extract listing details\n", " BookingDates: Capture selected dates\n", " BookingResult: Final booking status\n" ] } ], "source": [ "class ListingInfo(BaseModel):\n", " \"\"\"Information about the Airbnb listing\"\"\"\n", " title: str = Field(description=\"The name/title of the listing\")\n", " location: str = Field(description=\"City and country of the listing\")\n", " price_per_night: Optional[str] = Field(\n", " description=\"Price per night if visible\")\n", " rating: Optional[str] = Field(description=\"Rating score if visible\")\n", "\n", "\n", "class BookingDates(BaseModel):\n", " \"\"\"Selected booking dates\"\"\"\n", " check_in: str = Field(\n", " description=\"Check-in date in format: Month DD, YYYY\")\n", " check_out: str = Field(\n", " description=\"Check-out date in format: Month DD, YYYY\")\n", " nights: int = Field(description=\"Number of nights\")\n", "\n", "\n", "class BookingResult(BaseModel):\n", " \"\"\"Complete booking result information\"\"\"\n", " success: bool = Field(description=\"Whether the booking flow was completed\")\n", " listing_info: Optional[ListingInfo] = Field(\n", " description=\"Details about the listing\")\n", " booking_dates: Optional[BookingDates] = Field(description=\"Selected dates\")\n", " total_price: Optional[str] = Field(description=\"Total price if shown\")\n", " message: str = Field(description=\"Status message or error description\")\n", "\n", "\n", "print(\"✅ Structured output models defined\")\n", "print(\" ListingInfo: Extract listing details\")\n", "print(\" BookingDates: Capture selected dates\")\n", "print(\" BookingResult: Final booking status\")" ] }, { "cell_type": "markdown", "id": "cd44b2e8", "metadata": {}, "source": [ "## Helper Functions for Display\n", "\n", "These functions provide rich, educational output in the notebook." ] }, { "cell_type": "code", "execution_count": 28, "id": "cc83f640", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "✅ Helper functions loaded\n" ] } ], "source": [ "def display_step(step_number: int, title: str, description: str, color: str = \"#2E8B57\"):\n", " \"\"\"Display a workflow step with formatting\"\"\"\n", " html = f\"\"\"\n", "
\n", "

\n", " Step {step_number}: {title}\n", "

\n", "

{description}

\n", "
\n", " \"\"\"\n", " display(HTML(html))\n", "\n", "\n", "def display_action(action_type: str, details: str, emoji: str = \"⚙️\"):\n", " \"\"\"Display an action being performed\"\"\"\n", " html = f\"\"\"\n", "
\n", " {emoji} {action_type}:\n", " {details}\n", "
\n", " \"\"\"\n", " display(HTML(html))\n", "\n", "\n", "def display_result(success: bool, message: str):\n", " \"\"\"Display a result with success/failure indication\"\"\"\n", " color = \"#28a745\" if success else \"#dc3545\"\n", " emoji = \"✅\" if success else \"❌\"\n", " html = f\"\"\"\n", "
\n", " {emoji} {message}\n", "
\n", " \"\"\"\n", " display(HTML(html))\n", "\n", "\n", "def display_screenshot(screenshot_base64: str, caption: str = \"\"):\n", " \"\"\"Display a screenshot in the notebook\"\"\"\n", " html = f\"\"\"\n", "
\n", " \n", " {f\"

{caption}

\" if caption else \"\"}\n", "
\n", " \"\"\"\n", " display(HTML(html))\n", "\n", "\n", "print(\"✅ Helper functions loaded\")" ] }, { "cell_type": "markdown", "id": "2267dd74", "metadata": {}, "source": [ "## The Airbnb Booking Agent Class\n", "\n", "This class orchestrates the entire booking workflow, combining Agent and Actor approaches strategically." ] }, { "cell_type": "code", "execution_count": 29, "id": "9eb624c3", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "✅ AirbnbSearchAgent class defined\n", " Integration: Playwright browser + Browser-Use Agent\n", " Capabilities: Vision-based price extraction with structured output\n" ] } ], "source": [ "class AirbnbSearchAgent:\n", " \"\"\"\n", " Intelligent Airbnb search agent using Playwright + Browser-Use integration.\n", " \n", " This agent:\n", " 1. Navigates to Airbnb.com\n", " 2. Searches for listings in Stockholm\n", " 3. Extracts all visible prices using AI vision\n", " 4. Compares prices and finds the cheapest listing\n", " \"\"\"\n", " \n", " def __init__(self, llm, playwright_browser):\n", " self.llm = llm\n", " # Browser-Use wraps the Playwright browser\n", " # Reference: https://docs.browser-use.com/examples/templates/playwright-integration\n", " self.browser = Browser(playwright_browser=playwright_browser)\n", " \n", " async def take_screenshot(self, caption: str = \"\"):\n", " \"\"\"Take and display a screenshot of current page\"\"\"\n", " try:\n", " page = await self.browser.get_current_page()\n", " screenshot_base64 = await page.screenshot(format='png')\n", " display_screenshot(screenshot_base64, caption)\n", " except Exception as e:\n", " print(f\"⚠️ Could not capture screenshot: {str(e)}\")\n", " \n", " async def search_stockholm(self) -> SearchResult:\n", " \"\"\"\n", " Main workflow: Search Airbnb for Stockholm and find cheapest listing.\n", " \n", " Returns:\n", " SearchResult: Structured data with all listings and price analysis\n", " \"\"\"\n", " \n", " # Step 1: Navigate and search\n", " display_step(\n", " 1, \n", " \"Navigate & Search (AI Agent)\", \n", " \"Using AI agent with vision to navigate Airbnb and search for Stockholm listings. \"\n", " \"The agent will handle pop-ups, cookie banners, and search automatically.\"\n", " )\n", " \n", " try:\n", " # Agent navigates to Airbnb and searches\n", " search_agent = Agent(\n", " task=(\n", " \"Navigate to https://www.airbnb.com. \"\n", " \"Close any pop-ups, cookie banners, or login prompts if they appear. \"\n", " \"Search for 'Stockholm, Sweden' in the search box. \"\n", " \"Wait for the search results page to fully load with listing cards visible.\"\n", " ),\n", " llm=self.llm,\n", " browser=self.browser,\n", " use_vision=True # Critical: enables screenshot analysis\n", " )\n", " \n", " display_action(\"Agent\", \"Navigating to Airbnb and searching for Stockholm...\")\n", " await search_agent.run()\n", " \n", " # Wait for results to load\n", " await asyncio.sleep(3)\n", " await self.take_screenshot(\"Search results page loaded\")\n", " \n", " display_result(True, \"Successfully loaded Stockholm search results\")\n", " \n", " except Exception as e:\n", " display_result(False, f\"Search failed: {str(e)}\")\n", " raise\n", " \n", " # Step 2: Extract prices with vision\n", " display_step(\n", " 2,\n", " \"Extract Prices (Vision + LLM)\",\n", " \"Using GPT-4 Vision to read all listing prices from the page and extract \"\n", " \"structured data into Pydantic models. The AI 'sees' the page like a human.\"\n", " )\n", " \n", " try:\n", " page = await self.browser.get_current_page()\n", " \n", " display_action(\"Vision\", \"AI is analyzing the page and reading prices...\")\n", " \n", " # Use page.extract_content with structured output\n", " # Reference: https://docs.browser-use.com/customize/actor/all-parameters\n", " # This uses LLM to parse the visible page content\n", " extraction_prompt = \"\"\"\n", " Extract ALL Airbnb listings visible on this page.\n", " \n", " For each listing, extract:\n", " - Title/name of the property\n", " - Price per night (numeric value only, without currency symbols)\n", " - Currency (SEK for Swedish Krona)\n", " - Rating if visible\n", " \n", " After extracting all listings:\n", " - Identify which listing has the LOWEST price\n", " - Calculate the average price across all listings\n", " - Determine the price range (min to max)\n", " \n", " Focus on the listing cards on the search results page.\n", " Only include listings where you can clearly see the price.\n", " \"\"\"\n", " \n", " # Extract structured data using LLM vision\n", " search_results = await page.extract_content(\n", " prompt=extraction_prompt,\n", " structured_output=SearchResult,\n", " llm=self.llm\n", " )\n", " \n", " display_action(\n", " \"Extracted\", \n", " f\"Found {search_results.total_listings_found} listings with prices\"\n", " )\n", " \n", " # Display some sample prices\n", " if len(search_results.listings) > 0:\n", " sample_prices = [f\"{l.price_per_night:.0f} SEK\" for l in search_results.listings[:5]]\n", " display_action(\n", " \"Sample Prices\", \n", " f\"{', '.join(sample_prices)}{'...' if len(search_results.listings) > 5 else ''}\"\n", " )\n", " \n", " display_result(True, \"Price extraction completed successfully\")\n", " \n", " return search_results\n", " \n", " except Exception as e:\n", " display_result(False, f\"Price extraction failed: {str(e)}\")\n", " raise\n", "\n", "print(\"✅ AirbnbSearchAgent class defined\")\n", "print(\" Integration: Playwright browser + Browser-Use Agent\")\n", "print(\" Capabilities: Vision-based price extraction with structured output\")" ] }, { "cell_type": "markdown", "id": "f097a3de", "metadata": {}, "source": [ "## Execute the Search\n", "\n", "Now let's run the complete workflow and find the cheapest Airbnb in Stockholm!\n", "\n", "This will:\n", "1. Launch a real Chrome browser (visible)\n", "2. Use AI to navigate and search\n", "3. Extract all prices using vision\n", "4. Display the cheapest option" ] }, { "cell_type": "code", "execution_count": 34, "id": "75fcdd98", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "✅ AirbnbSearchAgent class defined\n", " Integration: CDP-based connection for Playwright + Browser-Use\n", " Capabilities: Vision-based price extraction with structured output\n", " Browser Mode: keep_alive=True (prevents auto-close)\n" ] } ], "source": [ "# UPDATED AirbnbSearchAgent class - Add keep_alive parameter\n", "class AirbnbSearchAgent:\n", " \"\"\"\n", " Intelligent Airbnb search agent using Browser-Use integration via CDP.\n", " \n", " This agent:\n", " 1. Connects to Chrome via CDP (Chrome DevTools Protocol)\n", " 2. Both Playwright and Browser-Use share the same browser instance\n", " 3. Searches for listings in Stockholm\n", " 4. Extracts prices using AI vision\n", " 5. Finds the cheapest listing\n", " \"\"\"\n", "\n", " def __init__(self, llm, cdp_url: str):\n", " \"\"\"\n", " Initialize agent with LLM and CDP connection.\n", " \n", " Args:\n", " llm: Language model for AI decisions\n", " cdp_url: Chrome DevTools Protocol URL (e.g., 'http://localhost:9222')\n", " \"\"\"\n", " self.llm = llm\n", " # Browser-Use connects to Chrome via CDP\n", " # IMPORTANT: keep_alive=True prevents browser from closing after Agent completes\n", " self.browser = Browser(\n", " cdp_url=cdp_url,\n", " keep_alive=True # ✅ This keeps the browser open!\n", " )\n", "\n", " async def take_screenshot(self, caption: str = \"\"):\n", " \"\"\"Take and display a screenshot of current page\"\"\"\n", " try:\n", " # Get pages and use the active one\n", " pages = await self.browser.get_pages()\n", " if not pages:\n", " print(\"⚠️ No pages available for screenshot\")\n", " return\n", "\n", " page = pages[0] # Use first page (active page)\n", " screenshot_bytes = await page.screenshot()\n", " import base64\n", " screenshot_base64 = base64.b64encode(screenshot_bytes).decode()\n", " display_screenshot(screenshot_base64, caption)\n", " except Exception as e:\n", " print(f\"⚠️ Could not capture screenshot: {str(e)}\")\n", "\n", " async def search_stockholm(self) -> SearchResult:\n", " \"\"\"\n", " Main workflow: Search Airbnb for Stockholm and find cheapest listing.\n", " \n", " Returns:\n", " SearchResult: Structured data with all listings and price analysis\n", " \"\"\"\n", "\n", " # Step 1: Navigate and search\n", " display_step(\n", " 1,\n", " \"Navigate & Search (AI Agent)\",\n", " \"Using AI agent with vision to navigate Airbnb and search for Stockholm listings. \"\n", " \"The agent will handle pop-ups, cookie banners, and search automatically.\"\n", " )\n", "\n", " try:\n", " # Agent navigates to Airbnb and searches\n", " search_agent = Agent(\n", " task=(\n", " \"Navigate to https://www.airbnb.com. \"\n", " \"Close any pop-ups, cookie banners, or login prompts if they appear. \"\n", " \"Search for 'Stockholm, Sweden' in the search box. \"\n", " \"Wait for the search results page to fully load with listing cards visible.\"\n", " ),\n", " llm=self.llm,\n", " browser=self.browser,\n", " use_vision=True # Critical: enables screenshot analysis\n", " )\n", "\n", " display_action(\n", " \"Agent\", \"Navigating to Airbnb and searching for Stockholm...\")\n", " await search_agent.run()\n", "\n", " # Wait for results to load\n", " await asyncio.sleep(3)\n", " await self.take_screenshot(\"Search results page loaded\")\n", "\n", " display_result(\n", " True, \"Successfully loaded Stockholm search results\")\n", "\n", " except Exception as e:\n", " display_result(False, f\"Search failed: {str(e)}\")\n", " raise\n", "\n", " # Step 2: Extract prices with vision\n", " display_step(\n", " 2,\n", " \"Extract Prices (Vision + LLM)\",\n", " \"Using GPT-4 Vision to read all listing prices from the page and extract \"\n", " \"structured data into Pydantic models. The AI 'sees' the page like a human.\"\n", " )\n", "\n", " try:\n", " # Get the pages created by the Agent\n", " pages = await self.browser.get_pages()\n", "\n", " if not pages:\n", " raise RuntimeError(\n", " \"No pages available after Agent run. Browser might have closed.\")\n", "\n", " # Use the first (active) page\n", " page = pages[0]\n", "\n", " display_action(\n", " \"Vision\", \"AI is analyzing the page and reading prices...\")\n", "\n", " # Extract structured data using LLM vision\n", " extraction_prompt = \"\"\"\n", "Extract ALL Airbnb Home listings visible on this page. DO NOT include \"Experiences\" or other non-home listings.\n", "\n", "For each listing, extract:\n", "- Title/name of the property\n", "- Price per night (numeric value only, without currency symbols)\n", "- Currency (SEK for Swedish Krona)\n", "- Rating if visible\n", "- URL: The full link to the listing detail page (should start with https://www.airbnb.com/rooms/)\n", "\n", "After extracting all listings:\n", "- Identify which listing has the LOWEST price\n", "- Calculate the average price across all listings\n", "- Determine the price range (min to max)\n", "\n", "Focus on the listing cards on the search results page.\n", "Only include listings where you can clearly see the price.\n", "IMPORTANT: Extract the actual URL/link for each listing so users can click on it.\n", "\"\"\"\n", "\n", " search_results = await page.extract_content(\n", " prompt=extraction_prompt,\n", " structured_output=SearchResult,\n", " llm=self.llm\n", " )\n", "\n", " display_action(\n", " \"Extracted\",\n", " f\"Found {search_results.total_listings_found} listings with prices\"\n", " )\n", "\n", " # Display some sample prices\n", " if len(search_results.listings) > 0:\n", " sample_prices = [\n", " f\"{l.price_per_night:.0f} SEK\" for l in search_results.listings[:5]]\n", " display_action(\n", " \"Sample Prices\",\n", " f\"{', '.join(sample_prices)}{'...' if len(search_results.listings) > 5 else ''}\"\n", " )\n", "\n", " display_result(True, \"Price extraction completed successfully\")\n", "\n", " return search_results\n", "\n", " except Exception as e:\n", " display_result(False, f\"Price extraction failed: {str(e)}\")\n", " raise\n", "\n", "\n", "print(\"✅ AirbnbSearchAgent class defined\")\n", "print(\" Integration: CDP-based connection for Playwright + Browser-Use\")\n", "print(\" Capabilities: Vision-based price extraction with structured output\")\n", "print(\" Browser Mode: keep_alive=True (prevents auto-close)\")" ] }, { "cell_type": "code", "execution_count": 35, "id": "2ea963e7", "metadata": {}, "outputs": [ { "data": { "text/html": [ "\n", "
\n", "

🏠 Find the Cheapest Airbnb in Stockholm

\n", "

\n", " This demo uses CDP (Chrome DevTools Protocol) integration:
\n", " • Chrome runs with remote debugging enabled
\n", " • Playwright connects to Chrome via CDP
\n", " • Browser-Use connects to same Chrome via CDP
\n", " • GPT-4 Vision reads and extracts prices
\n", " • Structured Output returns type-safe data\n", "

\n", "

\n", " 📊 Watch the browser as the AI agent searches and analyzes prices!\n", "

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", " ⚙️ Chrome:\n", " Starting Chrome with CDP (remote debugging)...\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "✅ Chrome started with CDP on port 9222\n" ] }, { "data": { "text/html": [ "\n", "
\n", " ⚙️ Playwright:\n", " Connecting Playwright to Chrome via CDP...\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", " ✅ Playwright connected successfully\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", " ⚙️ Browser-Use:\n", " Creating Browser-Use agent with CDP connection...\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", " ✅ Agent initialized with CDP integration\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "

\n", " Step 1: Navigate & Search (AI Agent)\n", "

\n", "

Using AI agent with vision to navigate Airbnb and search for Stockholm listings. The agent will handle pop-ups, cookie banners, and search automatically.

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "INFO [Agent] 🔗 Found URL in task: https://www.airbnb.com, adding as initial action...\n" ] }, { "data": { "text/html": [ "\n", "
\n", " ⚙️ Agent:\n", " Navigating to Airbnb and searching for Stockholm...\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "INFO [Agent] \u001b[34m🚀 Task: Navigate to https://www.airbnb.com. Close any pop-ups, cookie banners, or login prompts if they appear. Search for 'Stockholm, Sweden' in the search box. Wait for the search results page to fully load with listing cards visible.\u001b[0m\n", "INFO [service] ────────────────────────────────────────\n", "INFO [service] 🔐 To view this run in Browser Use Cloud, authenticate with:\n", "INFO [service] 👉 browser-use auth\n", "INFO [service] or: python -m browser_use.cli auth\n", "INFO [service] ────────────────────────────────────────\n", "\n", "INFO [Agent] 🦾 \u001b[34m[ACTION 1/1]\u001b[0m go_to_url: url: https://www.airbnb.com, new_tab: False\n", "INFO [tools] 🔗 Navigated to https://www.airbnb.com\n", "INFO [Agent] \n", "\n", "INFO [Agent] 📍 Step 1:\n", "ERROR [Agent] ❌ Result failed 1/4 times:\n", " LLM call timed out after 60 seconds. Keep your thinking and output short.\n", "INFO [Agent] \n", "\n", "INFO [Agent] 📍 Step 2:\n", "INFO [Agent] \u001b[32m👍 Eval: Successfully loaded Airbnb homepage and identified the search input box for destination.\u001b[0m\n", "INFO [Agent] \u001b[34m🎯 Next goal: Input 'Stockholm, Sweden' into the destination search box and click the search button to load results.\u001b[0m\n", "INFO [Agent] 🦾 \u001b[34m[ACTION 1/2]\u001b[0m input_text: index: 27, text: Stockholm, Sweden, clear_existing: True\n", "WARNING [BrowserSession] ⚠️ Some framework events may have failed to trigger\n", "INFO [BrowserSession] ⌨️ Typed \"Stockholm, Sweden\" into element with index 27\n", "INFO [service] Page changed after action: actions click_element_by_index are not yet executed\n", "INFO [Agent] \n", "\n", "INFO [Agent] 📍 Step 3:\n", "INFO [Agent] \u001b[32m👍 Eval: Successfully input 'Stockholm, Sweden' into the destination search box but did not yet click the search button to load results.\u001b[0m\n", "INFO [Agent] \u001b[34m🎯 Next goal: Click the search button to perform the search and wait for the listings page to load with visible listing cards.\u001b[0m\n", "INFO [Agent] 🦾 \u001b[34m[ACTION 1/1]\u001b[0m click_element_by_index: index: 34, while_holding_ctrl: False\n", "INFO [tools] 🖱️ Clicked element\n", "INFO [Agent] \n", "\n", "INFO [Agent] 📍 Step 4:\n", "INFO [Agent] \u001b[32m👍 Eval: Successfully clicked the search button and loaded the Airbnb search results page with visible listing cards for Stockholm.\u001b[0m\n", "INFO [Agent] \u001b[34m🎯 Next goal: Confirm no pop-ups or cookie banners are present and finalize task as completed since listings are visible.\u001b[0m\n", "INFO [Agent] 🦾 \u001b[34m[ACTION 1/1]\u001b[0m done: text: I have navigated to Airbnb.com, searched for Stockholm, Sweden, and confirmed that the search results page is fully loa\n", "INFO [Agent] \n", "📄 \u001b[32m Final Result:\u001b[0m \n", "I have navigated to Airbnb.com, searched for 'Stockholm, Sweden', and confirmed that the search results page is fully loaded with listing cards visible. There were no pop-ups or cookie banners to close. Task completed successfully.\n", "\n", "\n", "INFO [Agent] ✅ Task completed successfully\n", "⚠️ Could not capture screenshot: a bytes-like object is required, not 'str'\n" ] }, { "data": { "text/html": [ "\n", "
\n", " ✅ Successfully loaded Stockholm search results\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "

\n", " Step 2: Extract Prices (Vision + LLM)\n", "

\n", "

Using GPT-4 Vision to read all listing prices from the page and extract structured data into Pydantic models. The AI 'sees' the page like a human.

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", " ⚙️ Vision:\n", " AI is analyzing the page and reading prices...\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", " ⚙️ Extracted:\n", " Found 18 listings with prices\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", " ⚙️ Sample Prices:\n", " 1066 SEK, 294 SEK, 294 SEK, 1008 SEK, 368 SEK...\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", " ✅ Price extraction completed successfully\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "
" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "

📊 Search Results

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "

📈 Price Analysis

\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Location:Stockholm, Sweden
Total Listings Found:18
Average Price:572.72 SEK/night
Price Range:257 - 1066 SEK
\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "

\n", " 🏆 CHEAPEST AIRBNB IN STOCKHOLM\n", "

\n", "
\n", "

Room in Nacka

\n", "

\n", " 257.00 SEK/night\n", "

\n", "

⭐ Rating: 4.84/5.0

\n", "

\n", " 💰 Saves you 315.72 SEK compared to average price!\n", "

\n", " \n", " \n", " 🔗 View Listing on Airbnb\n", " \n", " \n", "
\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "

📋 All Listings Found (Click to View)

\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
RankListingPrice/NightRatingLink
🏆 1Room in Nacka...\n", " 257.00 SEK\n", " \n", " ⭐ 4.84\n", " \n", " 🔗 View\n", "
2Shared hotel room in Stockholms kommun...\n", " 258.00 SEK\n", " \n", " ⭐ 4.42\n", " \n", " 🔗 View\n", "
3Shared room in Stockholms kommun...\n", " 274.00 SEK\n", " \n", " ⭐ 4.68\n", " \n", " 🔗 View\n", "
4Shared hotel room in Stockholms kommun...\n", " 282.00 SEK\n", " \n", " ⭐ 4.6\n", " \n", " 🔗 View\n", "
5Shared room in Stockholms kommun...\n", " 294.00 SEK\n", " \n", " ⭐ 4.76\n", " \n", " 🔗 View\n", "
6Shared hotel room in Stockholms kommun...\n", " 294.00 SEK\n", " \n", " ⭐ 4.62\n", " \n", " 🔗 View\n", "
7Room in Stockholms kommun...\n", " 317.00 SEK\n", " \n", " ⭐ 4.93\n", " \n", " 🔗 View\n", "
8Shared hotel room in Stockholms kommun...\n", " 352.00 SEK\n", " \n", " N/A\n", " \n", " 🔗 View\n", "
9Room in Stockholms kommun...\n", " 353.00 SEK\n", " \n", " ⭐ 5.0\n", " \n", " 🔗 View\n", "
10Rooms in Enskede - Årsta - Vantör...\n", " 365.00 SEK\n", " \n", " ⭐ 4.76\n", " \n", " 🔗 View\n", "
11Hostel in Norrmalm...\n", " 368.00 SEK\n", " \n", " ⭐ 4.46\n", " \n", " 🔗 View\n", "
12Room in Helenelund...\n", " 383.00 SEK\n", " \n", " ⭐ 4.87\n", " \n", " 🔗 View\n", "
13Apartment in Sjöberg...\n", " 851.00 SEK\n", " \n", " ⭐ 4.29\n", " \n", " 🔗 View\n", "
14Apartment in Solna kommun...\n", " 929.00 SEK\n", " \n", " ⭐ 4.89\n", " \n", " 🔗 View\n", "
15Apartment in Stockholms kommun...\n", " 939.00 SEK\n", " \n", " N/A\n", " \n", " 🔗 View\n", "
16Apartment in Stockholms kommun...\n", " 966.00 SEK\n", " \n", " ⭐ 4.37\n", " \n", " 🔗 View\n", "
17Apartment in Stockholms kommun...\n", " 1008.00 SEK\n", " \n", " ⭐ 4.79\n", " \n", " 🔗 View\n", "
18Apartment in Stockholms kommun...\n", " 1066.00 SEK\n", " \n", " ⭐ 4.77\n", " \n", " 🔗 View\n", "
\n", "

\n", " 💡 Tip: Click on any listing title or the \"View\" button to open it in a new tab\n", "

\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", " ✅ Price comparison completed successfully!\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", " ⚙️ Cleanup:\n", " Closing browser and cleaning up...\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "WARNING [cdp_use.client] WebSocket connection closed: no close frame received or sent\n" ] }, { "data": { "text/html": [ "\n", "
\n", " ✅ Cleanup complete\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "text/html": [ "\n", "
\n", "

🎓 What You Just Learned

\n", "
    \n", "
  • CDP Integration: Chrome DevTools Protocol connects Playwright + Browser-Use
    • \n", "
  • Vision-Based Extraction: GPT-4 Vision reads prices like a human
    • \n", "
  • Structured Output: Type-safe data extraction with Pydantic models
    • \n", "
  • Price Comparison: Automated analysis to find best deals
    • \n", "
  • Clickable URLs: Direct links to Airbnb listings for easy viewing
    • \n", "
  • Real-World Application: Practical web scraping for price monitoring
    • \n", "
\n", "
\n", " " ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "import subprocess\n", "import tempfile\n", "\n", "\n", "async def start_chrome_with_cdp(port: int = 9222):\n", " \"\"\"\n", " Start Chrome with CDP (Chrome DevTools Protocol) enabled.\n", " Returns the Chrome process.\n", " \"\"\"\n", " # Create temporary directory for Chrome user data\n", " user_data_dir = tempfile.mkdtemp(prefix='chrome_cdp_')\n", "\n", " # Chrome paths for different platforms\n", " chrome_paths = [\n", " '/Applications/Google Chrome.app/Contents/MacOS/Google Chrome', # macOS\n", " '/usr/bin/google-chrome', # Linux\n", " '/usr/bin/chromium-browser', # Linux Chromium\n", " 'chrome', # Windows/PATH\n", " 'chromium', # Generic\n", " ]\n", "\n", " chrome_exe = None\n", " for path in chrome_paths:\n", " if os.path.exists(path) or path in ['chrome', 'chromium']:\n", " try:\n", " test_proc = await asyncio.create_subprocess_exec(\n", " path, '--version',\n", " stdout=subprocess.DEVNULL,\n", " stderr=subprocess.DEVNULL\n", " )\n", " await test_proc.wait()\n", " chrome_exe = path\n", " break\n", " except Exception:\n", " continue\n", "\n", " if not chrome_exe:\n", " raise RuntimeError(\n", " '❌ Chrome not found. Please install Chrome or Chromium.')\n", "\n", " # Chrome command arguments\n", " cmd = [\n", " chrome_exe,\n", " f'--remote-debugging-port={port}',\n", " f'--user-data-dir={user_data_dir}',\n", " '--no-first-run',\n", " '--no-default-browser-check',\n", " 'about:blank',\n", " ]\n", "\n", " # Start Chrome process\n", " process = await asyncio.create_subprocess_exec(\n", " *cmd,\n", " stdout=subprocess.DEVNULL,\n", " stderr=subprocess.DEVNULL\n", " )\n", "\n", " # Wait for Chrome to start and CDP to be ready\n", " import aiohttp\n", " cdp_ready = False\n", " for _ in range(20): # 20 second timeout\n", " try:\n", " async with aiohttp.ClientSession() as session:\n", " async with session.get(\n", " f'http://localhost:{port}/json/version',\n", " timeout=aiohttp.ClientTimeout(total=1)\n", " ) as response:\n", " if response.status == 200:\n", " cdp_ready = True\n", " break\n", " except Exception:\n", " pass\n", " await asyncio.sleep(1)\n", "\n", " if not cdp_ready:\n", " process.terminate()\n", " raise RuntimeError('❌ Chrome failed to start with CDP')\n", "\n", " print(f\"✅ Chrome started with CDP on port {port}\")\n", " return process\n", "\n", "\n", "async def main():\n", " \"\"\"\n", " Main execution function for Airbnb price comparison.\n", " \n", " Uses CDP to connect both Playwright and Browser-Use to the same Chrome instance.\n", " \"\"\"\n", "\n", " display(HTML(\"\"\"\n", "
\n", "

🏠 Find the Cheapest Airbnb in Stockholm

\n", "

\n", " This demo uses CDP (Chrome DevTools Protocol) integration:
\n", " • Chrome runs with remote debugging enabled
\n", " • Playwright connects to Chrome via CDP
\n", " • Browser-Use connects to same Chrome via CDP
\n", " • GPT-4 Vision reads and extracts prices
\n", " • Structured Output returns type-safe data\n", "

\n", "

\n", " 📊 Watch the browser as the AI agent searches and analyzes prices!\n", "

\n", "
\n", " \"\"\"))\n", "\n", " chrome_process = None\n", " playwright_browser = None\n", "\n", " try:\n", " # Step 1: Start Chrome with CDP\n", " display_action(\n", " \"Chrome\", \"Starting Chrome with CDP (remote debugging)...\")\n", " chrome_process = await start_chrome_with_cdp(port=9222)\n", " cdp_url = 'http://localhost:9222'\n", "\n", " # Step 2: Connect Playwright to CDP (optional - for custom Playwright actions)\n", " display_action(\n", " \"Playwright\", \"Connecting Playwright to Chrome via CDP...\")\n", " playwright = await async_playwright().start()\n", " playwright_browser = await playwright.chromium.connect_over_cdp(cdp_url)\n", " display_result(True, \"Playwright connected successfully\")\n", "\n", " # Step 3: Create Browser-Use agent with CDP connection\n", " display_action(\n", " \"Browser-Use\", \"Creating Browser-Use agent with CDP connection...\")\n", " agent = AirbnbSearchAgent(llm=llm, cdp_url=cdp_url)\n", " display_result(True, \"Agent initialized with CDP integration\")\n", "\n", " # Step 4: Search and extract prices\n", " result = await agent.search_stockholm()\n", "\n", " # Step 5: Display results\n", " display(\n", " HTML(\"
\"))\n", "\n", " display(HTML(\"\"\"\n", "
\n", "

📊 Search Results

\n", "
\n", " \"\"\"))\n", "\n", " # Display summary stats\n", " display(HTML(f\"\"\"\n", "
\n", "

📈 Price Analysis

\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Location:{result.location}
Total Listings Found:{result.total_listings_found}
Average Price:{result.average_price:.2f} SEK/night
Price Range:{result.price_range}
\n", "
\n", " \"\"\"))\n", "\n", " # Display the CHEAPEST listing with clickable link\n", " cheapest = result.cheapest_listing\n", "\n", " # Create View Listing button if URL exists\n", " view_button = \"\"\n", " if cheapest.url:\n", " view_button = f\"\"\"\n", " \n", " 🔗 View Listing on Airbnb\n", " \n", " \"\"\"\n", "\n", " display(HTML(f\"\"\"\n", "
\n", "

\n", " 🏆 CHEAPEST AIRBNB IN STOCKHOLM\n", "

\n", "
\n", "

{cheapest.title}

\n", "

\n", " {cheapest.price_per_night:.2f} {cheapest.currency}/night\n", "

\n", " {f\"

⭐ Rating: {cheapest.rating}/5.0

\" if cheapest.rating else \"\"}\n", "

\n", " 💰 Saves you {(result.average_price - cheapest.price_per_night):.2f} SEK compared to average price!\n", "

\n", " {view_button}\n", "
\n", "
\n", " \"\"\"))\n", "\n", " # Display all listings in a clickable table\n", " if len(result.listings) > 1:\n", " listings_html = \"\"\"\n", "
\n", "

📋 All Listings Found (Click to View)

\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \"\"\"\n", "\n", " sorted_listings = sorted(\n", " result.listings, key=lambda x: x.price_per_night)\n", "\n", " for idx, listing in enumerate(sorted_listings, 1):\n", " is_cheapest = listing.price_per_night == cheapest.price_per_night\n", " row_style = \"background: #fff3cd;\" if is_cheapest else \"\"\n", " badge = \"🏆 \" if is_cheapest else \"\"\n", "\n", " # Create clickable link if URL exists\n", " if listing.url:\n", " link_html = f'🔗 View'\n", " title_html = f'{listing.title[:50]}...'\n", " else:\n", " link_html = 'N/A'\n", " title_html = f'{listing.title[:50]}...'\n", "\n", " listings_html += f\"\"\"\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \"\"\"\n", "\n", " listings_html += \"\"\"\n", " \n", "
RankListingPrice/NightRatingLink
{badge}{idx}{title_html}\n", " {listing.price_per_night:.2f} {listing.currency}\n", " \n", " {f\"⭐ {listing.rating}\" if listing.rating else \"N/A\"}\n", " \n", " {link_html}\n", "
\n", "

\n", " 💡 Tip: Click on any listing title or the \"View\" button to open it in a new tab\n", "

\n", "
\n", " \"\"\"\n", "\n", " display(HTML(listings_html))\n", "\n", " display_result(True, \"Price comparison completed successfully!\")\n", "\n", " except Exception as e:\n", " display_result(False, f\"Error during search: {str(e)}\")\n", " import traceback\n", " print(traceback.format_exc())\n", "\n", " finally:\n", " # Cleanup\n", " display_action(\"Cleanup\", \"Closing browser and cleaning up...\")\n", "\n", " if playwright_browser:\n", " await playwright_browser.close()\n", "\n", " if chrome_process:\n", " chrome_process.terminate()\n", " try:\n", " await asyncio.wait_for(chrome_process.wait(), 5)\n", " except TimeoutError:\n", " chrome_process.kill()\n", "\n", " display_result(True, \"Cleanup complete\")\n", "\n", " # Display educational summary\n", " display(HTML(\"\"\"\n", "
\n", "

🎓 What You Just Learned

\n", "
    \n", "
  • CDP Integration: Chrome DevTools Protocol connects Playwright + Browser-Use
    • \n", "
  • Vision-Based Extraction: GPT-4 Vision reads prices like a human
    • \n", "
  • Structured Output: Type-safe data extraction with Pydantic models
    • \n", "
  • Price Comparison: Automated analysis to find best deals
    • \n", "
  • Clickable URLs: Direct links to Airbnb listings for easy viewing
    • \n", "
  • Real-World Application: Practical web scraping for price monitoring
    • \n", "
\n", "
\n", " \"\"\"))\n", "\n", "# Run the demo\n", "await main()" ] }, { "cell_type": "code", "execution_count": null, "id": "644c431e", "metadata": {}, "outputs": [], "source": [] }, { "cell_type": "markdown", "id": "1ef2945b", "metadata": {}, "source": [ "## Key Takeaways and Best Practices\n", "\n", "### When to Use Agent vs Actor\n", "\n", "| Scenario | Use Agent | Use Actor |\n", "|----------|-----------|-----------|\n", "| **Dynamic layouts** | ✅ AI adapts to changes | ❌ CSS selectors break |\n", "| **Known structure** | ❌ Slower than direct control | ✅ Fast and precise |\n", "| **Finding elements** | ✅ Natural language queries | ❌ Need exact selectors |\n", "| **Timing control** | ❌ Less predictable | ✅ Full timing control |\n", "| **Complex workflows** | ✅ Handles unexpected UI | ❌ Requires explicit code |\n", "\n", "### Browser-Use Best Practices\n", "\n", "1. **Start with Agent for exploration**: Let AI navigate complex sites first\n", "2. **Switch to Actor for precision**: Use CSS selectors for predictable elements\n", "3. **Always handle errors**: Websites change—build fallback strategies\n", "4. **Use structured output**: Pydantic models ensure type-safe data\n", "5. **Add delays strategically**: Use `asyncio.sleep()` after actions that trigger changes\n", "6. **Take screenshots**: Visual debugging is invaluable\n", "7. **Combine approaches**: Hybrid workflows leverage strengths of both paradigms\n", "\n", "### Real-World Applications\n", "\n", "- **Travel Booking**: Monitor prices, auto-book deals, compare options\n", "- **E-commerce**: Track inventory, compare prices, automated purchasing\n", "- **Data Collection**: Scrape dynamic sites, extract structured data\n", "- **Testing**: Automated UI testing with vision-based verification\n", "- **Monitoring**: Check website changes, alert on specific conditions\n", "- **Form Automation**: Fill complex multi-step forms intelligently" ] } ], "metadata": { "kernelspec": { "display_name": ".venv (3.12.11)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.12.11" } }, "nbformat": 4, "nbformat_minor": 5 }