Chrome

解锁浏览器支持两种专用的浏览器环境，其中一种是 Chrome。了解如何开始使用。

Unblocking Browser Chrome 环境提供在专用服务器上运行并使用住宅代理进行连接的高性能远程浏览器。这些浏览器环境速度快、稳定且高度可配置。它们可以作为本地浏览器基础设施的即插即用替代方案。

主要特性

快速且稳定的性能
任意代理国家选择
兼容 Chrome DevTools Protocol (CDP)

连接详情

使用以下 WebSocket 端点连接到 UBC：

wss://ubc.oxylabs.io

基本用法

from playwright.sync_api import sync_playwright

username = "your-username"
password = "your-password"
endpoint = "ubc.oxylabs.io"
browser_url = f"wss://{username}:{password}@{endpoint}"

with sync_playwright() as p:
    browser = p.chromium.connect_over_cdp(browser_url)
    page = browser.new_page()
    page.goto('https://example.com')
    browser.close()

import { chromium } from 'playwright';

(async () => {
    const username = 'your-username';
    const password = 'your-password';
    const endpoint = 'ubc.oxylabs.io';
    const browserUrl = `wss://${username}:${password}@${endpoint}`;

    const browser = await chromium.connectOverCDP(browserUrl);
    const page = await browser.newPage();
    await page.goto('https://example.com');
    await browser.close();
})();

import puppeteer from 'puppeteer';

(async () => {
  const username = 'your-username';
  const password = 'your-password';
  const endpoint = 'ubc.oxylabs.io';
  const browserUrl = `wss://${username}:${password}@${endpoint}`;

  const browser = await puppeteer.connect({
    browserWSEndpoint: browserUrl
  });
  const page = await browser.newPage();
  await page.goto('https://example.com');
  await browser.close();
})();

United States Proxy Infrastructure

主要在美国运营的用户可以通过专用入口直接连接到位于美国的基础设施。这可确保更快的加载时间和更高的浏览效率。要建立连接，请使用以下地址：

wss://ubc-us.oxylabs.io

代码示例：

from playwright.sync_api import sync_playwright

username = "your-username"
password = "your-password"
endpoint = "ubc-us.oxylabs.io"
browser_url = f"wss://{username}:{password}@{endpoint}"

with sync_playwright() as p:
    browser = p.chromium.connect_over_cdp(browser_url)
    page = browser.new_page()
    page.goto('https://example.com')
    browser.close()

import { chromium } from 'playwright';

(async () => {
    const username = 'your-username';
    const password = 'your-password';
    const endpoint = 'ubc-us.oxylabs.io';
    const browserUrl = `wss://${username}:${password}@${endpoint}`;

    const browser = await chromium.connectOverCDP(browserUrl);
    const page = await browser.newPage();
    await page.goto('https://example.com');
    await browser.close();
})();

import puppeteer from 'puppeteer';

(async () => {
  const username = 'your-username';
  const password = 'your-password';
  const endpoint = 'ubc-us.oxylabs.io';
  const browserUrl = `wss://${username}:${password}@${endpoint}`;

  const browser = await puppeteer.connect({
    browserWSEndpoint: browserUrl
  });
  const page = await browser.newPage();
  await page.goto('https://example.com');
  await browser.close();
})();

注意： 此方案主要缩短面向美国用户的响应时间，不应与代理地理位置选择混淆。更多内容见下一节。

浏览器参数

Unblocking Browser Chrome 接受通过连接 URL 以以下格式传递的额外浏览器参数： ?bargs=。这些 GET 参数指定启动浏览器时应使用的命令行参数。

如果参数需要值，我们使用 bargs=argname:argvalue;
如果参数只是一个标志，我们使用 bargs=flagname .

目前，Oxylabs Unblocking Browser Chrome 支持以下参数：

参数

描述

force-color-profile:<profile>

强制将所有显示器视为具有指定的色彩配置文件。

window-position:X,Y

指定初始窗口位置。

hide-scrollbars

阻止为网页内容创建滚动条——对获取一致的截图很有用。

enable-features:<feature1>,<feature2>,<feature3>

以逗号分隔的要启用的功能名称列表。

disable-notifications

禁用 Web 通知和 Push API。

使用示例：

from playwright.sync_api import sync_playwright

username = "your-username"
password = "your-password"
endpoint = "ubc.oxylabs.io"
browser_url = f"wss://{username}:{password}@{endpoint}/?bargs=force-color-profile:srgb&bargs=window-position:100,100"

with sync_playwright() as p:
    browser = p.chromium.connect_over_cdp(browser_url)
    page = browser.new_page()
    page.goto('https://example.com')
    browser.close()

设备类型

您可以使用 ?p_device 参数自定义浏览器如何模拟不同的设备类型。这样可以模拟所选设备类型（桌面、移动、平板）的指纹，对于抓取响应式布局、移动专用内容或依赖设备的行为（例如 CAPTCHA 或 UI 元素）尤其有用。

可用 ?p_device 参数值：

desktop (默认) – 模拟具有全尺寸视口和桌面 User-Agent 字符串的标准桌面浏览器。
mobile – 模拟具有较小屏幕分辨率、触摸能力和移动 User-Agent 的智能手机体验。
tablet – 模拟平板设备，适用于抓取中等尺寸布局和混合移动/平板界面。

例如：

wss://username:[email protected]?p_device=mobile

CAPTCHA 解决事件

当检测到 CAPTCHA 并正在解决时，Oxylabs 会向控制台记录一条消息。以下消息可能会打印到控制台日志：

oxylabs-captcha-solve-start

当我们的系统检测到 CAPTCHA 并开始解决时触发。

oxylabs-captcha-solve-end

当自动解算器已成功解决 CAPTCHA 时触发。

oxylabs-captcha-solve-error

当自动解算器未能解决 CAPTCHA 时触发。

您可以订阅这些事件以暂停自动化流程，并仅在 CAPTCHA 成功处理后恢复。通常 CAPTCHA 解决取决于类型和复杂度，耗时可达 30 秒，但在某些情况下可能更长，因此请预留足够时间。

请查看下面关于如何处理这些事件的示例。

import asyncio
import time
from typing import Any

from playwright.async_api import async_playwright


# 填写用户名和密码
UB_USERNAME: str = ""
UB_PASSWORD: str = ""
UB_BROWSER_URL: str = f"wss://{UB_USERNAME}:{UB_PASSWORD}@ubc-us.oxylabs.io"


class UBScraper:
    def __init__(self) -> None:
        self.OXYLABS_CAPTCHA_START_MESSAGE: str = "oxylabs-captcha-solve-start"
        self.OXYLABS_CAPTCHA_DONE_MESSAGE: str = "oxylabs-captcha-solve-end"

        self.CAPTCHA_STARTED: bool = True
        self.CAPTCHA_SOLVED: bool = False

    async def handle_console(self, msg: Any) -> None:
        msg_args = msg.args

        for arg in msg_args:
            log_message = str(arg)
            print(log_message)

            if log_message.strip() == self.OXYLABS_CAPTCHA_START_MESSAGE:
                print("Captcha started to solve!")
                self.CAPTCHA_STARTED = True
            if log_message.strip() == self.OXYLABS_CAPTCHA_DONE_MESSAGE:
                print("Captcha finished solving!")
                self.CAPTCHA_SOLVED = True

    async def wait_for_captcha_completion(self, timeout_seconds: int = 20) -> bool:
        start_time = time.time()
        check_interval = 1

        print(f"Waiting for captcha to complete (timeout: {timeout_seconds}s)")

        while not self.CAPTCHA_SOLVED:
            elapsed = time.time() - start_time

            if elapsed > timeout_seconds:
                print(f"Timeout after {elapsed:.1f}s waiting for captcha")
                return False

            if int(elapsed) % 5 == 0:
                print(f"Still waiting for captcha... ({int(elapsed)}s)")

            await asyncio.sleep(check_interval)

        completion_time = time.time() - start_time
        print(f"Captcha completed after {completion_time:.1f}s")
        return True

    async def scrape(self, url: str) -> None:
        async with async_playwright() as playwright:
            start = time.time()

            browser = await playwright.chromium.connect_over_cdp(
                UB_BROWSER_URL,
            )

            print(f"Connecting to browser took {time.time() - start:.2f} seconds")
            context = browser.contexts[0]
            page = await context.new_page()

            page.on("console", self.handle_console)

            await page.goto(url)

            captcha_completed = await self.wait_for_captcha_completion(
                timeout_seconds=30
            )

            if not captcha_completed:
                raise Exception("Failed to solve")

            await page.screenshot(path="cf_captcha_check_.png")
            print("done")

            input("Enter to close")


if __name__ == "__main__":
    import asyncio

    # 替换为您选择的 URL
    URL = "https://www.indeed.com/cmp/Bank-of-the-West/reviews?lang=any&fcountry=ALL&sort=date"

    asyncio.run(UBScraper().scrape(URL))

const {chromium} = require('playwright');
const sleep = require('util').promisify(setTimeout)

const
    CAPTCHA_SOLVE_START = 'oxylabs-captcha-solve-start',
    CAPTCHA_SOLVE_END = 'oxylabs-captcha-solve-end',
    CAPTCHA_SOLVE_ERROR = 'oxylabs-captcha-solve-error',

    UB_BROWSER_URL = 'wss://<username>:<password>@ubc.headlesify.io',
    CAPTCHA_CHECK_INTERVAL_SEC = 1,
    CAPTCHA_CHECK_TIMEOUT_SEC = 30,
    TARGET_URL = 'https://www.indeed.com/cmp/Bank-of-the-West/reviews?lang=any&fcountry=ALL&sort=date';

(async () => {
    console.log('Opening browser page...');
    const browser = await chromium.connectOverCDP(UB_BROWSER_URL);
    const ctx = browser.contexts()[0];
    const page = await ctx.newPage();

    // 处理 console.log 消息并查找 Oxylabs CAPTCHA 解决事件
    let captchaState = null;
    page.on('console', message => {
        const msg = message.text().trim();
        if (msg.startsWith('oxylabs-captcha-')) {
            captchaState = msg;
        }
    });

    console.log('Opening target website with CAPTCHA...');
    await page.goto(TARGET_URL);

    // 等待 CAPTCHA 被解决
    for (let i = 0; i < CAPTCHA_CHECK_TIMEOUT_SEC; i++) {
        await sleep(CAPTCHA_CHECK_INTERVAL_SEC * 1000);

        // 注意：为获得更好控制，您也可以仅在一定时间内等待 CAPTCHA_SOLVE_START 事件。
        if (captchaState === CAPTCHA_SOLVE_END) {
            console.log('CAPTCHA solved successfully, continue scraping...');
            break;
        }
    }

    // 检查 CAPTCHA 是否已成功解决
    if ([CAPTCHA_SOLVE_START, CAPTCHA_SOLVE_ERROR].includes(captchaState)) {
        console.error('Could not solve CAPTCHA. Try increasing CAPTCHA_CHECK_TIMEOUT_SEC.');
        process.exit(1);
    }

    await page.waitForSelector('h1[data-testid="PageHeader-title-reviews"]');

    console.log('Making a screenshot...');
    await page.screenshot({ path: 'page_screenshot.jpg' });

    await page.close();
    await browser.close();

    console.log('Done.');
    process.exit(0);
})();

const puppeteer = require('puppeteer');
const sleep = require('util').promisify(setTimeout);

const
    CAPTCHA_SOLVE_START = 'oxylabs-captcha-solve-start',
    CAPTCHA_SOLVE_END = 'oxylabs-captcha-solve-end',
    CAPTCHA_SOLVE_ERROR = 'oxylabs-captcha-solve-error',

    UB_BROWSER_URL = 'wss://<username>:<password>@ubc.headlesify.io',
    CAPTCHA_CHECK_INTERVAL_SEC = 1,
    CAPTCHA_CHECK_TIMEOUT_SEC = 30,
    TARGET_URL = 'https://www.indeed.com/cmp/Bank-of-the-West/reviews?lang=any&fcountry=ALL&sort=date';

(async () => {
    console.log('Opening browser page...');
    const browser = await puppeteer.connect({
        browserWSEndpoint: UB_BROWSER_URL,
        defaultViewport: null
    });

    const pages = await browser.pages();
    const page = pages.length > 0 ? pages[0] : await browser.newPage();

    // 处理 console.log 消息并查找 Oxylabs CAPTCHA 解决事件
    let captchaState = null;
    page.on('console', msg => {
        const text = msg.text().trim();
        if (text.startsWith('oxylabs-captcha-')) {
            captchaState = text;
        }
    });

    console.log('Opening target website with CAPTCHA...');
    await page.goto(TARGET_URL, { waitUntil: 'domcontentloaded' });

    for (let i = 0; i < CAPTCHA_CHECK_TIMEOUT_SEC; i++) {
        await sleep(CAPTCHA_CHECK_INTERVAL_SEC * 1000);

        if (captchaState === CAPTCHA_SOLVE_END) {
            console.log('CAPTCHA solved successfully, continue scraping...');
            break;
        }
    }

    if ([CAPTCHA_SOLVE_START, CAPTCHA_SOLVE_ERROR].includes(captchaState)) {
        console.error('Could not solve CAPTCHA. Try increasing CAPTCHA_CHECK_TIMEOUT_SEC.');
        process.exit(1);
    }

    await page.waitForSelector('h1[data-testid="PageHeader-title-reviews"]');

    console.log('Making a screenshot...');
    await page.screenshot({ path: 'page_screenshot.jpg' });

    await page.close();
    await browser.disconnect();  // use disconnect for remote sessions

    console.log('Done.');
    process.exit(0);
})();

动态 CAPTCHA 解决

默认情况下，Unblocking Browser 会在页面加载时自动检测并立即解决 CAPTCHA。但是，有些网站会在后续阶段显示 CAPTCHA，例如在提交表单时的弹出窗口或特定用户交互后。

Unblocking Browser 允许您在会话期间的任何时点手动触发 CAPTCHA 检测和解决。要手动触发 CAPTCHA 解决，请执行以下代码向 window 对象发送消息：

window.postMessage({action: 'solve_captcha', type: '<captcha type>'}, '*')

支持的 CAPTCHA 类型包括：

hcaptcha
recaptcha
turnstile (Cloudflare CAPTCHA)

用法示例（Playwright / Puppeteer JavaScript）：

// ...
await page.click('#form-submit');
// 现在我们知道应该显示 CAPTCHA
await page.evaluate(() => {
  window.postMessage({action: 'solve_captcha', type: 'recaptcha'}, '*')
});
// 像常规情况一样关注 `oxylabs-captcha-start` 和 `oxylabs-captcha-end` 事件
// ...

Turnstile 由于 Turnstile CAPTCHA 必须在出现在屏幕前被拦截，因此需要不同的方法。为此，先触发 CAPTCHA 检测，然后执行会触发 CAPTCHA 的操作：

// 我们知道接下来的操作可能会触发 Turnstile CAPTCHA
await page.evaluate(() => {
  window.postMessage({action: 'solve_captcha', type: 'turnstile'}, '*')
});
await page.click('#form-submit');
// 像常规情况一样关注 `oxylabs-captcha-start` 和 `oxylabs-captcha-end` 事件
// ...

最后更新于1天前

这有帮助吗？

晚安