FAQ
Frequently asked questions about the Oxylabs AI Studio apps.
AI-Crawler
How does AI-Crawler differ from a traditional web scraper?
Unlike traditional scrapers that rely on static selectors (CSS/XPath) and custom scripts, AI-Crawler uses natural language prompts and AI-assisted URL selection to dynamically identify and extract relevant content. It returns Markdown results and also supports schema-based parsing for structured JSON outputs, reducing the need for manual parsing logic.
What websites can I crawl with Oxylabs AI-Crawler?
You can crawl most publicly accessible websites. AI-Crawler is designed to handle both static and JavaScript-rendered pages, and it can be configured with geo-targeting. However, be sure your use case complies with the website’s terms of service and local laws.
Is AI-Crawler free?
Oxylabs AI Studio AI-Crawler is free to try by signing up for a free trial that includes 1,000 credits. After the trial, the monthly plans start at $12/month with 3,000 credits and 1 request/s, with higher plans offering more credits and higher request rates.
Can I generate my own schema for JSON output?
Yes, you can either provide your own schema in OpenAPI format or let AI-Crawler generate one automatically from a natural language prompt. This allows your extracted data to match the exact structure your application needs.
AI-Scraper
How does AI-Scraper differ from normal scrapers?
AI-Scraper doesn’t rely on CSS/XPath selectors or custom parsing logic. Instead, it uses natural language prompts and AI-powered extraction, making it more adaptable to layout changes and much easier to set up.
Can I scrape any webpage?
Yes, you can scrape any public webpage as long as the page is publicly accessible. AI-Scraper also supports JavaScript rendering for dynamic pages. Private or login-protected content isn’t supported out of the box.
Is schema mandatory for AI-Scraper?
No, schema is not mandatory, but it’s required if you want structured JSON output. If you don’t provide one, AI-Scraper can generate a schema automatically based on your prompt.
What happens if the page structure changes?
Unlike traditional scrapers, AI-Scraper is more resilient to layout changes because it interprets content with AI. However, major changes may require you to adjust either your prompt or the schema.
Is AI-Scraper free?
AI-Scraper is free to try by signing up for a free trial that includes 1,000 credits. After the trial, the monthly plans start at just $12/month with 3000 credits and 1 request/s, with higher plans offering more credits and higher request rates.
Browser Agent
How is Browser Agent different from Puppeteer or Selenium?
Traditional tools rely on writing selectors and scripts for every action. AI browser agents replace that with natural language instructions and add organic browsing, making automation much faster, easier, and less fragile.
Can Browser Agent log in to websites or fill forms?
Yes, you can instruct the agent to enter text, submit forms, or click buttons. Keep in mind that sites with advanced bot detection may require advanced setup.
Can I use Browser Agent on any website?
Browser Agent works on most public websites, including ones that rely on JavaScript or interactive flows. However, you should always make sure your use case complies with the target website’s Terms of Service and applicable laws.
Is Browser Agent free to use?
Oxylabs AI Studio Browser Agent is free to try by signing up for a free trial that includes 1,000 credits. After the trial, the monthly plans start at just $12/month with 3000 credits and 1 request/s, with higher plans offering more credits and higher request rates.
Last updated
Was this helpful?