How to Solve Captcha in CrewAI with CapSolver Integration

Blog

web scraping

Blog

web scraping

How to Solve Captcha in CrewAI with CapSolver Integration

Ethan Collins

Pattern Recognition Specialist

23-Dec-2025

TL;DR: CrewAI workflows often meet Captcha; integrating CapSolver allows automated scripts to solve them efficiently.

Introduction

When automating tasks with CrewAI, such as web scraping or browsing, CAPTCHAs can easily block your workflow. These challenges are common when accessing protected websites and can interrupt even well-designed automation scripts.

CapSolver offers a reliable way to handle CAPTCHAs, letting CrewAI continue its tasks without manual intervention. By integrating CapSolver, you can streamline automated browsing and data collection while staying compliant with website protections.

What is CrewAI?

CrewAI is a lean, lightning-fast Python framework for building autonomous AI agent systems. Built entirely from scratch—completely independent of LangChain or other agent frameworks—CrewAI offers both high-level ease of use and granular customization capabilities.

Key Features of CrewAI

Multi-Agent Collaboration: Create crews of AI agents that work together autonomously with natural decision-making and dynamic task delegation
Event-Driven Workflows (Flows): Precise execution control with fine-grained path management, state consistency, and conditional branching
Standalone Design: No external framework dependencies, built for speed with minimal resource demands
Production-Ready: Designed with enterprise reliability and scalability standards
Extensive Community: Over 100,000 certified developers through community training

Core Architecture

CrewAI operates on two complementary paradigms:

Component	Description
Crews	Multi-agent teams that collaborate autonomously, enabling flexible problem-solving with specialized roles
Flows	Event-driven workflows offering precise execution control for complex business logic

What is CapSolver?

CapSolver is a leading CAPTCHA solving service that provides AI-powered solutions for bypassing various CAPTCHA challenges. With support for multiple CAPTCHA types and lightning-fast response times, CapSolver integrates seamlessly into automated workflows.

Supported CAPTCHA Types

reCAPTCHA v2 (Image & Invisible)
reCAPTCHA v3
Cloudflare Turnstile
Cloudflare Challenge (5s)
AWS WAF
And many more...

Why Integrate CapSolver with CrewAI?

When building CrewAI agents that interact with websites—whether for data collection, automated testing, or content aggregation—CAPTCHA challenges become a significant obstacle. Here's why the integration matters:

Uninterrupted Agent Workflows: Agents can complete their tasks without manual intervention
Scalable Automation: Handle multiple CAPTCHA challenges across concurrent agent operations
Cost-Effective: Pay only for successfully solved CAPTCHAs
High Success Rates: Industry-leading accuracy for all supported CAPTCHA types

Installation

First, install the required packages:

bash Copy

pip install crewai
pip install 'crewai[tools]'
pip install requests

Creating a Custom CapSolver Tool for CrewAI

CrewAI allows you to create custom tools that agents can use to accomplish their tasks. Here's how to create a CapSolver tool for handling CAPTCHA challenges:

Basic CapSolver Tool Implementation

python Copy

import requests
import time
from crewai.tools import BaseTool
from typing import Type
from pydantic import BaseModel, Field

CAPSOLVER_API_KEY = "YOUR_CAPSOLVER_API_KEY"

class CaptchaSolverInput(BaseModel):
    """Input schema for CaptchaSolver tool."""
    website_url: str = Field(..., description="The URL of the website with CAPTCHA")
    website_key: str = Field(..., description="The site key of the CAPTCHA")
    captcha_type: str = Field(default="ReCaptchaV2TaskProxyLess", description="Type of CAPTCHA to solve")

class CaptchaSolverTool(BaseTool):
    name: str = "captcha_solver"
    description: str = "Solves CAPTCHA challenges using CapSolver API. Supports reCAPTCHA v2, v3, Turnstile, and more."
    args_schema: Type[BaseModel] = CaptchaSolverInput

    def _run(self, website_url: str, website_key: str, captcha_type: str = "ReCaptchaV2TaskProxyLess") -> str:
        # Create task
        create_task_url = "https://api.capsolver.com/createTask"

        task_payload = {
            "clientKey": CAPSOLVER_API_KEY,
            "task": {
                "type": captcha_type,
                "websiteURL": website_url,
                "websiteKey": website_key
            }
        }

        response = requests.post(create_task_url, json=task_payload)
        result = response.json()

        if result.get("errorId") != 0:
            return f"Error creating task: {result.get('errorDescription')}"

        task_id = result.get("taskId")

        # Poll for result
        get_result_url = "https://api.capsolver.com/getTaskResult"

        for _ in range(60):  # Max 60 attempts
            time.sleep(2)

            result_payload = {
                "clientKey": CAPSOLVER_API_KEY,
                "taskId": task_id
            }

            response = requests.post(get_result_url, json=result_payload)
            result = response.json()

            if result.get("status") == "ready":
                solution = result.get("solution", {})
                return solution.get("gRecaptchaResponse") or solution.get("token")
            elif result.get("status") == "failed":
                return f"Task failed: {result.get('errorDescription')}"

        return "Timeout waiting for CAPTCHA solution"

Solving Different CAPTCHA Types

reCAPTCHA v2 Solver

python Copy

import requests
import time
from crewai.tools import BaseTool
from typing import Type
from pydantic import BaseModel, Field

CAPSOLVER_API_KEY = "YOUR_CAPSOLVER_API_KEY"


class ReCaptchaV2Input(BaseModel):
    """Input schema for reCAPTCHA v2 solver."""
    website_url: str = Field(..., description="The URL of the website with reCAPTCHA v2")
    website_key: str = Field(..., description="The site key of the reCAPTCHA")


class ReCaptchaV2Tool(BaseTool):
    name: str = "recaptcha_v2_solver"
    description: str = "Solves reCAPTCHA v2 challenges using CapSolver"
    args_schema: Type[BaseModel] = ReCaptchaV2Input

    def _run(self, website_url: str, website_key: str) -> str:
        payload = {
            "clientKey": CAPSOLVER_API_KEY,
            "task": {
                "type": "ReCaptchaV2TaskProxyLess",
                "websiteURL": website_url,
                "websiteKey": website_key
            }
        }
        return self._solve_captcha(payload)

    def _solve_captcha(self, payload: dict) -> str:
        # Create task
        response = requests.post("https://api.capsolver.com/createTask", json=payload)
        result = response.json()

        if result.get("errorId") != 0:
            return f"Error: {result.get('errorDescription')}"

        task_id = result.get("taskId")

        # Poll for result
        for attempt in range(60):
            time.sleep(2)
            result = requests.post(
                "https://api.capsolver.com/getTaskResult",
                json={"clientKey": CAPSOLVER_API_KEY, "taskId": task_id}
            ).json()

            if result.get("status") == "ready":
                return result["solution"]["gRecaptchaResponse"]
            if result.get("status") == "failed":
                return f"Failed: {result.get('errorDescription')}"

        return "Timeout waiting for solution"

reCAPTCHA v3 Solver

python Copy

import requests
import time
from crewai.tools import BaseTool
from typing import Type
from pydantic import BaseModel, Field

CAPSOLVER_API_KEY = "YOUR_CAPSOLVER_API_KEY"


class ReCaptchaV3Input(BaseModel):
    """Input schema for reCAPTCHA v3 solver."""
    website_url: str = Field(..., description="The URL of the website with reCAPTCHA v3")
    website_key: str = Field(..., description="The site key of the reCAPTCHA")
    page_action: str = Field(default="submit", description="The action parameter for reCAPTCHA v3")


class ReCaptchaV3Tool(BaseTool):
    name: str = "recaptcha_v3_solver"
    description: str = "Solves reCAPTCHA v3 challenges with score-based verification"
    args_schema: Type[BaseModel] = ReCaptchaV3Input

    def _run(
        self,
        website_url: str,
        website_key: str,
        page_action: str = "submit"
    ) -> str:
        payload = {
            "clientKey": CAPSOLVER_API_KEY,
            "task": {
                "type": "ReCaptchaV3TaskProxyLess",
                "websiteURL": website_url,
                "websiteKey": website_key,
                "pageAction": page_action
            }
        }

        # Create task
        response = requests.post("https://api.capsolver.com/createTask", json=payload)
        result = response.json()

        if result.get("errorId") != 0:
            return f"Error: {result.get('errorDescription')}"

        task_id = result.get("taskId")

        # Poll for result
        for attempt in range(60):
            time.sleep(2)
            result = requests.post(
                "https://api.capsolver.com/getTaskResult",
                json={"clientKey": CAPSOLVER_API_KEY, "taskId": task_id}
            ).json()

            if result.get("status") == "ready":
                return result["solution"]["gRecaptchaResponse"]
            if result.get("status") == "failed":
                return f"Failed: {result.get('errorDescription')}"

        return "Timeout waiting for solution"

Cloudflare Turnstile Solver

python Copy

import requests
import time
from crewai.tools import BaseTool
from typing import Type
from pydantic import BaseModel, Field

CAPSOLVER_API_KEY = "YOUR_CAPSOLVER_API_KEY"


class TurnstileInput(BaseModel):
    """Input schema for Turnstile solver."""
    website_url: str = Field(..., description="The URL of the website with Turnstile")
    website_key: str = Field(..., description="The site key of the Turnstile widget")


class TurnstileTool(BaseTool):
    name: str = "turnstile_solver"
    description: str = "Solves Cloudflare Turnstile challenges"
    args_schema: Type[BaseModel] = TurnstileInput

    def _run(self, website_url: str, website_key: str) -> str:
        payload = {
            "clientKey": CAPSOLVER_API_KEY,
            "task": {
                "type": "AntiTurnstileTaskProxyLess",
                "websiteURL": website_url,
                "websiteKey": website_key
            }
        }

        # Create task
        response = requests.post("https://api.capsolver.com/createTask", json=payload)
        result = response.json()

        if result.get("errorId") != 0:
            return f"Error: {result.get('errorDescription')}"

        task_id = result.get("taskId")

        # Poll for result
        for attempt in range(60):
            time.sleep(2)
            result = requests.post(
                "https://api.capsolver.com/getTaskResult",
                json={"clientKey": CAPSOLVER_API_KEY, "taskId": task_id}
            ).json()

            if result.get("status") == "ready":
                return result["solution"]["token"]
            if result.get("status") == "failed":
                return f"Failed: {result.get('errorDescription')}"

        return "Timeout waiting for solution"

Cloudflare Challenge (5s) Solver

python Copy

import requests
import time
from crewai.tools import BaseTool
from typing import Type
from pydantic import BaseModel, Field

CAPSOLVER_API_KEY = "YOUR_CAPSOLVER_API_KEY"


class CloudflareChallengeInput(BaseModel):
    """Input schema for Cloudflare Challenge solver."""
    website_url: str = Field(..., description="The URL of the protected page")
    proxy: str = Field(..., description="Proxy in format: http://user:pass@ip:port")


class CloudflareChallengeTool(BaseTool):
    name: str = "cloudflare_challenge_solver"
    description: str = "Solves Cloudflare 5-second challenge pages"
    args_schema: Type[BaseModel] = CloudflareChallengeInput

    def _run(self, website_url: str, proxy: str) -> dict:
        payload = {
            "clientKey": CAPSOLVER_API_KEY,
            "task": {
                "type": "AntiCloudflareTask",
                "websiteURL": website_url,
                "proxy": proxy
            }
        }

        # Create task
        response = requests.post("https://api.capsolver.com/createTask", json=payload)
        result = response.json()

        if result.get("errorId") != 0:
            return f"Error: {result.get('errorDescription')}"

        task_id = result.get("taskId")

        # Poll for result
        for attempt in range(60):
            time.sleep(3)
            result = requests.post(
                "https://api.capsolver.com/getTaskResult",
                json={"clientKey": CAPSOLVER_API_KEY, "taskId": task_id}
            ).json()

            if result.get("status") == "ready":
                return {
                    "cookies": result["solution"]["cookies"],
                    "user_agent": result["solution"]["userAgent"]
                }
            if result.get("status") == "failed":
                return f"Failed: {result.get('errorDescription')}"

        return "Timeout waiting for solution"

How to Submit CAPTCHA Tokens

Each CAPTCHA type requires a different submission method:

reCAPTCHA v2/v3 - Token Injection

For reCAPTCHA, inject the token into the hidden textarea and submit the form:

python Copy

from selenium import webdriver
from selenium.webdriver.common.by import By

def submit_recaptcha_token(driver, token: str):
    """Inject reCAPTCHA token and submit"""
    # Make the hidden textarea visible and set the token
    recaptcha_response = driver.find_element(By.ID, "g-recaptcha-response")
    driver.execute_script("arguments[0].style.display = 'block';", recaptcha_response)
    recaptcha_response.clear()
    recaptcha_response.send_keys(token)

    # Submit the form
    form = driver.find_element(By.TAG_NAME, "form")
    form.submit()

Turnstile - Token Injection

For Turnstile, set the token in the hidden input:

python Copy

def submit_turnstile_token(driver, token: str):
    """Inject Turnstile token and submit"""
    # Set token in the hidden input
    turnstile_input = driver.find_element(By.NAME, "cf-turnstile-response")
    driver.execute_script("arguments[0].value = arguments[1];", turnstile_input, token)

    # Submit the form
    form = driver.find_element(By.TAG_NAME, "form")
    form.submit()

Cloudflare Challenge - Use Cookies

For Cloudflare Challenge (5s), CapSolver returns cookies and user-agent instead of a token. Use these in your requests:

python Copy

import requests

def access_cloudflare_protected_page(url: str, cf_solution: dict):
    """
    Use Cloudflare Challenge solution to access protected page.
    cf_solution contains 'cookies' and 'user_agent' from CapSolver.
    """
    # Create session with the solved cookies
    session = requests.Session()

    # Set the cookies from CapSolver solution
    for cookie in cf_solution["cookies"]:
        session.cookies.set(cookie["name"], cookie["value"])

    # Set the user agent that was used to solve
    headers = {
        "User-Agent": cf_solution["user_agent"]
    }

    # Now you can access the protected page
    response = session.get(url, headers=headers)
    return response.text

Complete Scraping Example

python Copy

import requests
import time
from selenium import webdriver
from selenium.webdriver.common.by import By

CAPSOLVER_API_KEY = "YOUR_CAPSOLVER_API_KEY"


def solve_recaptcha(website_url: str, website_key: str) -> str:
    """Get reCAPTCHA token from CapSolver"""
    payload = {
        "clientKey": CAPSOLVER_API_KEY,
        "task": {
            "type": "ReCaptchaV2TaskProxyLess",
            "websiteURL": website_url,
            "websiteKey": website_key
        }
    }

    response = requests.post("https://api.capsolver.com/createTask", json=payload)
    result = response.json()

    if result.get("errorId") != 0:
        raise Exception(f"Error: {result.get('errorDescription')}")

    task_id = result.get("taskId")

    for _ in range(60):
        time.sleep(2)
        result = requests.post(
            "https://api.capsolver.com/getTaskResult",
            json={"clientKey": CAPSOLVER_API_KEY, "taskId": task_id}
        ).json()

        if result.get("status") == "ready":
            return result["solution"]["gRecaptchaResponse"]
        if result.get("status") == "failed":
            raise Exception(f"Failed: {result.get('errorDescription')}")

    raise Exception("Timeout")


def scrape_with_recaptcha(target_url: str, site_key: str):
    """Full flow: solve reCAPTCHA → submit → scrape"""
    driver = webdriver.Chrome()
    driver.get(target_url)

    try:
        # 1. Solve CAPTCHA
        token = solve_recaptcha(target_url, site_key)

        # 2. Inject token
        recaptcha_response = driver.find_element(By.ID, "g-recaptcha-response")
        driver.execute_script("arguments[0].style.display = 'block';", recaptcha_response)
        recaptcha_response.clear()
        recaptcha_response.send_keys(token)

        # 3. Submit form
        driver.find_element(By.TAG_NAME, "form").submit()

        # 4. Scrape content
        time.sleep(3)  # Wait for page load
        return driver.page_source

    finally:
        driver.quit()

Using CapSolver Browser Extension

For scenarios requiring browser automation within CrewAI, you can utilize the CapSolver browser extension:

Download the Extension: Get the CapSolver extension from capsolver.com
Configure with Selenium/Playwright: Load the extension in your browser automation tool
Auto-Solve Mode: The extension automatically detects and solves CAPTCHAs

python Copy

from selenium import webdriver
from selenium.webdriver.chrome.options import Options

# Configure Chrome with CapSolver extension
chrome_options = Options()
chrome_options.add_extension("path/to/capsolver-extension.crx")

driver = webdriver.Chrome(options=chrome_options)

# The extension will automatically handle CAPTCHAs
driver.get("https://example.com/protected-page")

Best Practices

1. Error Handling

python Copy

def solve_with_retry(self, payload: dict, max_retries: int = 3) -> str:
    for attempt in range(max_retries):
        try:
            result = self._solve_captcha(payload)
            if result:
                return result
        except Exception as e:
            if attempt == max_retries - 1:
                raise
            time.sleep(2 ** attempt)  # Exponential backoff

2. Balance Management

python Copy

def check_balance() -> float:
    response = requests.post(
        "https://api.capsolver.com/getBalance",
        json={"clientKey": CAPSOLVER_API_KEY}
    )
    return response.json().get("balance", 0)

3. Caching Solutions

For repeated access to the same pages, cache CAPTCHA tokens when appropriate:

python Copy

from functools import lru_cache
from datetime import datetime, timedelta

captcha_cache = {}

def get_cached_token(website_url: str, website_key: str) -> str:
    cache_key = f"{website_url}:{website_key}"

    if cache_key in captcha_cache:
        token, timestamp = captcha_cache[cache_key]
        if datetime.now() - timestamp < timedelta(minutes=2):
            return token

    # Solve new CAPTCHA
    new_token = solve_captcha(website_url, website_key)
    captcha_cache[cache_key] = (new_token, datetime.now())
    return new_token

Conclusion

Integrating CapSolver with CrewAI unlocks the full potential of autonomous AI agents for web-based tasks. By combining CrewAI's powerful multi-agent orchestration with CapSolver's industry-leading CAPTCHA solving capabilities, developers can build robust automation solutions that handle even the most challenging web protection mechanisms.

Whether you're building data extraction pipelines, automated testing frameworks, or intelligent web agents, the CrewAI + CapSolver combination provides the reliability and scalability needed for production environments.

Ready to get started? Sign up for CapSolver and use bonus code CREWAI for an extra 6% bonus on your every recharge!

FAQ

What is CrewAI?

CrewAI is a lean, lightning-fast Python framework for building autonomous AI agent systems. It enables developers to create crews of AI agents that collaborate to accomplish complex tasks, with support for both autonomous decision-making and precise workflow control.

How does CapSolver integrate with CrewAI?

CapSolver integrates with CrewAI through custom tools. You create a tool that wraps the CapSolver API, allowing your AI agents to automatically solve CAPTCHA challenges when they encounter them during web operations.

What types of CAPTCHAs can CapSolver solve?

CapSolver supports a wide range of CAPTCHA types including reCAPTCHA v2, reCAPTCHA v3,Cloudflare Turnstile, Cloudflare Challenge, AWS WAF, GeeTest and many more.

How much does CapSolver cost?

CapSolver offers competitive pricing based on the type and volume of CAPTCHAs solved. Visit capsolver.com for current pricing details. Use code CREWAI for a 6% bonus on your first recharge.

Can I use CapSolver with other Python frameworks?

Yes! CapSolver provides a REST API that can be integrated with any Python framework, including Scrapy, Selenium, Playwright, and more.

Is CrewAI free to use?

Yes, CrewAI is open-source and released under the MIT license. The framework is free to use, though you may incur costs for LLM API calls (like OpenAI) and CAPTCHA solving services like CapSolver.

How do I find the CAPTCHA site key?

The site key is typically found in the page's HTML source. Look for:

reCAPTCHA: data-sitekey attribute or grecaptcha.render() call
: data-sitekey attribute
Turnstile: data-sitekey attribute in the Turnstile widget

Compliance Disclaimer: The information provided on this blog is for informational purposes only. CapSolver is committed to compliance with all applicable laws and regulations. The use of the CapSolver network for illegal, fraudulent, or abusive activities is strictly prohibited and will be investigated. Our captcha-solving solutions enhance user experience while ensuring 100% compliance in helping solve captcha difficulties during public data crawling. We encourage responsible use of our services. For more information, please visit our Terms of Service and Privacy Policy.

Master MCP : Boost AI Smarts in 2026

The Model Context Protocol (MCP) is the future of AI integration. Learn how MCP standardizes AI-tool communication, drives enterprise automation, and boosts AI smarts in 2026.

web scraping

Emma Foster

24-Dec-2025

How to Solve Captcha in Crawlee with CapSolver Integration

A practical guide to solving reCAPTCHA and Turnstile in Crawlee using CapSolver for stable Node.js scraping.

web scraping

Lucas Mitchell

24-Dec-2025

How to Solve Captcha in CrewAI with CapSolver Integration

CrewAI integration with CapSolver enables seamless CAPTCHA handling for reCAPTCHA, Cloudflare Turnstile, AWS WAF, and more, improving automated web tasks.

web scraping

Ethan Collins

23-Dec-2025

The Best Coding Language for Web Scraping in 2026

Choosing the right coding language for web scraping is crucial. Compare Python, Go, JavaScript, and more for performance and scale in 2026. Plus, learn how CapSolver ensures success.

web scraping

Sora Fujimoto

17-Dec-2025

Top 7 B2B Data Providers in 2026: A Practical Comparison Guide

Compare the top 7 B2B Data Providers for 2026 based on accuracy, compliance, and specialization. Find the best data vendor for your sales and marketing needs.

web scraping

Ethan Collins

17-Dec-2025

Camoufox and CapSolver CAPTCHA solving workflow

How to Integrate Camoufox with CapSolver for Seamless CAPTCHA Solving

Learn how to integrate Camoufox with CapSolver to bypass Cloudflare Turnstile and reCAPTCHA reliably at scale.

web scraping

Ethan Collins

16-Dec-2025

How to Solve Captcha in CrewAI with CapSolver Integration

Introduction

What is CrewAI?

Key Features of CrewAI

Core Architecture

What is CapSolver?

Supported CAPTCHA Types

Why Integrate CapSolver with CrewAI?

Installation

Creating a Custom CapSolver Tool for CrewAI

Basic CapSolver Tool Implementation

Solving Different CAPTCHA Types

reCAPTCHA v2 Solver

reCAPTCHA v3 Solver

Cloudflare Turnstile Solver

Cloudflare Challenge (5s) Solver

How to Submit CAPTCHA Tokens

reCAPTCHA v2/v3 - Token Injection

Turnstile - Token Injection

Cloudflare Challenge - Use Cookies

Complete Scraping Example

Using CapSolver Browser Extension

Best Practices

1. Error Handling

2. Balance Management

3. Caching Solutions

Conclusion

FAQ

What is CrewAI?

How does CapSolver integrate with CrewAI?

What types of CAPTCHAs can CapSolver solve?

How much does CapSolver cost?

Can I use CapSolver with other Python frameworks?

Is CrewAI free to use?

How do I find the CAPTCHA site key?

More

Master MCP : Boost AI Smarts in 2026

How to Solve Captcha in Crawlee with CapSolver Integration

How to Solve Captcha in CrewAI with CapSolver Integration

The Best Coding Language for Web Scraping in 2026

Top 7 B2B Data Providers in 2026: A Practical Comparison Guide

How to Integrate Camoufox with CapSolver for Seamless CAPTCHA Solving