Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://crawlee.dev/python/api/class/RequestQueue below:

RequestQueue | API | Crawlee for Python · Fast, reliable Python web crawlers.

• __init__(client, id, name): None

• Parameters
  • client: RequestQueueClient
  • id: str
  • name: str | None
  Returns None

• async add_request(request, *, forefront): ProcessedRequest

• Overrides RequestManager.add_request

  Parameters
  • request: str | Request
  • optionalkeyword-onlyforefront: bool = False
  Returns ProcessedRequest

• async add_requests(requests, *, forefront, batch_size, wait_time_between_batches, wait_for_all_requests_to_be_added, wait_for_all_requests_to_be_added_timeout): None

• Overrides RequestManager.add_requests

  Parameters
  • requests: Sequence[str | Request]
  • optionalkeyword-onlyforefront: bool = False
  • optionalkeyword-onlybatch_size: int = 1000
  • optionalkeyword-onlywait_time_between_batches: timedelta = timedelta(seconds=1)
  • optionalkeyword-onlywait_for_all_requests_to_be_added: bool = False
  • optionalkeyword-onlywait_for_all_requests_to_be_added_timeout: timedelta | None = None
  Returns None

• Overrides Storage.drop

  Returns None

• async fetch_next_request(): Request | None

• async get_handled_count(): int

• async get_request(request_id): Request | None

• Parameters
  • request_id: str
  Returns Request | None

• async get_total_count(): int

• Overrides RequestManager.is_empty

  Returns bool

• async is_finished(): bool

• async mark_request_as_handled(request): ProcessedRequest | None

• async open(*, id, name, configuration, storage_client): Storage

• Overrides Storage.open

  Parameters
  • optionalkeyword-onlyid: str | None = None
  • optionalkeyword-onlyname: str | None = None
  • optionalkeyword-onlyconfiguration: Configuration | None = None
  • optionalkeyword-onlystorage_client: StorageClient | None = None
  Returns Storage

• Overrides Storage.purge

  Returns None

• async reclaim_request(request, *, forefront): ProcessedRequest | None

• Overrides RequestManager.reclaim_request

  Parameters
  • request: Request
  • optionalkeyword-onlyforefront: bool = False
  Returns ProcessedRequest | None

• async to_tandem(request_manager): RequestManagerTandem

• Inherited from RequestLoader.to_tandem

  Parameters
  • optionalrequest_manager: RequestManager | None = None
  Returns RequestManagerTandem

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4