Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://crawlee.dev/python/api/class/HttpCrawlingContext below:

Website Navigation

• Previous

  BeautifulSoupCrawlingContext

• Next

  HttpCrawlingResult

HttpCrawlingContext | API | Crawlee for Python · Fast, reliable Python web crawlers.

The crawling context used by the AbstractHttpCrawler.

• HttpCrawlingResult
• BasicCrawlingContext
  • HttpCrawlingContext
    • ParsedHttpCrawlingContext

• __hash__
• from_basic_crawling_context
• get_snapshot

• add_requests
• get_key_value_store
• http_response
• log
• proxy_info
• push_data
• request
• send_request
• session
• use_state

• __hash__(): int

• Inherited from BasicCrawlingContext.__hash__

  Return hash of the context. Each context is considered unique.

  Returns int

• from_basic_crawling_context(context, http_response): Self

• Initialize a new instance from an existing BasicCrawlingContext.

  Parameters
  • context: BasicCrawlingContext
  • http_response: HttpResponse
  Returns Self

• async get_snapshot(): PageSnapshot

• Overrides BasicCrawlingContext.get_snapshot

  Get snapshot of crawled page.

  Returns PageSnapshot

add_requests

Inherited from BasicCrawlingContext.add_requests

Add requests crawling context helper function.

get_key_value_store

Inherited from BasicCrawlingContext.get_key_value_store

Get key-value store crawling context helper function.

http_response

Inherited from HttpCrawlingResult.http_response

The HTTP response received from the server.

log: logging.Logger

Inherited from BasicCrawlingContext.log

Logger instance.

proxy_info: ProxyInfo | None

Inherited from BasicCrawlingContext.proxy_info

Proxy information for the current page being processed.

push_data

Inherited from BasicCrawlingContext.push_data

Push data crawling context helper function.

request

Inherited from BasicCrawlingContext.request

Request object for the current page being processed.

send_request

Inherited from BasicCrawlingContext.send_request

Send request crawling context helper function.

session: Session | None

Inherited from BasicCrawlingContext.session

Session object for the current page being processed.

use_state

Inherited from BasicCrawlingContext.use_state

Use state crawling context helper function.

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4