Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://crawlee.dev/python/api/class/AbstractHttpParser below:

Website Navigation

• Previous

  ImpitHttpClient

• Next

  BeautifulSoupParser

AbstractHttpParser | API | Crawlee for Python · Fast, reliable Python web crawlers.

Parser used for parsing HTTP response and inspecting parsed result to find links or detect blocking.

• find_links(parsed_content, selector): Iterable[str]

• Overrides AbstractHttpParser.find_links

  Find all links in result using selector.

  Parameters
  • parsed_content: TParseResult

    Parsed HTTP response. Result of parse method.

  • selector: str

    String used to define matching pattern for finding links.

  Returns Iterable[str]

• Overrides AbstractHttpParser.is_blocked

  Detect if blocked and return BlockedInfo with additional information.

  Default implementation that expects is_matching_selector abstract method to be implemented. Override this method if your parser has different way of blockage detection.

  Parameters
  • parsed_content: TParseResult

    Parsed HTTP response. Result of parse method.

  Returns BlockedInfo

• is_matching_selector(parsed_content, selector): bool

• Overrides AbstractHttpParser.select

  Use css selector to select page element and return it.

  Parameters
  • parsed_content: TParseResult

    Content where the page element will be located.

  • selector: str

    Css selector used to locate desired html element.

  Returns Sequence[TSelectResult]

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4