schema_salad.fetcher

Resource fetching.

Classes

Fetcher

Fetch resources from URIs.

MemoryCachingFetcher

Fetcher that caches resources in memory after retrieval.

DefaultFetcher

The default Fetcher implementation.

Module Contents

class schema_salad.fetcher.Fetcher

Bases: abc.ABC

Inheritance diagram of schema_salad.fetcher.Fetcher

Fetch resources from URIs.

abstract fetch_text(url, content_types=None)

Retrieve the given resource as a string.

Parameters:
Return type:

str

abstract check_exists(url)

Check if the given resource exists.

Parameters:

url (str)

Return type:

bool

abstract urljoin(base_url, url)

Construct a full (“absolute”) URL by combining a “base URL” with another URL.

Parameters:
Return type:

str

schemes = ['file', 'http', 'https', 'mailto']
supported_schemes()

Return the list of supported URI schemes.

Return type:

list[str]

class schema_salad.fetcher.MemoryCachingFetcher(cache)

Bases: Fetcher

Inheritance diagram of schema_salad.fetcher.MemoryCachingFetcher

Fetcher that caches resources in memory after retrieval.

Parameters:

cache (schema_salad.utils.CacheType)

cache
class schema_salad.fetcher.DefaultFetcher(cache, session)

Bases: MemoryCachingFetcher

Inheritance diagram of schema_salad.fetcher.DefaultFetcher

The default Fetcher implementation.

Parameters:
session
fetch_text(url, content_types=None)

Retrieve the given resource as a string.

Parameters:
Return type:

str

check_exists(url)

Check if the given resource exists.

Parameters:

url (str)

Return type:

bool

urljoin(base_url, url)

Construct a full (“absolute”) URL by combining a “base URL” with another URL.

Parameters:
Return type:

str