magpie.fetch.cache

Module Contents

Functions

cache_url_duct

cache_urls_in_folder

url_to_cached_url

clear_cache

refresh_cache_celery

fix_extensionless_links

This is similar to what --adjust-extension does for wget, except that wget only does it for html, css and a few other files.

test_cache_url

Data

API

magpie.fetch.cache.WGET_OPTS

[’–span-hosts’, ‘–adjust-extension’, ‘–trust-server-names’, ‘–convert-links’, ‘–page-requisites…

magpie.fetch.cache.cache_url_duct(url: str)[source]
magpie.fetch.cache.cache_urls_in_folder(folder: magpie.datamodel.Folder, cache_url)[source]
magpie.fetch.cache.url_to_cached_url(url: str) str[source]
magpie.fetch.cache.clear_cache()[source]
magpie.fetch.cache.refresh_cache_celery(collection: magpie.datamodel.Folder)[source]

This is similar to what --adjust-extension does for wget, except that wget only does it for html, css and a few other files.

magpie.fetch.cache.test_cache_url()[source]