Sitemap

class datahtml.sitemap.SitemapLink(fullurl: str, lastmod: str)

fullurl: str

lastmod: str

__init__(fullurl: str, lastmod: str) → None

datahtml.sitemap.get_sitemaps_from_robots(robots_txt: str) → List[str]: it’s parse links to sitemap files from the robots.txt protocol file