Add support for blacklisting http:// (or other schemes)

[cipriancraciun]

Given that today HTTPS is almost mandatory, it would be useful to have an option to report the presence of http:// URLs.

As an extension to this, perhaps add a way to warn the user if other schemes are used, like for example ftp://, slack://, etc.

Perhaps the simplest way to achieve this is to have either:

• --allow-scheme http --allow-scheme https --alow-scheme ftp --allow-scheme mailto where any scheme not listed is warned;
• --deny-scheme gopher --deny-scheme gemini where any scheme listed is warned;
• (obviously combining both --allow-scheme and --deny-scheme makes no sense;)

[raviqqe]

Currently, we don't support this use case because Muffet is meant to be a link checker but not a general linter. Is it possible for you to use other existing HTML linting tools instead?

[cipriancraciun]

Is it possible for you to use other existing HTML linting tools instead?

I could definitively use another tool, in fact I have written a small Go tool myself for this use-case.

However, since muffet is able to crawl "live pages" (i.e. over HTTP), I think it would be a better place to implement such compliance checks, instead of an "offline" (i.e. over files). And sometimes, for example with dynamic sites, there is no "offline" checking possibility.

---

[...] Muffet is meant to be a link checker [...]

And it is exactly for this reason I've mentioned schemes, which are part of links.

I think a site shouldn't just contain "working links" but also "safe(er) links", thus the primary use-case of checking for http:// links.