Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vetted blocklists thread #1913

Closed
ameshkov opened this issue Jul 23, 2020 · 50 comments
Closed

Vetted blocklists thread #1913

ameshkov opened this issue Jul 23, 2020 · 50 comments
Assignees
Milestone

Comments

@ameshkov
Copy link
Member

ameshkov commented Jul 23, 2020

AdGuard Home lets the user choose from a list of vetted blocklists.

If you have in mind any lists that can be added there, please leave a comment in this thread, we'll consider it.

Previous task with a relevant comments thread: #1325

Requirements

  • Maintained
  • Clear purpose
  • We prefer (mostly) original lists to compilations (like Energized or oisd.nl). Maybe we should add a special section for compilations (?)
@nezorflame
Copy link

StevenBlack's one would be nice to have, along with the Energized lists.

@ameshkov
Copy link
Member Author

As I recall, there were some people against Energized: #1325 (comment)

@DandelionSprout
Since the Energized lists are compiled almost entirely from other lists (except for ~20,000 of the entries that come from Energized Core), I personally would have chose to prioritise adding the best ones among the source lists instead.

Can we just include the Energized Core?

@DandelionSprout
Copy link
Member

Sadly not, because of AdroitAdorKhan/EnergizedProtection#60.

@ameshkov
Copy link
Member Author

Weird stuff, so adding Energized means that the whitelist should be added as well

@ameshkov
Copy link
Member Author

We should consider adding Luminati and Avast to the list of "Services", see the lists here: https://github.com/durablenapkin/block

@ameshkov
Copy link
Member Author

@YBS-PC
Copy link

YBS-PC commented Aug 30, 2020

it will be good if you replace Spam404 link
from https://raw.githubusercontent.com/Spam404/lists/master/main-blacklist.txt
to https://raw.githubusercontent.com/Spam404/lists/master/adblock-list.txt

@ameshkov
Copy link
Member Author

ameshkov commented Sep 1, 2020

@YBS-PC the "adblock-list" is supposed to be used by traditional adblockers and not in host-level blockers and there's a risk that at some point there will be added some unsupported modifiers like $third-party or $document. That's why I'd better keep simple hosts list for now.

@emlimap
Copy link

emlimap commented Sep 8, 2020

URLhaus Malicious URL Blocklist - https://gitlab.com/curben/urlhaus-filter#urlhaus-malicious-url-blocklist

This list is being used by ublock origin to replace Malware domains list. The author also has an AGH specific list https://gitlab.com/curben/urlhaus-filter#domain-based-adguard-home

@DandelionSprout
Copy link
Member

DandelionSprout commented Sep 10, 2020

It is now pretty safe to assume that anything Energized-related is ruled out entirely, since the lead dev is too often absent that the possibility of creating a Core + Whitelist combo for AGH probably wouldn't be worth the effort to suggest and hope for.

On the other hand, I'm currently testing out Block List Project: Ads, with good results so far.

@josephbu
Copy link

josephbu commented Oct 2, 2020

This list is being used by ublock origin to replace Malware domains list. The author also has an AGH specific list https://gitlab.com/curben/urlhaus-filter#domain-based-adguard-home

Based on my experience I would suggest using the "Lite version" of the URLhaus list, that version contains the current online domains/IPs only.

The full list results in false positives as it contains entries that once contained malware but may have been fixed 6 months or a year ago, but are still included in the list as historic.

@ameshkov
Copy link
Member Author

ameshkov commented Oct 5, 2020

One more interesting list - WindowsSpyBlocker - Hosts spy rules by @crazy-max
https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt

@DandelionSprout
Copy link
Member

DandelionSprout commented Oct 11, 2020

It is now reasonably safe to assume that no projects or lists made by Energized Protection should ever be included in AdGuard Home or any other AdGuard project, due to long-term negligence of reported problems by its one actual maintainer: https://github.com/EnergizedProtection/block/issues/562

Edit: Okay, so in my eagerness to point this out, I forgot I had essentially pointed out the same thing near-verbatim a month ago, although without a proper conclusive source at the time. My fault. 😅

@crazy-max
Copy link
Contributor

@ameshkov

One more interesting list - WindowsSpyBlocker - Hosts spy rules by @crazy-max
https://raw.githubusercontent.com/crazy-max/WindowsSpyBlocker/master/data/hosts/spy.txt

Feel free to get back to me if you use this list.

@ameshkov
Copy link
Member Author

One more interesting list:
https://github.com/jerryn70/GoodbyeAds

@uservictor
Copy link

This list is nice for blocking trackers.
https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-blocklist.txt

Have a nice day

@ghost
Copy link

ghost commented Dec 18, 2020

Developer Dan's Ads & Tracking

A programmatically expanded list of hosts used for advertisements and tracking. This is my primary list and I recommend using it. This list was last updated on December 18, 2020.

Website: https://www.github.developerdan.com/hosts/
List: https://www.github.developerdan.com/hosts/lists/ads-and-tracking-extended.txt

@ZeroClover
Copy link

The Malware Domain List vetted by AGH no longer appears to be valid.

https://www.malwaredomainlist.com/hostslist/hosts.txt

@ameshkov
Copy link
Member Author

ameshkov commented Jul 7, 2021

@DandelionSprout it resulted, we just create additional issues for actually adding or updating lists. This one is purely for discussion and suggestions.

@ainar-g ainar-g mentioned this issue Oct 1, 2021
@gyCfjSnO
Copy link

gyCfjSnO commented Oct 7, 2021

Problem Description

Have to manually find more lists, defaults aren't enough

Proposed Solution

Add lists that are green & bulleted with a tick from Firebog.net to the default "Choose from the list" option

https://v.firebog.net/hosts/lists.php?type=tick

@timkgh
Copy link

timkgh commented Oct 21, 2021

Could this data be incorporated into the default AG list or into a separate list?
EFF's Privacy Badger
https://github.com/EFForg/badger-sett
https://raw.githubusercontent.com/EFForg/badger-sett/master/results.json

@DandelionSprout
Copy link
Member

After doing some RegEx conversion testing of Privacy Badger's list, there are some problems with it, and the problems are pretty big at that, sadly.

They've set the list to block spotify.com and yahoo.com, while they've set it to allow adnuntius.com, in-appadvertising.com and exoticads.com. It also has the peculiar distinction of having more allowed domains than it has blocked domains.

@timkgh
Copy link

timkgh commented Oct 22, 2021

An allow list for affiliate links would be useful too, but we'd need a version of this that applies to subdomains too.
https://raw.githubusercontent.com/nextdns/metadata/master/privacy/affiliate-tracking-domains

@ghost
Copy link

ghost commented Oct 22, 2021

@timkgh, I have converted the A&T links list to AdGuard format, extended it with my own domains and use it in AdGuard Home: https://raw.githubusercontent.com/Zelo72/adguard/main/whitelist.referral.adguard

Feel free to use it, it will be updated regularly.

@timkgh
Copy link

timkgh commented Oct 23, 2021

@timkgh, I have converted the A&T links list to AdGuard format, extended it with my own domains and use it in AdGuard Home: https://raw.githubusercontent.com/Zelo72/adguard/main/whitelist.referral.adguard

Feel free to use it, it will be updated regularly.

@Zelo72 the converted list does not seem to allow subdomains, using the NextDNS list directly has the same problem. I think the converted version needs to use the @@||...^ syntax instead.
Update: Fixed. Thank you @Zelo72

@DandelionSprout
Copy link
Member

Apparently xorcan's Turkish list is gone. An apparent successor has been created: https://raw.githubusercontent.com/HuzunluArtemis/TurkishAdblockList/main/src/HostsList.txt

@gyCfjSnO
Copy link

Can we please have the ticked firebog lists added/vetted?

https://v.firebog.net/hosts/lists.php?type=tick

@Potterli20
Copy link

Potterli20 commented Jan 19, 2022

International/China accelerated ad filtering rules subscription.
国际/中国加速广告过滤规则订阅
Trli rules is the only global library that provides a complete set of rules, and the rules are updated 24 hours a day, probably starting at 0:00 US time.
冷莫(trli)的规则唯一一个提供全球比较全的库,规则是24小时更新,大概是第二天的从美国时间0点开始。

文件库:trli.coding.net/public
说明库:github.com/Potterli20/hosts
Library: trli.coding.net/public
That library: github.com/Potterli20/hosts

adguardhome:https://trli.coding.net/p/file/d/ad-hosts/git/lfs/master/ad-adguardhome.txt

allow:https://trli.coding.net/p/file/d/allow/git/lfs/master/allow.txt

The project is available globally and has been made out of a black and white list of global examples.
Of course, the blacklist has mistakenly killed the domain name processing.

@DandelionSprout
Copy link
Member

DandelionSprout commented Jan 19, 2022

My current understanding is that when it comes to lists that should be natively included in AGH as opt-ins, such requests are now supposed to be submitted to https://github.com/AdguardTeam/HostlistsRegistry, although it doesn't seem to me that that repository have taken effect in stable AdGuard versions yet.

For general simple suggestions, however, I can only presume that this thread is still the intended place.

@gyCfjSnO
Copy link

Can we look at adding some of the lists from Zelo72 https://github.com/Zelo72/adguard

@timkgh
Copy link

timkgh commented Feb 6, 2022

Can we look at adding some of the lists from Zelo72 https://github.com/Zelo72/adguard

Zelo72 seems to be gone, does anyone know what happened to him and whether there are replacements for this list? #1913 (comment)

@gyCfjSnO
Copy link

gyCfjSnO commented Feb 6, 2022

Can we look at adding some of the lists from Zelo72 https://github.com/Zelo72/adguard

Zelo72 seems to be gone, does anyone know what happened to him and whether there are replacements for this list? #1913 (comment)

Oh no! I really enjoyed using Zelo72's lists 🥲 I hope it's temporary.

@timkgh
Copy link

timkgh commented Aug 1, 2022

Can we look at adding some of the lists from Zelo72 https://github.com/Zelo72/adguard

Zelo72 seems to be gone, does anyone know what happened to him and whether there are replacements for this list? #1913 (comment)

Oh no! I really enjoyed using Zelo72's lists 🥲 I hope it's temporary.

The list is now https://raw.githubusercontent.com/hagezi/dns-blocklists/main/adblock/whitelist-referral.txt

@ainar-g
Copy link
Contributor

ainar-g commented Oct 21, 2022

Starting with AdGuard Home 0.107.17, AdGuard Home will use the Hostlists Registry as the source of its filtering rule lists. Please send your suggestions to that repo. See #3972. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests