Skip to content

kylerchin/actix_block_ai_crawling

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

30 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Block AI crawling in Actix

Crates link: https://crates.io/crates/actix_block_ai_crawling Docs link: https://docs.rs/actix_block_ai_crawling/latest/actix_block_ai_crawling/

This blocks any HTTP requests coming from a Generative AI crawler. It works by blocking matching User Agents including ChatGPT from OpenAI, Bard from Google, and the CC crawler dataset. It also blocks OpenAI's IP addresses.

It's extremely simple to use. Just add .wrap(actix_block_ai_crawling::BlockAi); to your app.

let app = App::new()
.wrap(actix_block_ai_crawling::BlockAi);

Pull requests are welcome! Please hand-write your code. AI written code is not welcome.

About

Block web ai scrapers

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages