TY - RPRT TI - Scrapers selectively respect robots.txt directives: evidence from a large-scale empirical study AU - Taein Kim AU - Karstan Bock AU - Claire Luo AU - Amanda Liswood AU - Chloe Poroslay AU - Emily Wenger PY - 2025 UR - https://arxiv.org/abs/2505.21733 ID - 2505.21733 ER -