1.1 KiB

Raw Permalink Blame History

Changelog

All notable changes to robots-txt will be documented in this file

2.0.1 - 2021-05-06

added x-robots-tag: none (#32)

2.0.0 - 2021-03-28

require PHP 8+
drop support for PHP 7.x
convert syntax to PHP 8
remove deprecated methods
use php-cs-fixer & github workflow

1.0.10 - 2020-12-08

handle multiple user-agent (#29)

1.0.9 - 2020-11-27

add support for PHP 8.0 + move to GitHub actions (#27)

1.0.8 - 2020-09-12

make user agent checks case-insensitive

1.0.7 - 2020-04-29

fix find robots meta tag line if minified code (#23)

1.0.6 - 2020-04-07

fix headers checking (nofollow, noindex) for custom userAgent (#21)

1.0.5 - 2019-08-08

improvements around handling of wildcards, end-of-string, query string

1.0.4 - 2019-08-07

improve readability

1.0.3 - 2019-03-11

fix parsing robotstxt urls with keywords (#14)

1.0.2 - 2019-01-11

make robots.txt check case insensitive

1.0.1 - 2018-05-07

prevent exception if the domain has no robots.txt

1.0.0 - 2018-05-07

initial release