All notable changes to Tokenizer are documented in this file using the Keep a CHANGELOG principles.
- Removed the custom token
T_AMPERSANDas PHP 8.1+ provides tokens for it already and our 2.0.0 release overwrote it. See #44 for details.
This release bumps the minimum version required to PHP 8.1.
- New API
XMLSerializer::appendToWriterto allow easier integration and better performance when writing fragments (Thanks @staabm)
- Internal change: Now uses
PHPToken::tokenizein favor oftoken_get_all(requires PHP 8+) (Thanks @staabm)
1.3.1 - 2025-111-17
- #37: v1.3.0 introduced a breaking change on the token collection (ArrayAccess interface removed)
1.3.0 - 2025-11-13
- Require at least PHP 7.3 for building, code should still be PHP 7.2 compliant
- Merge various performance improvements provided by @staabm
- Merge some code cleanups provided by @staabm
1.2.3 - 2024-03-03
- Do not use implicitly nullable parameters
1.2.2 - 2023-11-20
- #18: Tokenizer fails on protobuf metadata files
1.2.1 - 2021-07-28
- #13: Fatal error when tokenizing files that contain only a single empty line
1.2.0 - 2020-07-13
This release is now PHP 8.0 compliant.
- Whitespace handling in general (only noticeable in the intermediate
TokenCollection) is now consistent
- Updated
Tokenizerto deal with changed whitespace handling in PHP 8.0 The XMLSerializer was unaffected.
1.1.3 - 2019-06-14
- Ensure XMLSerializer can deal with empty token collections
- #2: Fatal error in infection / phpunit
1.1.2 - 2019-04-04
- Reverted PHPUnit 8 test update to stay PHP 7.0 compliant
1.1.1 - 2019-04-03
- #1: Empty file causes invalid array read
- Tests should now be PHPUnit 8 compliant
1.1.0 - 2017-04-07
- Allow use of custom namespace for XML serialization
1.0.0 - 2017-04-05
Initial Release