Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(deps): update rust crate regex to v1 [security] #12378

Closed
wants to merge 1 commit into from

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Jul 19, 2023

Mend Renovate

This PR contains the following updates:

Package Type Update Change
regex dev-dependencies major 0.1.1 -> 1.5.5

⚠ Dependency Lookup Warnings ⚠

Warnings were logged while processing this repo. Please check the logs for more information.

GitHub Vulnerability Alerts

CVE-2022-24713

This is a cross-post of the official security advisory. The official advisory contains a signed version with our PGP key, as well.

The Rust Security Response WG was notified that the regex crate did not properly limit the complexity of the regular expressions (regex) it parses. An attacker could use this security issue to perform a denial of service, by sending a specially crafted regex to a service accepting untrusted regexes. No known vulnerability is present when parsing untrusted input with trusted regexes.

This issue has been assigned CVE-2022-24713. The severity of this vulnerability is "high" when the regex crate is used to parse untrusted regexes. Other uses of the regex crate are not affected by this vulnerability.

Overview

The regex crate features built-in mitigations to prevent denial of service attacks caused by untrusted regexes, or untrusted input matched by trusted regexes. Those (tunable) mitigations already provide sane defaults to prevent attacks. This guarantee is documented and it's considered part of the crate's API.

Unfortunately a bug was discovered in the mitigations designed to prevent untrusted regexes to take an arbitrary amount of time during parsing, and it's possible to craft regexes that bypass such mitigations. This makes it possible to perform denial of service attacks by sending specially crafted regexes to services accepting user-controlled, untrusted regexes.

Affected versions

All versions of the regex crate before or equal to 1.5.4 are affected by this issue. The fix is include starting from regex 1.5.5.

Mitigations

We recommend everyone accepting user-controlled regexes to upgrade immediately to the latest version of the regex crate.

Unfortunately there is no fixed set of problematic regexes, as there are practically infinite regexes that could be crafted to exploit this vulnerability. Because of this, we do not recommend denying known problematic regexes.

Acknowledgements

We want to thank Addison Crump for responsibly disclosing this to us according to the Rust security policy, and for helping review the fix.

We also want to thank Andrew Gallant for developing the fix, and Pietro Albini for coordinating the disclosure and writing this advisory.


Release Notes

rust-lang/regex (regex)

v1.5.5

Compare Source

==================
This releases fixes a security bug in the regex compiler. This bug permits a
vector for a denial-of-service attack in cases where the regex being compiled
is untrusted. There are no known problems where the regex is itself trusted,
including in cases of untrusted haystacks.

v1.5.4

Compare Source

==================
This release fixes another compilation failure when building regex. This time,
the fix is for when the pattern feature is enabled, which only works on
nightly Rust. CI has been updated to test this case.

  • BUG #​772:
    Fix build when pattern feature is enabled.

v1.5.3

Compare Source

==================
This releases fixes a bug when building regex with only the unicode-perl
feature. It turns out that while CI was building this configuration, it wasn't
actually failing the overall build on a failed compilation.

  • BUG #​769:
    Fix build in regex-syntax when only the unicode-perl feature is enabled.

v1.5.2

Compare Source

==================
This release fixes a performance bug when Unicode word boundaries are used.
Namely, for certain regexes on certain inputs, it's possible for the lazy DFA
to stop searching (causing a fallback to a slower engine) when it doesn't
actually need to.

PR #​768 fixes the bug, which was
originally reported in
ripgrep#1860.

v1.5.1

Compare Source

==================
This is a patch release that fixes a compilation error when the perf-literal
feature is not enabled.

v1.5.0

Compare Source

==================
This release primarily updates to Rust 2018 (finally) and bumps the MSRV to
Rust 1.41 (from Rust 1.28). Rust 1.41 was chosen because it's still reasonably
old, and is what's in Debian stable at the time of writing.

This release also drops this crate's own bespoke substring search algorithms
in favor of a new
memmem implementation provided by the memchr crate.
This will change the performance profile of some regexes, sometimes getting a
little worse, and hopefully more frequently, getting a lot better. Please
report any serious performance regressions if you find them.

v1.4.6

Compare Source

==================
This is a small patch release that fixes the compiler's size check on how much
heap memory a regex uses. Previously, the compiler did not account for the
heap usage of Unicode character classes. Now it does. It's possible that this
may make some regexes fail to compile that previously did compile. If that
happens, please file an issue.

v1.4.5

Compare Source

==================
This is a small patch release that fixes a regression in the size of a Regex
in the 1.4.4 release. Prior to 1.4.4, a Regex was 552 bytes. In the 1.4.4
release, it was 856 bytes due to internal changes. In this release, a Regex
is now 16 bytes. In general, the size of a Regex was never something that was
on my radar, but this increased size in the 1.4.4 release seems to have crossed
a threshold and resulted in stack overflows in some programs.

  • BUG #​750:
    Fixes stack overflows seemingly caused by a large Regex size by decreasing
    its size.

v1.4.4

Compare Source

==================
This is a small patch release that contains some bug fixes. Notably, it also
drops the thread_local (and lazy_static, via transitivity) dependencies.

Bug fixes:

  • BUG #​362:
    Memory leaks caused by an internal caching strategy should now be fixed.
  • BUG #​576:
    All regex types now implement UnwindSafe and RefUnwindSafe.
  • BUG #​728:
    Add missing Replacer impls for Vec<u8>, String, Cow, etc.

v1.4.3

Compare Source

==================
This is a small patch release that adds some missing standard trait
implementations for some types in the public API.

Bug fixes:

  • BUG #​734:
    Add FusedIterator and ExactSizeIterator impls to iterator types.
  • BUG #​735:
    Add missing Debug impls to public API types.

v1.4.2

Compare Source

==================
This is a small bug fix release that bans \P{any}. We previously banned empty
classes like [^\w\W], but missed the \P{any} case. In the future, we hope
to permit empty classes.

  • BUG #​722:
    Ban \P{any} to avoid a panic in the regex compiler. Found by OSS-Fuzz.

v1.4.1

Compare Source

==================
This is a small bug fix release that makes \p{cf} work. Previously, it would
report "property not found" even though cf is a valid abbreviation for the
Format general category.

  • BUG #​719:
    Fixes bug that prevented \p{cf} from working.

v1.4.0

Compare Source

==================
This releases has a few minor documentation fixes as well as some very minor
API additions. The MSRV remains at Rust 1.28 for now, but this is intended to
increase to at least Rust 1.41.1 soon.

This release also adds support for OSS-Fuzz. Kudos to
@​DavidKorczynski
for doing the heavy lifting for that!

New features:

Bug fixes:

  • BUG #​694:
    Fix doc example for Replacer::replace_append.
  • BUG #​698:
    Clarify docs for s flag when using a bytes::Regex.
  • BUG #​711:
    Clarify is_match docs to indicate that it can match anywhere in string.

v1.3.9

Compare Source

==================
This release fixes a MSRV (Minimum Support Rust Version) regression in the
1.3.8 release. Namely, while 1.3.8 compiles on Rust 1.28, it actually does not
compile on other Rust versions, such as Rust 1.39.

Bug fixes:

  • BUG #​685:
    Remove use of doc_comment crate, which cannot be used before Rust 1.43.

v1.3.8

Compare Source

==================
This release contains a couple of important bug fixes driven
by better support for empty-subexpressions in regexes. For
example, regexes like b| are now allowed. Major thanks to
@​sliquister for implementing support for this
in #​677.

Bug fixes:

  • BUG #​523:
    Add note to documentation that spaces can be escaped in x mode.
  • BUG #​524:
    Add support for empty sub-expressions, including empty alternations.
  • BUG #​659:
    Fix match bug caused by an empty sub-expression miscompilation.

v1.3.7

Compare Source

==================
This release contains a small bug fix that fixes how regex forwards crate
features to regex-syntax. In particular, this will reduce recompilations in
some cases.

Bug fixes:

v1.3.6

Compare Source

==================
This release contains a sizable (~30%) performance improvement when compiling
some kinds of large regular expressions.

Performance improvements:

  • PERF #​657:
    Improvement performance of compiling large regular expressions.

v1.3.5

Compare Source

==================
This release updates this crate to Unicode 13.

New features:

v1.3.4

Compare Source

==================
This is a small bug fix release that fixes a bug related to the scoping of
flags in a regex. Namely, before this fix, a regex like ((?i)a)b) would
match aB despite the fact that b should not be matched case insensitively.

Bug fixes:

  • BUG #​640:
    Fix bug related to the scoping of flags in a regex.

v1.3.3

Compare Source

==================
This is a small maintenance release that upgrades the dependency on
thread_local from 0.3 to 1.0. The minimum supported Rust version remains
at Rust 1.28.

v1.3.2

Compare Source

==================
This is a small maintenance release with some house cleaning and bug fixes.

New features:

  • FEATURE #​631:
    Add a Match::range method an a From<Match> for Range impl.

Bug fixes:

  • BUG #​521:
    Corrects /-/.splitn("a", 2) to return ["a"] instead of ["a", ""].
  • BUG #​594:
    Improve error reporting when writing \p\.
  • BUG #​627:
    Corrects /-/.split("a-") to return ["a", ""] instead of ["a"].
  • BUG #​633:
    Squash deprecation warnings for the std::error::Error::description method.

v1.3.1

Compare Source

==================
This is a maintenance release with no changes in order to try to work-around
a docs.rs/Cargo issue.

v1.3.0

Compare Source

==================
This release adds a plethora of new crate features that permit users of regex
to shrink its size considerably, in exchange for giving up either functionality
(such as Unicode support) or runtime performance. When all such features are
disabled, the dependency tree for regex shrinks to exactly 1 crate
(regex-syntax). More information about the new crate features can be
found in the docs.

Note that while this is a new minor version release, the minimum supported
Rust version for this crate remains at 1.28.0.

New features:

  • FEATURE #​474:
    The use_std feature has been deprecated in favor of the std feature.
    The use_std feature will be removed in regex 2. Until then, use_std will
    remain as an alias for the std feature.
  • FEATURE #​583:
    Add a substantial number of crate features shrinking regex.

v1.2.1

Compare Source

==================
This release does a bit of house cleaning. Namely:

  • This repository is now using rustfmt.
  • License headers have been removed from all files, in following suit with the
    Rust project.
  • Teddy has been removed from the regex crate, and is now part of the
    aho-corasick crate.
    See aho-corasick's new packed sub-module for details.
  • The utf8-ranges crate has been deprecated, with its functionality moving
    into the
    utf8 sub-module of regex-syntax.
  • The ucd-util dependency has been dropped, in favor of implementing what
    little we need inside of regex-syntax itself.

In general, this is part of an ongoing (long term) effort to make optimizations
in the regex engine easier to reason about. The current code is too convoluted
and thus it is very easy to introduce new bugs. This simplification effort is
the primary motivation behind re-working the aho-corasick crate to not only
bundle algorithms like Teddy, but to also provide regex-like match semantics
automatically.

Moving forward, the plan is to join up with the bstr and regex-automata
crates, with the former providing more sophisticated substring search
algorithms (thereby deleting existing code in regex) and the latter providing
ahead-of-time compiled DFAs for cases where they are inexpensive to compute.

v1.2.0

Compare Source

==================
This release updates regex's minimum supported Rust version to 1.28, which was
release almost 1 year ago. This release also updates regex's Unicode data
tables to 12.1.0.

v1.1.9

Compare Source

==================
This release contains a bug fix that caused regex's tests to fail, due to a
dependency on an unreleased behavior in regex-syntax.

  • BUG #​593:
    Move an integration-style test on error messages into regex-syntax.

v1.1.8

Compare Source

==================
This release contains a few small internal refactorings. One of which fixes
an instance of undefined behavior in a part of the SIMD code.

Bug fixes:

  • BUG #​545:
    Improves error messages when a repetition operator is used without a number.
  • BUG #​588:
    Removes use of a repr(Rust) union used for type punning in the Teddy matcher.
  • BUG #​591:
    Update docs for running benchmarks and improve failure modes.

v1.1.7

Compare Source

==================
This release fixes up a few warnings as a result of recent deprecations.

v1.1.6

Compare Source

==================
This release fixes a regression introduced by a bug fix (for
BUG #​557) which could cause
the regex engine to enter an infinite loop. This bug was originally
reported against ripgrep.

v1.1.5

Compare Source

==================
This release fixes a bug in regex's dependency specification where it requires
a newer version of regex-syntax, but this wasn't communicated correctly in the
Cargo.toml. This would have been caught by a minimal version check, but this
check was disabled because the rand crate itself advertises incorrect
dependency specifications.

Bug fixes:

v1.1.4

Compare Source

==================
This release fixes a backwards compatibility regression where Regex was no
longer UnwindSafe. This was caused by the upgrade to aho-corasick 0.7, whose
AhoCorasick type was itself not UnwindSafe. This has been fixed in aho-corasick
0.7.4, which we now require.

Bug fixes:

  • BUG #​568:
    Fix an API regression where Regex was no longer UnwindSafe.

v1.1.3

Compare Source

==================
This releases fixes a few bugs and adds a performance improvement when a regex
is a simple alternation of literals.

Performance improvements:

  • OPT #​566:
    Upgrades aho-corasick to 0.7 and uses it for foo|bar|...|quux regexes.

Bug fixes:

  • BUG #​527:
    Fix a bug where the parser would panic on patterns like ((?x)).
  • BUG #​555:
    Fix a bug where the parser would panic on patterns like (?m){1,1}.
  • BUG #​557:
    Fix a bug where captures could lead to an incorrect match.

v1.1.2

Compare Source

==================
This release fixes a bug found in the fix introduced in 1.1.1.

Bug fixes:

  • BUG edf45e6f:
    Fix bug introduced in reverse suffix literal matcher in the 1.1.1 release.

v1.1.1

Compare Source

==================
This is a small release with one fix for a bug caused by literal optimizations.

Bug fixes:

v1.1.0

Compare Source

==================
This is a small release with a couple small enhancements. This release also
increases the minimal supported Rust version (MSRV) to 1.24.1 (from 1.20.0). In
accordance with this crate's MSRV policy, this release bumps the minor version
number.

Performance improvements:

New features:

Bug fixes:

  • BUG #​530:
    Add Unicode license (for data tables).
  • Various typo/doc fixups.

v1.0.6

Compare Source

==================
This is a small release.

Performance improvements:

  • OPT #​513:
    Improve performance of compiling large Unicode classes by 8-10%.

Bug fixes:

  • BUG #​533:
    Fix definition of [[:blank:]] class that regressed in regex-syntax 0.5.

v1.0.5

Compare Source

==================
This is a small release with an API enhancement.

New features:

v1.0.4

Compare Source

==================
This is a small release that bumps the quickcheck dependency.

v1.0.3

Compare Source

==================
This is a small bug fix release.

Bug fixes:

v1.0.2

Compare Source

==================
This release exposes some new lower level APIs on Regex that permit
amortizing allocation and controlling the location at which a search is
performed in a more granular way. Most users of the regex crate will not
need or want to use these APIs.

New features:

  • FEATURE #​493:
    Add a few lower level APIs for amortizing allocation and more fine grained
    searching.

Bug fixes:

  • BUG 3981d2ad:
    Correct outdated documentation on RegexBuilder::dot_matches_new_line.
  • BUG 7ebe4ae0:
    Correct outdated documentation on Parser::allow_invalid_utf8 in the
    regex-syntax crate.
  • BUG 24c7770b:
    Fix a bug in the HIR printer where it wouldn't correctly escape meta
    characters in character classes.

v1.0.1

Compare Source

==================
This release upgrades regex's Unicode tables to Unicode 11, and enables SIMD
optimizations automatically on Rust stable (1.27 or newer).

New features:

  • FEATURE #​486:
    Implement size_hint on RegexSet match iterators.
  • FEATURE #​488:
    Update Unicode tables for Unicode 11.
  • FEATURE #​490:
    SIMD optimizations are now enabled automatically in Rust stable, for versions
    1.27 and up. No compilation flags or features need to be set. CPU support
    SIMD is detected automatically at runtime.

Bug fixes:

  • BUG #​482:
    Present a better compilation error when the use_std feature isn't used.

v1.0.0

Compare Source

==================
This release marks the 1.0 release of regex.

While this release includes some breaking changes, most users of older versions
of the regex library should be able to migrate to 1.0 by simply bumping the
version number. The important changes are as follows:

  • We adopt Rust 1.20 as the new minimum supported version of Rust for regex.
    We also tentativley adopt a policy that permits bumping the minimum supported
    version of Rust in minor version releases of regex, but no patch releases.
    That is, with respect to semver, we do not strictly consider bumping the
    minimum version of Rust to be a breaking change, but adopt a conservative
    stance as a compromise.
  • Octal syntax in regular expressions has been disabled by default. This
    permits better error messages that inform users that backreferences aren't
    available. Octal syntax can be re-enabled via the corresponding option on
    RegexBuilder.
  • (?-u:\B) is no longer allowed in Unicode regexes since it can match at
    invalid UTF-8 code unit boundaries. (?-u:\b) is still allowed in Unicode
    regexes.
  • The From<regex_syntax::Error> impl has been removed. This formally removes
    the public dependency on regex-syntax.
  • A new feature, use_std, has been added and enabled by default. Disabling
    the feature will result in a compilation error. In the future, this may
    permit us to support no_std environments (w/ alloc) in a backwards
    compatible way.

For more information and discussion, please see
1.0 release tracking issue.

v0.2.11

Compare Source

===================
This release primarily contains bug fixes. Some of them resolve bugs where
the parser could panic.

New features:

  • FEATURE #​459:
    Include C++'s standard regex library and Boost's regex library in the
    benchmark harness. We now include D/libphobos, C++/std, C++/boost, Oniguruma,
    PCRE1, PCRE2, RE2 and Tcl in the harness.

Bug fixes:

  • BUG #​445:
    Clarify order of indices returned by RegexSet match iterator.
  • BUG #​461:
    Improve error messages for invalid regexes like [\d-a].
  • BUG #​464:
    Fix a bug in the error message pretty printer that could cause a panic when
    a regex contained a literal \n character.
  • BUG #​465:
    Fix a panic in the parser that was caused by applying a repetition operator
    to (?flags).
  • BUG #​466:
    Fix a bug where \pC was not recognized as an alias for \p{Other}.
  • BUG #​470:
    Fix a bug where literal searches did more work than necessary for anchored
    regexes.

v0.2.10

Compare Source

===================
This release primarily updates the regex crate to changes made in std::arch
on nightly Rust.

New features:

v0.2.9

Compare Source

==================
This release introduces a new nightly only feature, unstable, which enables
SIMD optimizations for certain types of regexes. No additional compile time
options are necessary, and the regex crate will automatically choose the
best CPU features at run time. As a result, the simd (nightly only) crate
dependency has been dropped.

New features:

  • FEATURE #​456:
    The regex crate now includes AVX2 optimizations in addition to the extant
    SSSE3 optimization.

Bug fixes:

  • BUG #​455:
    Fix a bug where (?x)[ / - ] failed to parse.

v0.2.8

Compare Source

==================
Bug gixes:

  • BUG #​454:
    Fix a bug in the nest limit checker being too aggressive.

v0.2.7

Compare Source

==================
This release includes a ground-up rewrite of the regex-syntax crate, which has
been in development for over a year.
731
New features:

  • Error messages for invalid regexes have been greatly improved. You get these
    automatically; you don't need to do anything. In addition to better
    formatting, error messages will now explicitly call out the use of look
    around. When regex 1.0 is released, this will happen for backreferences as
    well.
  • Full support for intersection, difference and symmetric difference of
    character classes. These can be used via the &&, -- and ~~ binary
    operators within classes.
  • A Unicode Level 1 conformat implementation of \p{..} character classes.
    Things like \p{scx:Hira}, \p{age:3.2} or \p{Changes_When_Casefolded}
    now work. All property name and value aliases are supported, and properties
    are selected via loose matching. e.g., \p{Greek} is the same as
    \p{G r E e K}.
  • A new UNICODE.md document has been added to this repository that
    exhaustively documents support for UTS#18.
  • Empty sub-expressions are now permitted in most places. That is, ()+ is
    now a valid regex.
  • Almost everything in regex-syntax now uses constant stack space, even when
    performing analysis that requires structural induction. This reduces the risk
    of a user provided regular expression causing a stack overflow.
  • FEATURE #​174:
    The Ast type in regex-syntax now contains span information.
  • FEATURE #​424:
    Support \u, \u{...}, \U and \U{...} syntax for specifying code points
    in a regular expression.
  • FEATURE #​449:
    Add a Replace::by_ref adapter for use of a replacer without consuming it.

Bug fixes:

  • BUG #​446:
    We re-enable the Boyer-Moore literal matcher.

v0.2.6

Compare Source

==================
Bug fixes:

  • BUG #​446:
    Fixes a bug in the new Boyer-Moore searcher that results in a match failure.
    We fix this bug by temporarily disabling Boyer-Moore.

v0.2.5

Compare Source

==================
Bug fixes:

  • BUG #​437:
    Fixes a bug in the new Boyer-Moore searcher that results in a panic.

v0.2.4

Compare Source

==================
New features:

Bug fixes:

  • BUG:
    The regex compiler plugin has been removed.
  • BUG:
    simd has been bumped to 0.2.1, which fixes a Rust nightly build error.
  • BUG:
    Bring the benchmark harness up to date.

v0.2.3

Compare Source

==================
New features:

Bug fixes:

v0.2.2

Compare Source

==================
New features:

  • FEATURE #​341:
    Support nested character classes and intersection operation.
    For example, [\p{Greek}&&\pL] matches greek letters and
    [[0-9]&&[^4]] matches every decimal digit except 4.
    (Much thanks to @​robinst, who contributed this awesome feature.)

Bug fixes:

  • BUG #​321:
    Fix bug in literal extraction and UTF-8 decoding.
  • BUG #​326:
    Add documentation tip about the (?x) flag.
  • BUG #​333:
    Show additional replacement example using curly braces.
  • BUG #​334:
    Fix bug when resolving captures after a match.
  • BUG #​338:
    Add example that uses Captures::get to API documentation.
  • BUG #​353:
    Fix RegexSet bug that caused match failure in some cases.
  • BUG #​354:
    Fix panic in parser when (?x) is used.
  • BUG #​358:
    Fix literal optimization bug with RegexSet.
  • BUG #​359:
    Fix example code in README.
  • BUG #​365:
    Fix bug in rure_captures_len in the C binding.
  • BUG #​367:
    Fix byte class bug that caused a panic.

v0.2.1

Compare Source

===================
This release primarily contains bug fixes. Some of them resolve bugs where
the parser could panic.

New features:

  • FEATURE #​459:
    Include C++'s standard regex library and Boost's regex library in the
    benchmark harness. We now include D/libphobos, C++/std, C++/boost, Oniguruma,
    PCRE1, PCRE2, RE2 and Tcl in the harness.

Bug fixes:

  • BUG #​445:
    Clarify order of indices returned by RegexSet match iterator.
  • BUG #​461:
    Improve error messages for invalid regexes like [\d-a].
  • BUG #​464:
    Fix a bug in the error message pretty printer that could cause a panic when
    a regex contained a literal \n character.
  • BUG #​465:
    Fix a panic in the parser that was caused by applying a repetition operator
    to (?flags).
  • BUG #​466:
    Fix a bug where \pC was not recognized as an alias for \p{Other}.
  • BUG #​470:
    Fix a bug where literal searches did more work than necessary for anchored
    regexes.

v0.2.0

Compare Source

=====
This is a new major release of the regex crate, and is an implementation of the
regex 1.0 RFC.
We are releasing a 0.2 first, and if there are no major problems, we will
release a 1.0 shortly. For 0.2, the minimum supported Rust version is
1.12.

There are a number of breaking changes in 0.2. They are split into two
types. The first type correspond to breaking changes in regular expression
syntax. The second type correspond to breaking changes in the API.

Breaking changes for regex syntax:

  • POSIX character classes now require double bracketing. Previously, the regex
    [:upper:] would parse as the upper POSIX character class. Now it parses
    as the character class containing the characters :upper:. The fix to this
    change is to use [[:upper:]] instead. Note that variants like
    [[:upper:][:blank:]] continue to work.
  • The character [ must always be escaped inside a character class.
  • The characters &, - and ~ must be escaped if any one of them are
    repeated consecutively. For example, [&], [\&], [\&\&], [&-&] are all
    equivalent while [&&] is illegal. (The motivation for this and the prior
    change is to provide a backwards compatible path for adding character class
    set notation.)
  • A bytes::Regex now has Unicode mode enabled by default (like the main
    Regex type). This means regexes compiled with bytes::Regex::new that
    don't have the Unicode flag set should add (?-u) to recover the original
    behavior.

Breaking changes for the regex API:

  • find and find_iter now return Match values instead of
    (usize, usize).
    Match values have start and end methods, which
    return the match offsets. Match values also have an as_str method,
    which returns the text of the match itself.
  • The Captures type now only provides a single iterator over all capturing
    matches, which should replace uses of iter and iter_pos. Uses of
    iter_named should use the capture_names method on Regex.
  • The at method on the Captures type has been renamed to get, and it
    now returns a Match. Similarly, the name method on Captures now returns
    a Match.
  • The replace methods now return Cow values. The Cow::Borrowed variant
    is returned when no replacements are made.
  • The Replacer trait has been completely overhauled. This should only
    impact clients that implement this trait explicitly. Standard uses of
    the replace methods should continue to work unchanged. If you implement
    the Replacer trait, please consult the new documentation.
  • The quote free function has been renamed to escape.
  • The Regex::with_size_limit method has been removed. It is replaced by
    RegexBuilder::size_limit.
  • The RegexBuilder type has switched from owned self method receivers to
    &mut self method receivers. Most uses will continue to work unchanged, but
    some code may require naming an intermediate variable to hold the builder.
  • The compile method on RegexBuilder has been renamed to build.
  • The free is_match function has been removed. It is replaced by compiling
    a Regex and calling its is_match method.
  • The PartialEq and Eq impls on Regex have been dropped. If you relied
    on these impls, the fix is to define a wrapper type around Regex, impl
    Deref on it and provide the necessary impls.
  • The is_empty method on Captures has been removed. This always returns
    false, so its use is superfluous.
  • The Syntax variant of the Error type now contains a string instead of
    a regex_syntax::Error. If you were examining syntax errors more closely,
    you'll need to explicitly use the regex_syntax crate to re-parse the regex.
  • The InvalidSet variant of the Error type has been removed since it is
    no longer used.
  • Most of the iterator types have been renamed to match conventions. If you
    were using these iterator types explicitly, please consult the documentation
    for its new name. For example, RegexSplits has been renamed to Split.

A number of bugs have been fixed:

  • BUG #​151:
    The Replacer trait has been changed to permit the caller to control
    allocation.
  • BUG #​165:
    Remove the free is_match function.
  • BUG #​166:
    Expose more knobs (available in 0.1) and remove with_size_limit.
  • BUG #​168:
    Iterators produced by Captures now have the correct lifetime parameters.
  • BUG #​175:
    Fix a corner case in the parsing of POSIX character classes.
  • BUG #​178:
    Drop the PartialEq and Eq impls on Regex.
  • BUG #​179:
    Remove is_empty from Captures since it always returns false.
  • BUG #​276:
    Position of named capture can now be retrieved from a Captures.
  • BUG #​296:
    Remove winapi/kernel32-sys dependency on UNIX.
  • BUG #​307:
    Fix error on emscripten.

v0.1.80

Compare Source

======

v0.1.79

Compare Source

======

  • Require regex-syntax 0.3.8.

v0.1.78

Compare Source

======

  • PR #​290:
    Fixes bug #​289, which caused some regexes with a certain combination
    of literals to match incorrectly.

v0.1.77

Compare Source

======

  • PR #​281:
    Fixes bug #​280 by disabling all literal optimizations when a pattern
    is partially anchored.

v0.1.76

Compare Source

======

  • Tweak criteria for using the Teddy literal matcher.

v0.1.75

Compare Source

======

  • PR #​275:
    Improves match verification performance in the Teddy SIMD searcher.
  • PR #​278:
    Replaces slow substring loop in the Teddy SIMD searcher with Aho-Corasick.
  • Implemented DoubleEndedIterator on regex set match iterators.

v0.1.74

Compare Source

======

  • Release regex-syntax 0.3.5 with a minor bug fix.
  • Fix bug #​272.
  • Fix bug #​277.
  • PR #​270:
    Fixes bugs #​264, #​268 and an unreported where the DFA cache size could be
    drastically under estimated in some cases (leading to high unexpected memory
    usage).

v0.1.73

Compare Source

======

  • Release regex-syntax 0.3.4.
  • Bump regex-syntax dependency version for regex to 0.3.4.

v0.1.72

Compare Source

======

  • PR #​262:
    Fixes a number of small bugs caught by fuzz testing (AFL).

v0.1.71

Compare Source

======

  • PR #​236:
    Fix a bug in how suffix literals were extracted, which could lead
    to invalid match behavior in some cases.

v0.1.70

Compare Source

======

  • PR #​231:
    Add SIMD accelerated multiple pattern search.
  • PR #​228:
    Reintroduce the reverse suffix literal optimization.
  • PR #​226:
    Implements NFA state compression in the lazy DFA.
  • PR #​223:
    A fully anchored RegexSet can now short-circuit.

v0.1.69

Compare Source

======

  • PR #​216:
    Tweak the threshold for running backtracking.
  • PR #​217:
    Add upper limit (from the DFA) to capture search (for the NFA).
  • PR #​218:
    Add rure, a C API.

v0.1.68

Compare Source

======

  • PR #​210:
    Fixed a performance bug in bytes::Regex::replace where extend was used
    instead of extend_from_slice.
  • PR #​211:
    Fixed a bug in the handling of word boundaries in the DFA.
  • PR #​213:
    Added RE2 and Tcl to the benchmark harness. Also added a CLI utility from
    running regexes using any of the following regex engines: PCRE1, PCRE2,
    Oniguruma, RE2, Tcl and of course Rust's own regexes.

v0.1.67

Compare Source

======

  • PR #​201:
    Fix undefined behavior in the regex! compiler plugin macro.
  • PR #​205:
    More improvements to DFA performance. Competitive with RE2. See PR for
    benchmarks.
  • PR #​209:
    Release 0.1.66 was semver incompatible since it required a newer version
    of Rust than previous releases. This PR fixes that. (And 0.1.66 was
    yanked.)

v0.1.66

Compare Source

======

  • Speculative support for Unicode word boundaries was added to the DFA. This
    should remove the last common case that disqualified use of the DFA.
  • An optimization that scanned for suffix literals and then matched the regular
    expression in reverse was removed because it had worst case quadratic time
    complexity. It was replaced with a more limited optimization where, given any
    regex of the form re$, it will be matched in reverse from the end of the
    haystack.
  • PR #​202:
    The inner loop of the DFA was heavily optimized to improve cache locality
    and reduce the overall number of instructions run on each iteration. This
    represents the first use of unsafe in regex (to elide bounds checks).
  • PR #​200:
    Use of the mempool crate (which used thread local storage) was replaced
    with a faster version of a similar API in @​Amanieu's thread_local crate.
    It should reduce contention when using a regex from multiple threads
    simultaneously.
  • PCRE2 JIT benchmarks were added. A benchmark comparison can be found
    here.
    (Includes a comparison with PCRE1's JIT and Oniguruma.)
  • A bug where word boundaries weren't being matched correctly in the DFA was
    fixed. This only affected use of bytes::Regex.
  • #​160:
    Captures now has a Debug impl.

v0.1.65

Compare Source

v0.1.64

Compare Source

v0.1.63

Compare Source

v0.1.62

Compare Source

v0.1.61

Compare Source

v0.1.60

Compare Source

v0.1.59

Compare Source

v0.1.58

Compare Source

v0.1.57

[Compare Source](https://github.com/rust-lang/regex/compare/0.1.56


Configuration

📅 Schedule: Branch creation - "" (UTC), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR has been generated by Mend Renovate. View repository job log here.

@renovate
Copy link
Contributor Author

renovate bot commented Jul 19, 2023

⚠ Artifact update problem

Renovate failed to update artifacts related to this branch. You probably do not want to merge this PR as-is.

♻ Renovate will retry this branch, including artifacts, only when one of the following happens:

  • any of the package files in this branch needs updating, or
  • the branch becomes conflicted, or
  • you click the rebase/retry checkbox if found above, or
  • you rename this PR's title to start with "rebase!" to trigger it manually

The artifact failure details are included below:

File name: Cargo.lock
Command failed: docker run --rm --name=renovate_a_sidecar --label=renovate_a_child --memory=3584m -v "/tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo":"/tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo" -v "/tmp/worker/e191d6/1b27eb/cache":"/tmp/worker/e191d6/1b27eb/cache" -e CONTAINERBASE_CACHE_DIR -w "/tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo" ghcr.io/containerbase/sidecar:9.5.2 bash -l -c "install-tool rust 1.71.0 && cargo update --manifest-path tests/testsuite/cargo_remove/remove-target.in/Cargo.toml --workspace"
/usr/local/bin/docker: line 4: .: filename argument required
.: usage: . filename [arguments]
install: WARNING: failed to run ldconfig. this may happen when not installing as root. run with --verbose to see the error
error: current package believes it's in a workspace when it's not:
current:   /tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo/tests/testsuite/cargo_remove/remove-target.in/Cargo.toml
workspace: /tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo/Cargo.toml

this may be fixable by adding `tests/testsuite/cargo_remove/remove-target.in` to the `workspace.members` array of the manifest located at: /tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo/Cargo.toml
Alternatively, to keep it out of the workspace, add the package to the `workspace.exclude` array, or add an empty `[workspace]` table to the package's manifest.

File name: Cargo.lock
Command failed: docker run --rm --name=renovate_a_sidecar --label=renovate_a_child --memory=3584m -v "/tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo":"/tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo" -v "/tmp/worker/e191d6/1b27eb/cache":"/tmp/worker/e191d6/1b27eb/cache" -e CONTAINERBASE_CACHE_DIR -w "/tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo" ghcr.io/containerbase/sidecar:9.5.2 bash -l -c "install-tool rust 1.71.0 && cargo update --manifest-path tests/testsuite/cargo_remove/remove-basic.in/Cargo.toml --workspace"
/usr/local/bin/docker: line 4: .: filename argument required
.: usage: . filename [arguments]
install: WARNING: failed to run ldconfig. this may happen when not installing as root. run with --verbose to see the error
error: current package believes it's in a workspace when it's not:
current:   /tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo/tests/testsuite/cargo_remove/remove-basic.in/Cargo.toml
workspace: /tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo/Cargo.toml

this may be fixable by adding `tests/testsuite/cargo_remove/remove-basic.in` to the `workspace.members` array of the manifest located at: /tmp/worker/e191d6/1b27eb/repos/github/rust-lang/cargo/Cargo.toml
Alternatively, to keep it out of the workspace, add the package to the `workspace.exclude` array, or add an empty `[workspace]` table to the package's manifest.

@rustbot
Copy link
Collaborator

rustbot commented Jul 19, 2023

Thanks for the pull request, and welcome! The Rust team is excited to review your changes, and you should hear from @epage (or someone else) soon.

Please see the contribution instructions for more information. Namely, in order to ensure the minimum review times lag, PR authors and assigned reviewers should ensure that the review label (S-waiting-on-review and S-waiting-on-author) stays updated, invoking these commands when appropriate:

  • @rustbot author: the review is finished, PR author should check the comments and take action accordingly
  • @rustbot review: the author is ready for a review, this PR will be queued again in the reviewer's queue

@rustbot rustbot added the S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. label Jul 19, 2023
Copy link
Member

@weihanglo weihanglo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh nice. First false positive 😆.

Maybe we should change to use empty-library instead.

epage added a commit to epage/cargo that referenced this pull request Jul 19, 2023
Inspired by rust-lang#12378

There is a preset for ignores but I feel like we'd more likely want to
be able to easily see whats actuazlly ignored.
@epage epage closed this Jul 19, 2023
@epage epage deleted the renovate/crate-regex-vulnerability branch July 19, 2023 13:43
@renovate
Copy link
Contributor Author

renovate bot commented Jul 19, 2023

Renovate Ignore Notification

Because you closed this PR without merging, Renovate will ignore this update. You will not get PRs for any future 1.x releases. But if you manually upgrade to 1.x then Renovate will re-enable minor and patch updates automatically.

If you accidentally closed this PR, or if you changed your mind: rename this PR to get a fresh replacement PR.

bors added a commit that referenced this pull request Jul 19, 2023
chore: Don't update test data

Inspired by #12378

There is a preset for ignores but I feel like we'd more likely want to be able to easily see whats actuazlly ignored.
bors added a commit that referenced this pull request Jul 19, 2023
chore: Don't update test data

Inspired by #12378

There is a preset for ignores but I feel like we'd more likely want to be able to easily see whats actuazlly ignored.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
S-waiting-on-review Status: Awaiting review from the assignee but also interested parties.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants