Merge branch 'master' of https://github.com/itsadok/pyre2 into itsadok-master

Author: axiak

README.rst

@@ -47,6 +47,18 @@ And in the above example, ``set_fallback_notification`` can handle 3 values:
 ``re.FALLBACK_QUIETLY`` (default), ``re.FALLBACK_WARNING`` (raises a warning), and
 ``re.FALLBACK_EXCEPTION`` (which raises an exception).
 
+**Note**: The re2 module treats byte strings as UTF-8. This is fully backwards compatible with 7-bit ascii.
+However, bytes containing values larger than 0x7f are going to be treated very differently in re2 than in re.
+The RE library quietly ignores invalid utf8 in input strings, and throws an exception on invalid utf8 in patterns.
+For example:
+
+    >>> re.findall(r'.', '\x80\x81\x82')
+    ['\x80', '\x81', '\x82']
+    >>> re2.findall(r'.', '\x80\x81\x82')
+    []
+
+If you require the use of regular expressions over an arbitrary stream of bytes, then this library might not be for you.
+
 Installation
 ============
 

src/_re2.pxd

@@ -1,4 +1,3 @@
-
 cdef extern from *:
     ctypedef char* const_char_ptr "const char*"
 
@@ -11,7 +10,7 @@ cdef extern from "<string>" namespace "std":
         void push_back(char c)
 
     ctypedef string cpp_string "std::string"
-    ctypedef string const_string "std::string"
+    ctypedef string const_string "const std::string"