| commit | e66381d42467b6e46b8f265bb28f518ae508259c | [log] [tgz] |
|---|---|---|
| author | James Farrell <jamesfarrell@google.com> | Wed Sep 18 20:37:06 2024 +0000 |
| committer | James Farrell <jamesfarrell@google.com> | Wed Sep 18 20:37:06 2024 +0000 |
| tree | 51618264976904c2126fec07194010352cd58915 | |
| parent | 717e7ee187536930f1371e77e3e0db4c31c4528a [diff] |
Migrate 26 crates to monorepo tokio-util tower tower-layer tower-service tracing tracing-attributes tracing-core tracing-subscriber try-lock tungstenite twox-hash ucd-trie unicode-bidi unicode-normalization unicode-segmentation unicode-width unsafe-libyaml userfaultfd utf-8 uuid weak-table webpki which winnow x509-cert xml-rs Bug: http://b/339424309 Test: treehugger Change-Id: I21d241495d9e2c44a62a70c9b0ca91d5d173e3a1
Iterators which split strings on Grapheme Cluster or Word boundaries, according to the Unicode Standard Annex #29 rules.
use unicode_segmentation::UnicodeSegmentation; fn main() { let s = "a̐éö̲\r\n"; let g = s.graphemes(true).collect::<Vec<&str>>(); let b: &[_] = &["a̐", "é", "ö̲", "\r\n"]; assert_eq!(g, b); let s = "The quick (\"brown\") fox can't jump 32.3 feet, right?"; let w = s.unicode_words().collect::<Vec<&str>>(); let b: &[_] = &["The", "quick", "brown", "fox", "can't", "jump", "32.3", "feet", "right"]; assert_eq!(w, b); let s = "The quick (\"brown\") fox"; let w = s.split_word_bounds().collect::<Vec<&str>>(); let b: &[_] = &["The", " ", "quick", " ", "(", "\"", "brown", "\"", ")", " ", " ", "fox"]; assert_eq!(w, b); }
unicode-segmentation does not depend on libstd, so it can be used in crates with the #![no_std] attribute.
You can use this package in your project by adding the following to your Cargo.toml:
[dependencies] unicode-segmentation = "1.10.1"
GraphemeCursor API allows random access and bidirectional iteration.as_str methods to the iterator types.