A string transformation library and CLI tool for Rust. Chain operations like split, join, replace, and filter using template syntax.
- 🌟 Why String Pipeline?
- ⚡ Examples
- 🚀 Installation
- 🏃 Quick Start
- 🧪 Testing
- ⚡ Performance & Benchmarking
- 📚 Documentation
- 🤝 Contributing
- 📄 License
Transform complex text processing into simple, readable templates:
# Traditional approach (multiple commands) echo "john.doe@email.com,jane.smith@company.org" | \ tr ',' '\n' | \ grep -o '@[^,]*' | \ tr -d '@' | \ sort | \ tr '\n' ',' # String Pipeline (single template) string-pipeline "{split:,:..|map:{regex_extract:@(.+):1}|sort}" "john.doe@email.com,jane.smith@company.org" # Output: "company.org,email.com"- 🔗 Chainable Operations: Pipe operations together naturally
- 🗺️ Powerful Mapping: Apply sub-pipelines to each list item
- 🔍 Regex Support: sed-like patterns for complex transformations
- 🐛 Debug Mode: Step-by-step operation visualization
# Extract middle items from list string-pipeline "{split:,:1..3}" "a,b,c,d,e" # Output: "b,c" # Clean and format names string-pipeline '{split:,:..|map:{trim|upper|append:!}}' " john , jane , bob " # Output: "JOHN!,JANE!,BOB!" # Extract numbers and pad with zeros string-pipeline '{split:,:..|map:{regex_extract:\d+|pad:3:0:left}}' "item1,thing22,stuff333" # Output: "001,022,333"# Filter files, format as list string-pipeline '{split:,:..|filter:\.py$|sort|map:{prepend:• }|join:\n}' "app.py,readme.md,test.py,data.json" # Output: "• app.py\n• test.py" # Extract domains from URLs string-pipeline '{split:,:..|map:{regex_extract://([^/]+):1|upper}}' "https://github.com,https://google.com" # Output: "GITHUB.COM,GOOGLE.COM" # Debug complex processing string-pipeline "{split: :..|filter:^[A-Z]|sort:desc}" "apple Banana cherry Date" # Output: Date,Banana# Install from crates.io cargo install string_pipeline # Or build from source git clone https://github.com/lalvarezt/string_pipeline.git cd string_pipeline cargo install --path .Add to your Cargo.toml:
[dependencies] string_pipeline = "0.12.0"# With argument string-pipeline '{template}' "input string" # With stdin echo "input" | string-pipeline '{template}' # Debug mode string-pipeline --debug "{split:,:..|map:{upper}}" "hello,world" # DEBUG: 📂 MULTI-TEMPLATE # DEBUG: ├── 🏁 MULTI-TEMPLATE START # DEBUG: ├── Template: "{!split:,:..|map:{upper}}" # DEBUG: ├── ➡️ Input: "hello,world" # DEBUG: ├── 1 sections to process (literal: 0, template: 1) # DEBUG: │ # DEBUG: ├── 📊 SECTION 1/1: [template: split(',',..) | map { operations: [upper] }] # DEBUG: ├── 💾 CACHE MISS Computing and storing result # DEBUG: │ # DEBUG: ├── 📂 Main Pipeline # DEBUG: │ ├── 🚀 PIPELINE START: 2 operations # DEBUG: │ ├── ➡️ Input: String(hello,world) # DEBUG: │ ├── 1. Split(',') # DEBUG: │ ├── 2. Map(1) # DEBUG: │ ├── ⚙️ Step 1: Split # DEBUG: │ │ ├── ➡️ Input: String(hello,world) # DEBUG: │ │ ├── 🎯 Result: List["hello", "world"] # DEBUG: │ │ └── Time: 332.41µs # DEBUG: │ ├── ⚙️ Step 2: Map # DEBUG: │ │ ├── ➡️ Input: List["hello", "world"] # DEBUG: │ │ ├── 🎯 Result: String(processing...) # DEBUG: │ │ └── Time: 0ns # DEBUG: │ │ ├── 🗂️ Item 1/2 # DEBUG: │ │ │ ├── ➡️ Input: "hello" # DEBUG: │ │ │ ├── 📂 Sub-Pipeline # DEBUG: │ │ │ │ ├── 🔧 SUB-PIPELINE START: 1 operations # DEBUG: │ │ │ │ ├── ➡️ Input: String(hello) # DEBUG: │ │ │ │ ├── ⚙️ Step 1: Upper # DEBUG: │ │ │ │ │ ├── ➡️ Input: String(hello) # DEBUG: │ │ │ │ │ ├── 🎯 Result: String(HELLO) # DEBUG: │ │ │ │ │ └── Time: 875ns # DEBUG: │ │ │ │ ├── ✅ SUB-PIPELINE COMPLETE # DEBUG: │ │ │ │ ├── 🎯 Result: String(HELLO) # DEBUG: │ │ │ │ └── Time: 16.37µs # DEBUG: │ │ │ └── Output: "HELLO" # DEBUG: │ │ ├── 🗂️ Item 2/2 # DEBUG: │ │ │ ├── ➡️ Input: "world" # DEBUG: │ │ │ ├── 📂 Sub-Pipeline # DEBUG: │ │ │ │ ├── 🔧 SUB-PIPELINE START: 1 operations # DEBUG: │ │ │ │ ├── ➡️ Input: String(world) # DEBUG: │ │ │ │ ├── ⚙️ Step 1: Upper # DEBUG: │ │ │ │ │ ├── ➡️ Input: String(world) # DEBUG: │ │ │ │ │ ├── 🎯 Result: String(WORLD) # DEBUG: │ │ │ │ │ └── Time: 93ns # DEBUG: │ │ │ │ ├── ✅ SUB-PIPELINE COMPLETE # DEBUG: │ │ │ │ ├── 🎯 Result: String(WORLD) # DEBUG: │ │ │ │ └── Time: 15.749µs # DEBUG: │ │ │ └── Output: "WORLD" # DEBUG: │ │ └── 📦 MAP COMPLETED: 2 → 2 items # DEBUG: │ ├── ✅ PIPELINE COMPLETE # DEBUG: │ ├── 🎯 Result: List["HELLO", "WORLD"] # DEBUG: │ └── Time: 457.193µs # DEBUG: │ # DEBUG: ├── 🏁 ✅ MULTI-TEMPLATE COMPLETE # DEBUG: ├── 🎯 Final result: "HELLO,WORLD" # DEBUG: ├── Total execution time: 568.533µs # DEBUG: └── Cache stats: 0 regex patterns, 1 split operations cached # HELLO,WORLDuse string_pipeline::Template; fn main() -> Result<(), Box<dyn std::error::Error>> { let template = Template::parse("{split:,:..|map:{upper}|join:-}")?; let result = template.format("hello,world,rust")?; println!("{}", result); // "HELLO-WORLD-RUST" Ok(()) }# Run all tests cargo test # Run with output cargo test -- --nocapture # Run benchmarks cargo benchString Pipeline includes simple benchmarking tools for measuring performance:
# Build the benchmark tool cargo build --release --bin bench # Run benchmarks (1000 iterations) ./target/release/bench # Quick performance check (100 iterations) ./target/release/bench --iterations 100 # Generate JSON for scripts ./target/release/bench --format json > benchmark_results.json📖 Template System ⚙️ CLI Options & Usage 🔍 Comprehensive Debug System Guide 📊 Performance Benchmarking Guide
We welcome contributions! 🎉
- 🐛 Report bugs via GitHub Issues
- 💡 Suggest features or improvements
- 🔧 Submit pull requests
This project is licensed under the MIT License. See LICENSE for details.
⚡ Fast and composable string transformations made simple!