Partition data into child streams

Serverless Preview Stack Preview 9.2.0

For wired streams, send all of your logs to the /logs endpoint. This endpoint acts as your entry point for all of your log data.

Once you've sent your data to the /logs endpoint, open the stream and use the Partitioning tab to organize and route the data into meaningful child streams. For example, you can partition your logs into child streams their source or type:

• Route application logs to a logs.myapp child stream.
• Route system logs to a logs.system child stream.

Create partitions using the following options:

• Manual configuration: Use fields and attributes from your data to define how it's routed to child streams.
• AI suggestions: Let Streams analyze your data and suggest partitions, which you can review and accept or reject.

To manually configure when to send data to child streams:

1. Select Create partition manually.
2. From the Data preview, filter data based on fields or attributes by hovering over the field and selecting the icon. This creates a Condition for your stream.
3. Under Stream name, give your stream a name based on the condition.
4. Select Save to create the child stream.

To use AI suggestions to send data to child streams:

1. Select Suggest partitions with AI. Streams uses AI to look at your data and give you suggestions for grouping your data.
2. Either Accept or Reject the AI suggestions. After selecting Accept, you'll see the suggested Stream name and Condition.
3. Select Create stream.

After partitioning your wired streams:

• Extract fields using the Processing tab to filter and analyze your data effectively.
• Map fields using the Schema tab to make fields easier to query.