Skip to content
This repository was archived by the owner on Jan 13, 2020. It is now read-only.

Commit 379665a

Browse files
committed
add nested-json access
1 parent 553649c commit 379665a

File tree

5 files changed

+6
-2
lines changed

5 files changed

+6
-2
lines changed

SUMMARY-nanhang.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -56,6 +56,7 @@
5656
* [本地文件接入](developer/data-access/index-task.md)
5757
* [Kafka接入](developer/data-access/kakfa-druid.md)
5858
* [kafka动态维接入](developer/data-access/default-kafka.md)
59+
* [嵌套json数据接入](developer/data-access/nested-json-parser.md)
5960
* [hadoop接入](developer/data-access/hadoop.md)
6061
* [数据段合并](developer/data-access/merge-druid.md)
6162
* [parser 类型](developer/data-access/parser.md)

SUMMARY-tsa.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -91,6 +91,7 @@
9191
* [本地文件接入](developer/data-access/index-task.md)
9292
* [Kafka接入](developer/data-access/kakfa-druid.md)
9393
* [kafka动态维接入](developer/data-access/default-kafka.md)
94+
* [嵌套json数据接入](developer/data-access/default-kafka.md)
9495
* [hadoop接入](developer/data-access/hadoop.md)
9596
* [数据段合并](developer/data-access/merge-druid.md)
9697
* [parser 类型](developer/data-access/parser.md)

SUMMARY.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -97,6 +97,7 @@
9797
* [本地文件接入](developer/data-access/index-task.md)
9898
* [Kafka接入](developer/data-access/kakfa-druid.md)
9999
* [kafka动态维接入](developer/data-access/default-kafka.md)
100+
* [嵌套json数据接入](developer/data-access/nested-json-parser.md)
100101
* [hadoop接入](developer/data-access/hadoop.md)
101102
* [数据段合并](developer/data-access/merge-druid.md)
102103
* 日志记录接入

developer/data-access/index.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,7 @@
66
- [本地文件接入](index-task.md)
77
- [Kafka接入](kakfa-druid.md)
88
- [kafka动态维接入](default-kafka.md)
9+
- [嵌套json数据接入](nested-json-parser.md)
910
- [hadoop接入](hadoop.md)
1011
- [预聚合接入](rollup-druid.md)
1112
- [数据段合并](merge-druid.md)

developer/data-access/nested-json-parser.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# 解析嵌套json格式数据
1+
# 嵌套json数据接入
22

33
> ## 概要  
44
> * 本流程主要介绍如何配置解析嵌套json格式数据.
@@ -108,7 +108,7 @@
108108
- **`dataSchema.parser.type`** 默认的parser类型为string,所以此处可省略.
109109
- **`dataSchema.parser.parseSpec.format`** parse类型配置为嵌套的"nested".
110110
- **`dataSchema.parser.parseSpec.decollator`** 分割符默认为".",在本文档是将嵌套的json打平,所以此配置无效.如果想将嵌套的json解析后,保留原来的嵌套格式,比如解析以上json后显示的字段包含"msg.EventTime",则需要此配置.
111-
- **`dataSchema.parser.parseSpec.timestampSpec`** 配置时间错列,如果数据中没有时间列,可使用当前时间作为时间列.
111+
- **`dataSchema.parser.parseSpec.timestampSpec`** 配置时间戳列,如果数据中没有时间列,可使用当前时间作为时间列.
112112
- **`dataSchema.parser.parseSpec.timestampSpec.reNewTime`** 使用当前时间作为时间戳.如果使用该配置,其他项不需要配.
113113
- **`dataSchema.parser.parseSpec.timestampSpec.missingValue`** 使用固定时间作为时间戳,比如`2016-08-03T12:53:51.999Z`.如果使用该配置,其他项不需要配.
114114
- **`dataSchema.parser.parseSpec.timestampSpec.column`** 时间戳列.

0 commit comments

Comments
 (0)