Skip to content

Support for multiple storage directories #274

@lfrancke

Description

@lfrancke

Currently, only a single storage directory is supported. We need to support an arbitrary number.
While we're also want to support heterogenous storage tagging.
CRD design

 dataNodes: roleGroups: default: replicas: 1 config: resources: storage: data: # We need to overwrite the data pvcs coming from the default value count: 0 my-disks: capacity: 100Gi count: 5 hdfsStorageType: Disk my-ssds: capacity: 10Gi storageClass: premium count: 3 hdfsStorageType: Ssd 

By defaulting to

 data capacity: 5Gi count: 1 hdfsStorageType: Disk 

this is a non-breaking change for the CRD. Because we name the pvcs data, data-1, data-2 etc. even the pvc names do not change, so the whole feature should be non-breaking

  • Multiple pvcs supported
  • hdfsStorageType is passed to hdfs
  • CRD change is non-breaking
  • pvc name change is non-breaking
  • Tests added
  • Documentation added

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions