[HDFS-15785] Datanode to support using DNS to resolve nameservices to IP addresses to get list of namenodes - ASF JIRA

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.4.0
Component/s: datanode
Labels:
- pull-request-available

Description

Currently as HDFS supports observers, multiple-standby and router, the namenode hosts are changing frequently in large deployment, we can consider supporting https://issues.apache.org/jira/browse/HDFS-14118 on datanode to reduce the need to update config frequently on all datanodes. In that case, datanode and clients can use the same set of config as well.

Basically we can resolve the DNS and generate namenode for each IP behind it.