How to find the BlockName to DataNode mapping in Hadoop
source link: https://www.codesd.com/item/how-to-find-the-blockname-to-datanode-mapping-in-hadoop.html
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
How to find the BlockName to DataNode mapping in Hadoop
Is there a programatic interface to find out whether given a blockID it exists on which data node. I.e. ability to read fsImage and return this info.
One of the crude ways i know of is to look for a file with blockName in the dfs data dir. This is however an O(n) solution and i am pretty sure there would be an O(1) solution to this.
Related Articles
how to find the central element of the map ?? STL
How to find the menu item (if any) that opens a given HMENU when it is enabled?
How to find the keys of the card that are not in the keys of another card?
How to find the longest common prefix of two strings in Scala?
How to find the most frequent number in 1T numbers?
How to find the median values in a Hashtable in Java?
How to find the location using the MAC address of the phone?
How to find the most common character in a large chain using java?
How to find the length of an array of std :: strings?
How to find the end address of a function in a C program?
How to find the number of factors of & ldquo; product of numbers & rdquo;
How to find the li index that does not have an identifier?
How to find the largest number in a string that contains not only numbers but words?
How to find the number of unique names from the list of matched data with linked information?
Recommend
-
286
Files Permalink Latest commit message Comm...
-
128
作者: 中野猛 / 山下真一 / 猿田浩辅 出版社: 中国电力出版社 原作名: Hadoop Hacks ―プロフェッショナルが使う実践テクニック 译者: 陈新 / 常娜 出版年: 2013-12-15 页数: 394 装帧: 平装 ISBN: 9787512..
-
78
原作者:Sundara Ragha...
-
96
教你五招搞定Hadoop集群,搞不定找我!
-
90
当接触大数据时,首先碰到的就是hadoop的学习,安装 Hadoop 往往会成为新手的一道门槛。尽管安装其实很简单,书上有写到,官方网站也有 Hadoop 安装配置教程,但由于刚接触对 Linux 环境不熟悉。加上网上不少教程比较乱,导致新..
-
123
Hadoop命令大全,Hadoop常用命令
-
92
...
-
7
总的来说,正确的做法是优先通过配置文件,再在具体机器上进行相应进程的启动/停止操作。 网上一些资料说在调整配置文件的时候,优先使用主机名而不是IP进行配置。 总的来说添加/删除DataNode和TaskTracker的方法非常相似,只是操作的配置项...
-
3
ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for Block pool BP-xxxx Hadoop分布式集群的NameN...
-
2
动态添加/删除 Hadoop DataNode Jul 31, 2019 NameNode 添加节点 etc/hadoop/slaves 同步 etc/hadoop 配置 在新节点 ./sbin/hadoop-daemon.sh sta...
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK