hdfs
sqoop import complete but hive show tables can't see table
After install hadoop, hive (CDH version) I execute ./sqoop import -connect jdbc:mysql://10.164.11.204/server -username root -password password -table user -hive-import --hive-home /opt/hive/[详细]
2023-03-17 04:01 分类:问答The way to check a HDFS directory's size?
开发者_运维知识库I know du -sh in common Linux filesystems. But how to do that with HDFS?Prior to 0.20.203, and officially deprecated in 2.6.0:[详细]
2023-03-15 17:02 分类:问答Uploading large gzipped data files to HDFS
I have a use case where I want to upload big gzipped text data files (~ 60 GB) on HDFS. My code below is taking about 2 hours to upload these files in chunks of 500 MB. Following is the pseudo code.[详细]
2023-03-14 13:47 分类:问答Hive - create a table from zip file
I have开发者_StackOverflow中文版 bunch of zip files of CSVs, that I want to create Hive table from. I\'m trying to figure out what\'s the best way to do so.[详细]
2023-03-13 18:38 分类:问答Is it possible to append to HDFS file from multiple clients in parallel?
Basically whole question is in the title. I\'m wondering if it\'s possible to append to file located on HDFS from multiple computers simultaneously? Something like storing stream of events constantly[详细]
2023-03-13 14:21 分类:问答What is the maximum number of files allowed in a HDFS directory?
Wh开发者_JAVA百科at is the maximum number of files and directories allowed in a HDFS (hadoop) directory?In modern Apache Hadoop versions, various HDFS limits are controlled by configuration properties[详细]
2023-03-13 08:21 分类:问答"hadoop namenode -format" returns a java.net.UnknownHostException
I\'m currently learning hadoop and I\'m trying to setup a single node test as defined in http://hadoop.apache.org/common/docs/current/single_node_setup.html[详细]
2023-03-12 05:01 分类:问答Does Cloudera Mountable HDFS provide deduplicaion
Looking at running a HDFS based storage cluster, and looking at a simple method of using the Mountable HDFS system through the Cloudera release.[详细]
2023-03-12 01:38 分类:问答Hadoop fully distributed mode
I am a newbie to Hadoop. I have managed to develop a simple Map/Reduce application that works fine in \'pseudo distributed mode\'.I want to test that in \'fully distributed mode\'. I have few question[详细]
2023-03-10 12:18 分类:问答HadoopFS (HDFS) as distributive file storage
I\'m consider to use HDFS as horizontal scaling file storage system for our client video hosting service. My main concern that HDFS wasn\'t developed for this needs this is more \"an open source syste[详细]
2023-03-08 23:48 分类:问答
加载中,请稍侯......