开发者

Custom inputformat to process protobufs in hadoop 0.20

开发者 https://www.devze.com 2023-02-15 18:05 出处:网络
I\'d like to process protobufs using hadoop....but am unsure where to start. I don\'t care about splitting large files.

I'd like to process protobufs using hadoop....but am unsure where to start. I don't care about splitting large files. The protobufs are stored as bina开发者_开发知识库ry data...what class should I extend to make it easier


elephant-bird can process protobufs using hadoop. This framework generates hadoop I/O classes along with regular protobuf classes. It uses lzo compression.

0

精彩评论

暂无评论...
验证码 换一张
取 消