|
@@ -30,6 +30,8 @@ Native Libraries Guide
|
|
|
compression" could refer to all *.so's you need to compile that are
|
|
|
specifically related to compression. Currently, however, this document
|
|
|
only addresses the native hadoop library (<<<libhadoop.so>>>).
|
|
|
+ The document for libhdfs library (<<<libhdfs.so>>>) is
|
|
|
+ {{{../hadoop-hdfs/LibHdfs.html}here}}.
|
|
|
|
|
|
* Native Hadoop Library
|
|
|
|
|
@@ -64,14 +66,16 @@ Native Libraries Guide
|
|
|
|
|
|
* Components
|
|
|
|
|
|
- The native hadoop library includes two components, the zlib and gzip
|
|
|
- compression codecs:
|
|
|
+ The native hadoop library includes various components:
|
|
|
|
|
|
- * zlib
|
|
|
+ * Compression Codecs (bzip2, lz4, snappy, zlib)
|
|
|
|
|
|
- * gzip
|
|
|
+ * Native IO utilities for {{{../hadoop-hdfs/ShortCircuitLocalReads.html}
|
|
|
+ HDFS Short-Circuit Local Reads}} and
|
|
|
+ {{{../hadoop-hdfs/CentralizedCacheManagement.html}Centralized Cache
|
|
|
+ Management in HDFS}}
|
|
|
|
|
|
- The native hadoop library is imperative for gzip to work.
|
|
|
+ * CRC32 checksum implementation
|
|
|
|
|
|
* Supported Platforms
|
|
|
|