How to write encrypted data to HDFS

Question

Since Apache Hadoop 2.6 recently introduced HDFS-6134 (Transparent Data at Rest Encryption), I would like to know if it is possible to write directly to the encryption zone using the Java Hadoop application? The documentation only explains the command hdfs crypto createZone keyName myKey path /encryptionZoneto copy a file to an encrypted zone, but I would like to know how can I use api to write to an encrypted zone?

Answer 1

Of course, you cannot write encrypted data directly to an already created encrypted zone. This is simply not possible because encryption / decryption is not performed at the application level. Hadoop DFS Client will “transparently” encrypt / decrypt data with each write / read.

You can read the actual design of this transparent encryption for more details.

https://issues.apache.org/jira/secure/attachment/12660368/HDFSDataatRestEncryption.pdf