encryption - AWS EMR SSE Consistent view -


i trying create emr cluster on aws below cli command, not create cluster in consistent view , server side encryption flag not getting set (fs.s3.consistent , fs.s3.enableserversideencryption both false in emrfs-site.xml). whats wrong?

aws emr create-cluster \ --name "reporting-aws-cli-temp" \ --instance-type m1.medium \ --service-role emr_defaultrole \ --instance-count 2 \ --ami-version 3.3.1 \ --ec2-attributes subnetid=subnet-111111,keyname=somekey,instanceprofile=server-role \ --log-uri s3://some-logs \ --emrfs sse=true,consistent=true,retryperiod=3,args=[fs.s3.serversideencryptionalgorithm=aes256]

2nd part of question have below

problem statement csv data want analyze periodically posted aws ec2 instances (server) amazon s3 bucket , using hive read data amazon s3 bucket , doing analysis. data post on amazon s3 needs encrypted , hive has first decrypt file , analyse

current state able achieve following periodically post file s3 in 3 separate way

  1. plain csv file can download , read
  2. protecting data key @ client side , uploading file (reference : http://docs.aws.amazon.com/amazons3/latest/dev/usingclientsideencryption.html)
  3. protecting data server side encryption (sse-s3) , uploading (http://docs.aws.amazon.com/amazons3/latest/dev/serv-side-encryption.html)

creation of emr cluster on aws hive (version 0.13.0) installed on it. able create external tables , added partitions point plain csv data , read , simple analysis on point stuck if data in encrypted either client side encryption or server side encryption, how can hive decrypt data in file prior reading data inside it.

use below argument enable encryption

--emrfs encryption=serverside,args=[fs.s3.serversideencryptionalgorithm=aes256] 

Comments

Popular posts from this blog

python - mat is not a numerical tuple : openCV error -

c# - MSAA finds controls UI Automation doesn't -

wordpress - .htaccess: RewriteRule: bad flag delimiters -