task_201405192004_0003_r_000000org.apache.pig.backend.executionengine.ExecException: ERROR 2081: Unable to setup the store function.


Solutions on the web1

Solution icon of web
via amazon.com by Unknown author, 8 months ago
ERROR 2081: Unable to setup the store function.

Stack trace

task_201405192004_0003_r_000000org.apache.pig.backend.executionengine.ExecException: ERROR 2081: Unable to setup the store function.
	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.setUp(POStore.java:114)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:391)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:257)
	at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
	at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:663)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:426)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1132)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.io.IOException: File already exists:s3n://cgm-dw-workspace-dev/dw_loads/content_dimension/201405051848/debug/missing_listing_key/part-r-00000.gz
	at org.apache.hadoop.fs.s3native.NativeS3FileSystem.create(NativeS3FileSystem.java:647)
	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:557)
	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:538)
	at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:445)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextOutputFormat.getRecordWriter(PigTextOutputFormat.java:101)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReducePOStoreImpl.createStoreFunc(MapReducePOStoreImpl.java:85)
	at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStore.setUp(POStore.java:106)
	... 10 more

Write tip

You have a different solution? A short tip here would help you and many other users who saw this issue last week.

Users with the same issue

Samebug visitor profile picture
Unknown user
Once, 2 months ago
2 times, 6 months ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
Samebug visitor profile picture
Unknown user
Once, 1 year ago
1 more bugmates