FileStreamMapReduce.Jar

Amazon’s Elastic map reduce allows users to easily run commands on hundreds or thousands of instances (cpu’s)Using the FileStreamMapReduce.jar you can easily run thousands of image or video converting and processing commands in a
manner that will save you time and money.Use this JAR for more advanced commands. It allows you to convert images, apply watermarks, process video data all on a file by file basis.
As well it also maintains the original filenames and won’t split or compress the final output data.
The FileStreamMapReduce.jar has a running total of successful and failed conversions so you can keep track if everything is going
ok. Also files that were not successfully converted are indicated with a .err extension.

How to run FileStreamMapReduce on Amazon Elastic Map Reduce.

jar location: s3n://myjarlocation/FileStreamMapReduce.jar
jar arguements: s3n://myinputbucket/ s3n://myoutputbucket/ -install=convert -extension=png “-command=/usr/local/bin/convert -resize 32×32 – png:-”
**remember trailing slashes in input and output bucket paths**

The -install=convert command will install the command via yum install convert
The -extension=png option will rename any output file to the specified extension since data is streamed to the convert/ffmpeg commands.
Other common tools you may wish to install are -install=ffmpeg

**UNFORTUNATELY AMAZON DOES NOT SUPPORT CONVERT or FPMG ON THEIR HADOOP SERVERS**
Tested using Amazon Elastic Map Reduce /w Hadoop 0.18.3

Running the plugin with ffmpeg
jar location: s3n://myjarlocation/FileStreamMapReduce.jar

jar arguements: s3n://myinputbucket/ s3n://myoutputbucket/ -install=convert -extension=avi “-command=/path/to/ffmpeg -i pipe:0 -f avi pipe:1″

Here are some additional instructions on how to use ffmpeg with stdin and stdout streams.

This is how you would use it with FileStreamMapReduce.Jar

http://ffmpeg.org/ffmpeg-doc.html#SEC41

BUY THE PLUGIN NOW $20 once you buy the plugin you should be able to login to this site and use the download link.