Trial #26: Migrate DynamoDB Table Remote/Cloud

Problem:

You may need a method to migrate in and out of AWS if you:

• Develop a dataset locally and want to move to the cloud
• Need too develop locally against data originating in the cloud

Solution:

• AWS has an enterprise level solution, Data Pipeline which may not be required for your datasets or workflow.

• dynamodump makes a neat little local copy of your data in a series of 3.5MB or less json files under the name specified. Careful using the same name twice if you were wishing to retain a copy of the data as it will clear down its directory structure by default.

Here is an example pair of how you might process a local table and then upload to aws with dynamodump:

python dynamodump.py -m backup -r local -s TABLE-NAME --host localhost --port 8000 --accessKey a --secretKey a

python dynamodump.py -p default -r YOUR-REGION -m restore  -s TABLE-NAME