...
On demand provisioning of hardware, and template driven development, combined with low latency access to existing on-permise data sources make AWS a powerful platform for high performance grid computing systems.
| Gliffy Diagram | ||||
|---|---|---|---|---|
|
The role of AWS DirectConnect provides low latency and reliable connection between the corporate data center site and AWS. For situations with lower bandwidth requirements, a VPN connection to the VPC gateway can be established.
Grid controllers and grid engines are running Amazon Elastic Compute Cloud (Amazon EC2) instances started on demand from Amazon Machine Images (AMIs) that contain the operating system and grid software.
The role of Amazon Dynamo DB is to store the results from Grid engine that is a kind of managed database providing configurable read and write throughput, allowing scalability on demand.
The result of Amazon Dynamo DB are aggregated using a map/reduce job in Amazon Elastic MapReduce (Amazon EMR) and final output is stored in Amazon S3.
Aggregate results can be achived using Amazon Glacier, a low-cost, secure, and durable storage service.