internetse_admin

Go Virtual has recently delivered Denmark’s largest Supercomputer to Danish Technical University.

This is to be used for Bioinformatics by the Center for Bioinformatics and Sequencing. In a tender for 40M DKK CBS wanted a Supercomputer that could solve some of the world’s largest Life Science problems.

Data Center Housing Solution:

Go Virtual designed and delivered for hosting the Supercomputer:

• 2x 15m Datacenter containers with state of the art air and liquid cooling
• Each container 2 Expandable containers from DCC
• Guaranteed 10 years warrenty
• Raised floor with two water cooling circuits
• Cold water 10-18 degrees
• Warm-water up to 40 degrees
• 500KW of power capacity
• 500KW of cooling capacity – air and liquid cooling
• In-row cooling racks for air cooled equipment
• State of the art fire extinguishing equipment and sensors to detect any possible problems and leaks.
• First container contains the cluster
• Second container contains the Storage cluster

Supercomputer solution:

With CBS’s specific need Go Virtual designed the following solution:

• Compute Nodes: 540 HP XL230
• 128GB, 2x E5-2683v3 Intel processor each with 14 cores at  2,0 GHz
• Fat Nodes: 27 HP DL560
• 1TB, 4x E5-4610v2 Intel processors each 8  2,3 GHz cores
• Head Nodes: 2 Hewlett Packard DL560 –

1TB, 4x E5-4610v2 Intel processors each 8  2,3 GHz cores and redundant shared storage

• 16048 with a theoretical performance of 548TF #121 on T500
• 96 TB of extremely fast memory in total 569 servers.
• 

• Cluster Network solution:

  With CBS’s requirements in mind GoVirtual designed and delivered following Mellanox Infiniband interconnect solution:

• 

• Storage Solution

  With CBS’s needs for an Enterprise storage solution Go Virtual designed a solution from EMC:

  Storage Solution- EMC Isilon +50GB/s

  Primary Site

  • 50 Storage nodes (X400)
  • • 600 cores
    • 50 GB/  aggregate bandwidth
    • 1200 GB global cache
    • 150 SSDs
    • 3PB of usable highly available storage (1650 spindles)
    • 1PB Tape library backup – Main site

    Secondary Site

    • 11 NL400 nodes
    • 3PB secondary storage array (async replication over 50km)
    • 1PB Tape library backup HP MSL6480

    Storage Software

    • Backup Networker
    • Snapshots

    Storage replication

    EMC Software:

    • InsightIQ
    • SmartConnect
    • SnapshotIQ
    • SyncIQ
    • SmartQuota
    • 

    • Supercomputer Software Solution:

      Cluster Management solution

      Bright Cluster Management

      Cluster Monitoring Solution

      Workload Management:

      MOAB Enterprise

      HP SIM tools

      IRS – HP automatic notification system

      HP monitoring tools

      HP SW deployment Tools

    • GoVirtual builds the first Bioinformatics Cloud Solution on top of the Cluster:

      Meeting CBS’s requirements GoVirtual and HP has designed and are in the process of building a cloud environment on top of the HPC cluster:

    • This will enable CBS’s users to share the cluster in the following way:
    • The CBS system will have a large larges cluster pool running standard jobs as in a more traditional HPC cluster. But additionally higher level users can purchase and size an environment as sub clusters with CBS’s software tools which will be living on the system as needed. I will be totally logically/physically separated from other users without any overhead of server virtualization. The environment will be flexible in size and can be expanded if needed both on the server and storage side. End users will be accountable for their usage and have to pay for the usage.This Enterprise solution is unique and nothing like this has been built before.