Create a cluster

description

Starts new cluster on AWS.

command-line

>>> ./EHPC-Client --create OPTIONS
Note: all options should be in form parameter=value
Options:
        --help, -h                prints help
        --region, -r              region of interest EU1,USE1,USW1,Asia1
        --name                    Name of cluster created default HPC-cloud
        --amiID, -ami             ID of AMI to load
        --log-File                path to a file to log progress to
        --emulate                 Print the commands which will run but nothing will be done on AWS
AWS Credentials
        --private-Key, -pk        path of the private file
        --certificate, -cert      path of the cert file
        --conf                    take credentials from preconfigured file
S3 as Shared FS
        --accessKey, -ak           access key (required for S3FS)
        --secretKey, -sk           Secret Access Key (required for S3FS)
        --s3-bucketname, -s3b      bucket to use as S3FS
        --s3-mountPoint            Mount point for S3FS, default /s3
        --s3-temp                  temp directory for S3FS, default /tmp
        --configure-s3             Configure AWS S3 tool to be able to copy and get S3 data from your buckets
NFS:
        --nfs-mountPoint           Mount point for NFS, default /nfs
        --nfs-newVolume            Create New Volume as it as NFS point
        --nfs-attchVolume          Attach existing EBS volume as NFS point
        --nfs-device               Device to add Vol as, default /dev/sdf
Nodes Configuration
        --key-pair, -kp             key pair to start compute nodes with, default Current KeyPair
        --security-group, -sg       security group for compute nodes, default Current Security Group
        --instances-type, -t        instance type of all nodes
        --nodes-count, -n           number of the cluster machines
        --user-data                                     data to be sent to the machine
Main Node Configuration
        --main-node-type            instance type of the main node only
        --mainNodePBSCores          Number of cores to set for PBS Torque on the main node
Extra Nodes configuration
        --extra-nodes-type          Instance type of extra nodes
        --extraMachinesPBSCores     Number of cores used by PBS torque for extra machines
Note: you have to provide --extraMachinesPBSCores in case to you set the compute nodes type differnet from main node

command line examples

Example 1

create cluster of AMI ami-898989 of m1.xlarge containing 4 machines in eu-west-1 with KeyPair HPCloud-Key and set the security group to HPCloud and use eg.HPCloud as S3 bucket and mount of /s3 with EHPC-Client --create --conf=default -r=EU1 -t=m1.xlarge -n=4 -kp=HPCloud-Key -sg=HPCloud -s3b=eg.HPCloud --s3-mountPoint=/s3 --access-key=jsjhsjhsjytety --secret-key=339803/i839 -ami=ami-898989

Output

URL

Example 2

create a cluster which has a main node node of xlarge large and has 4 extra machines of type ‘m1.large’

EHPC-Client --create --conf=default -r=EU1 --main-node-type=m1.xlarge --extra-nodes-type=m1.large n=5 extraMachinesPBSCores=2

Output

URL

Example 3

create a 4 nodes cluster with NFS shared folder on a new volume of 100 GB

EHPC-Client --create --conf=default -r=EU1 --nfs-mountPoint=/nfs --nfs-newVolume=100 -n=4 -t=m1.large

Output

URL