Using Cisco UCS servers for a Hadoop & Spark Cluster


When creating a Hadoop & Spark Cluster, two types of server configurations (Management and Data nodes) are desired.

 Server Types Service Placement Examples Server Design Focus
Management Node Name node, Job Tracker, HBase Master, Zookeeper, Hive, Oozie, etc… Fast CPU, Memory and Network
Data Node HDFS, GPFS, Task Tracker, HBase Region Fast Dense Storage and Network

Management nodes – Cisco C220 M4

When using Cisco server models, the Cisco C220 M4 server configured with at least two LFF 3.5″ drives can be used as a Management node. For detailed information click HERE.

product-large

CPU and memory resources are adjusted based on the workload planned for the Hadoop Cluster.

Cluster Purpose, Management Node(s) CPU Memory (min)
IA – Internet Analytics E5-2640 v3 64GB (1866 MHz)
LZ / DL – Landing Zone / Data Lake E5-2660 v3 128GB (2133 MHz)
NS / CA – NoSQL / Complex Data Analytics E5-2680 v3 128GB (2133 MHz)

Data nodes – Cisco C240 M4

The Cisco C240 M4 server with up to 12 LFF 3.5″ drives and 2 SFF 2.5″ internal drives can be used as a Data node. For detailed information click HERE.

product-large

Cluster Purpose, Data Nodes CPU Memory (min)
IA – Internet Analytics E5-2620 v3 64GB (1866 MHz)
LZ / DL – Landing Zone / Data Lake E5-2640 v3 64GB (1866 MHz)
NS / CA – NoSQL / Complex Data Analytics E5-2680 v3 128GB (2133 MHz)