User Tools

Site Tools


start

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
start [2020/06/27 17:40]
deadline
start [2021/05/19 15:40] (current)
deadline [!!! UNDER CONSTRUCTION AND UPDATING CONTENT !!!]
Line 1: Line 1:
  
-====!!! UNDER CONSTRUCTION !!!====+====!!! UNDER CONSTRUCTION AND UPDATING CONTENT !!!====
  
-Welcome to the Limulus Systems Manual.  The following content can be customized for your own system (see [[https://www.dokuwiki.org/manual| Doku Wiki Guide]].+**Welcome to the Limulus Systems Manual**
  
-[[https://www.limulus-computing.com|Limulus Computing systems]] are available in either four or eight node desk-side cases or in a 4-node rack-mount unit. Multiple systems can be connected together and work as one cluster. There are two software stacks available: High Performance Computing (HPC) or scalable data analytics (Hadoop, Spark, Kafka, etc.).+[[https://www.limulus-computing.com|Limulus Cluster Computing systems]] are available in either fouror eight-node desk-side cases or in a 4-node rack-mount unit. Multiple systems can be connected together to work as a larger cluster. There are two software stacks available: High Performance Computing (HPC) or scalable data analytics (Hadoop, Spark, Kafka, etc.).
  
-The following Guide will help you navigate the Limulus system+=====Important:===== 
 + 
 +   - Certain portions of this manual are **restricted** to Limulus Computing Support Customers. Contact [[ https://www.limulus-computing.com/contact/uncategorised/basement-supercomputing| Limulus Computing]] for further information or to purchase a support contract. 
 +  - Unless otherwise noted, all content, diagrams, images, etc. are available under the [[https://creativecommons.org/licenses/by-nc-sa/4.0/deed.en|Creative Commons Attribution-Noncommercial-Share Alike 4.0 International]] license. This license offers the maximum amount of "informational freedom" and restricts any commercial use of this content (or any derivative thereof).  
 + 
 +The following guide will aid in navigating and maintaining Limulus Computing cluster appliances. The content is constantly updated to address new hardware, software, and user needs  
 +  
 +=====First Steps===== 
 +  * [[Unpacking and Startup]] 
 +  * [[Essential Quick Start (HPC Systems)]] 
 +  * [[Essential Quick Start (Data Analytics Systems)]] 
 +  * [[Getting Help]]
  
 =====User Guide===== =====User Guide=====
Line 14: Line 25:
   * [[Using Software Modules]]   * [[Using Software Modules]]
   * [[Submitting Jobs to the Slurm Workload Manager]]   * [[Submitting Jobs to the Slurm Workload Manager]]
 +  * [[Running Interactive Jobs on the Cluster Nodes]]
   * [[Compiling and Running an MPI Application]]   * [[Compiling and Running an MPI Application]]
 ===Data Analytics Systems=== ===Data Analytics Systems===
-  * [[Running Hive and Spark from he Command line]]+  * [[Running Hive and Spark from the Command line]]
   * [[Using the Zeppelin Web Notebook]]   * [[Using the Zeppelin Web Notebook]]
    
Line 26: Line 38:
   * [[Adding Users]]   * [[Adding Users]]
   * [[Powering Up/Down Nodes]]   * [[Powering Up/Down Nodes]]
-  * [[Logs and Log Management]] 
   * [[Adaptive Cooling]]   * [[Adaptive Cooling]]
   * [[Monitoring System Resources]]    * [[Monitoring System Resources]] 
   * [[RAID Storage Management]]   * [[RAID Storage Management]]
   * [[Setting Node Governors/Turbo Mode]]   * [[Setting Node Governors/Turbo Mode]]
 +  * [[System-wide Administration Commands (pdsh)]]
   * [[Software Management]]   * [[Software Management]]
 +  * [[Firewall Configuration]]
 +===HPC Systems===
   * [[Open HPC Components]]   * [[Open HPC Components]]
 +  * [[HPC Logs and Log Management]]
   * [[Slurm Workload Manager]]   * [[Slurm Workload Manager]]
   * [[Warewulf Worker Node Images]]   * [[Warewulf Worker Node Images]]
 +===Data Analytics Systems===
 +  * [[Using the Apache Ambari Cluster Manager]]
 +  * [[HDFS Management]]
 +  * [[Apache Logs and Log Management]]
  
 ===== System Operation Guide ===== ===== System Operation Guide =====
 +  * [[Limulus Design Philosophy]]
   * [[Functional Diagram]]   * [[Functional Diagram]]
   * [[Desk-side Case]]   * [[Desk-side Case]]
   * [[Rack-mount Case]]   * [[Rack-mount Case]]
-  * [[Compute Blades]]+  * [[Limulus Compute Blades]]
   * [[Node Power Control]]   * [[Node Power Control]]
   * [[Internal Networks]]   * [[Internal Networks]]
   * [[Fan Control]]   * [[Fan Control]]
   * [[Limulus Services]]   * [[Limulus Services]]
 +  * [[Hadoop HDFS Drive Assignments]]
  
 ===== Frequently Asked Questions ===== ===== Frequently Asked Questions =====
Line 50: Line 71:
   * [[User Questions and Procedures]]   * [[User Questions and Procedures]]
   * [[Administrative Questions and Procedures]]   * [[Administrative Questions and Procedures]]
 +  * [[ Sandbox ]]
  
start.1593279636.txt.gz · Last modified: 2020/06/27 17:40 by deadline