This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
general_questions [2020/06/19 18:38] deadline local links |
general_questions [2021/05/04 14:46] (current) brandonm [Support] Word fixes |
||
---|---|---|---|
Line 5: | Line 5: | ||
* [[General Questions# | * [[General Questions# | ||
* [[General Questions# | * [[General Questions# | ||
- | * [[General Questions# | + | * [[General Questions#Power Heat Noise|Power Heat Noise]] |
* [[General Questions# | * [[General Questions# | ||
* [[General Questions# | * [[General Questions# | ||
Line 12: | Line 12: | ||
**Is this a real cluster? | **Is this a real cluster? | ||
- | Yes, it is a real cluster. The basic system has four motherboards which are cluster nodes in a standard off the shelf case with a single power supply. The main motherboard is always powered and functions just like a workstation. The three compute nodes can be powered-on when needed. The software is identical to that running on large clusters. | + | Yes, it is a real cluster. The basic system has four motherboards which are cluster nodes in a standard off-the-shelf case with a single power supply. The main motherboard is always powered |
**What can I run on such a system?**\\ | **What can I run on such a system?**\\ | ||
- | Any software that is designed to run on a Linux cluster including both High Performance | + | Any software that is designed to run on a Linux cluster, including both High Performance |
Computing (HPC) and Apache Hadoop applications. | Computing (HPC) and Apache Hadoop applications. | ||
Line 23: | Line 23: | ||
**How fast is it?**\\ | **How fast is it?**\\ | ||
- | The first Limulus version achieved 385.5 double precision CPU GFLOPS (52% of peak running HPL). Note, benchmarking results in HPC are very application specific. While a GPU might match the performance of a small cluster for some applications, | + | The first Limulus version achieved 385.5 double precision CPU GFLOPS (52% of peak running HPL). Note, benchmarking results in HPC are very application-specific. While a GPU might match the performance of a small cluster for some applications, |
- | **What | + | **What |
Limulus is an acronym for **LI**nux **MUL**ti-core **U**nified **S**upercomputer. | Limulus is an acronym for **LI**nux **MUL**ti-core **U**nified **S**upercomputer. | ||
**What is the difference between a Limulus and a 8/16-core workstation? | **What is the difference between a Limulus and a 8/16-core workstation? | ||
- | In terms of core count, there is no difference. In terms of price and performance there can be a big difference. A multi-core SMP system (such as a dual socket workstation or server motherboard) can provide many cores, but depending on workload, you may not be able to get effective use from all of the cores due to memory contention (See [[https:// | + | In terms of core count, there is no difference. In terms of price and performance there can be a big difference. A multi-core SMP system (such as a dual socket workstation or server motherboard) can provide many cores, but depending on workload, you may not be able to get effective use from all of the cores due to memory contention (See [[https:// |
- | Also, as more cores are added to a processor the amount heat generated increases. To account for this excess heat either the clock frequency must be lowered | + | Also, as more cores are added to a processor, the amount |
In terms of price, comparable core-heavy workstation solutions usually cost more than a comparable Limulus personal workstation cluster. | In terms of price, comparable core-heavy workstation solutions usually cost more than a comparable Limulus personal workstation cluster. | ||
- | **Why don't I just use the cloud?**\ | + | **Why don't I just use the cloud?**\\ |
- | The cloud is basically " | + | The cloud is basically " |
**What is Limulus' | **What is Limulus' | ||
- | There are several areas where a personal cluster can be useful (i.e where you own the reset switch). In addition, **Edge Computing** whereby compute resources are needed locally outside of a data center or cloud, has become and important factor in many deployments. Some examples are as follows: | + | There are several areas where a personal cluster can be useful (i.e. where you own the reset switch). In addition, **Edge Computing**, whereby compute resources are needed locally outside of a data center or cloud, has become and important factor in many deployments. Some examples are as follows: |
- | * System administrators - a cluster sandbox to try new things, test software packages | + | |
- | * Software developers - a private software development environment | + | * **System administrators** - a cluster sandbox to try new things, test software packages |
- | * Academic projects - instructional hardware, student projects, learn to run real HPC/ | + | |
- | * Cloud staging - stage and develop cloud HPC software before launching it to the cloud | + | |
- | * Small medium scale production work - test ideas, run applications under your control with up to 96 physical cores | + | |
- | * Small and medium-sized business HPC - explore how HPC can help manufacturing without a huge investment | + | |
- | * Big Data/Hadoop - try and test big data and Apache Hadoop/ | + | |
+ | | ||
====Hardware ==== | ====Hardware ==== | ||
- | **How many cores can you fit on one case?**\\ | + | **How many cores can you fit in one case?**\\ |
- | Currently, a single Limulus system can provide at least 32 cores (64 threads with AMD Ryzen processors). The 1000 level systems provide 64 cores (128 threads). The rack mount option can support up to four single Limulus systems for a total of 128 cores (256 threads). | + | Currently, a single Limulus system can provide at least 32 cores (64 threads with AMD Ryzen processors). The 1000-level systems provide 64 cores (128 threads). The rack mount option can support up to four single Limulus systems for a total of 128 cores (256 threads). |
**What kind of processors do you use?**\\ | **What kind of processors do you use?**\\ | ||
- | Our current designs include Ryzen processors from AMD (Intel available upon request). For the nodes we use low power (65 Watt six/ | + | Our current designs include Ryzen processors from AMD (Intel available upon request). For the nodes we use low-power 65-watt six/ |
**What kind of motherboards do you use?**\\ | **What kind of motherboards do you use?**\\ | ||
- | We can use almost any standard Micro-ATX (uATX) motherboard. However, we prefer to test them before we recommend any specific motherboard. Geometry and component issues (i.e. Gigabit Ethernet chipset) make some boards more desirable than others. | + | We can use almost any standard Micro-ATX (µATX) motherboard. However, we prefer to test them before we recommend any specific motherboard. Geometry and component issues (e.g. Gigabit Ethernet chipset) make some boards more desirable than others. |
**How do you fit those extra motherboards in a standard case?**\\ | **How do you fit those extra motherboards in a standard case?**\\ | ||
- | Our second generation uses uATX blades that can hold almost any standard | + | Our second generation uses µATX blades that can hold almost any standard |
**Why do you use 3D printing? | **Why do you use 3D printing? | ||
- | By using 3D printing we can keep costs lower (i.e. we don't have to buy sheet metal or injection molded parts in high quantity), easily manage design changes, and allow customized solutions. In addition 3D printing can be used to create sophisticated shapes that might otherwise | + | By using 3D printing we can keep costs lower (i.e. we don't have to buy sheet metal or injection molded parts in high quantity), easily manage design changes, and allow customized solutions. In addition, 3D printing can be used to create sophisticated shapes that might otherwise be expensive, difficult, |
**Will 3D printed plastic parts melt in a high performance computer? | **Will 3D printed plastic parts melt in a high performance computer? | ||
In a word, no. First, our systems are designed to run cool and have plenty of moving air and case ventilation to remove heat. Second, during normal | In a word, no. First, our systems are designed to run cool and have plenty of moving air and case ventilation to remove heat. Second, during normal | ||
operation, the hottest part of the system are the CPUs and active coolers. These devices | operation, the hottest part of the system are the CPUs and active coolers. These devices | ||
- | can reach 70-85° C before | + | can reach 70-85 °C before |
- | and have a default throttling temperature (72C) that will initiate kernel level throttling, if needed. Finally, all parts are printed (and annealed) using | + | and have a default throttling temperature (72 °C) that will initiate kernel-level throttling, if needed. Finally, all parts are printed (and annealed) using |
- | high performance PLA. The resulting parts start to become soft between 75-85° C. If would take some work to seal off the case so that the internal | + | high performance PLA. The resulting parts start to become soft between 75-85 °C. If would take some work to seal off the case so that the internal |
temperature is in this range (plus a bunch of other things would not work). | temperature is in this range (plus a bunch of other things would not work). | ||
Line 79: | Line 80: | ||
**Why don't you pack a bunch of 20-core processors into the case?**\\ | **Why don't you pack a bunch of 20-core processors into the case?**\\ | ||
- | Limulus is designed with a desk-side heat/ | + | Limulus is designed with a desk-side heat/ |
**Why don't you pack a bunch of GPU processors into the case?**\\ | **Why don't you pack a bunch of GPU processors into the case?**\\ | ||
- | Using GPUs is a great solution if it fits your problem, but GPUs require more power and more heat must be removed from the case. The Limulus DL (Deep Learning) systems employ GPUs. | + | Using GPUs is a great solution if it fits your problem, but GPUs require more power, and more heat must be removed from the case. The Limulus DL (Deep Learning) systems employ GPUs. |
**Do you use dual socket motherboards? | **Do you use dual socket motherboards? | ||
- | No. Limulus is designed to use single socket | + | No. Limulus is designed to use single socket |
**Can I connect multiple Limulus cases and create a bigger cluster? | **Can I connect multiple Limulus cases and create a bigger cluster? | ||
- | Yes, a whole " | + | Yes, a whole " |
**How are the nodes connected? | **How are the nodes connected? | ||
Line 94: | Line 95: | ||
**Does each motherboard have a hard drive?**\\ | **Does each motherboard have a hard drive?**\\ | ||
- | In the standard HPC design only the main motherboard has persistent storage. The nodes run using a RAM disk and are stateless (We use the Warewulf | + | In the standard HPC design, only the main motherboard has persistent storage. The nodes run using a RAM disk and are stateless (we use the Warewulf |
- | Our Hadoop models have dedicated SSD data drives (for HDFS) connected to each motherboard and we install the base operating system and all Hadoop software in a resident M.2 drive. | + | Our Hadoop models have dedicated SSD data drives (for HDFS) connected to each motherboard, and we install the base operating system and all Hadoop software in a resident M.2 drive. |
**Can I add extra hard drives?**\\ | **Can I add extra hard drives?**\\ | ||
- | Yes, each Limulus HPC system comes with an M.2 SSD for system software. There is an additional two 2.5 inch bays and six open 3.5 inch drive bays that can be used to increase the total number of drives to eight (two SSD, six HDD). RAID storage is now an option on all systems. | + | Yes, each Limulus HPC system comes with an M.2 SSD for system software. There are an additional two 2.5-inch bays and six open 3.5-inch drive bays that can be used to increase the total number of drives to eight (two SSD, six HDD). RAID storage is now an option on all systems. |
- | The Limulus Hadoop version has eight 2.5 bays (for SSD disks, used for HDFS) and six 3.5 inch bays for large spinning RAID sets. | + | The Limulus Hadoop version has eight 2.5-inch bays (for SSD disks, used for HDFS) and six 3.5-inch bays for large spinning RAID sets. |
**Can I add expansion cards to the node motherboards? | **Can I add expansion cards to the node motherboards? | ||
- | Yes, there is an optional bracket for adding one low profile PCIe card (usually 10GbE). And, it depends | + | Yes, there is an optional bracket for adding one low-profile PCIe card (usually 10GbE), |
**Can I add expansion cards to the main motherboard? | **Can I add expansion cards to the main motherboard? | ||
Line 109: | Line 110: | ||
**Can I add video cards to the node motherboards? | **Can I add video cards to the node motherboards? | ||
- | We include a low power video card and do not recommend using higher powered cards (in addition there may not be adequate | + | We include a low-power video card and do not recommend using higher-powered cards (in addition, there may not be adequate |
**How big is the power supply?**\\ | **How big is the power supply?**\\ | ||
- | Depending on the specific hardware installed 850 -1200 Watts. | + | Depending on the specific hardware installed, 850-1200 |
**Does it have ECC memory?**\\ | **Does it have ECC memory?**\\ | ||
- | When using AMD Ryzen processors the base Limulus models now support ECC (Error Correcting Memory). | + | When using AMD Ryzen processors, the base Limulus models now support ECC (Error Correcting Memory). |
- | Depending on the Intel processor, ECC an memory option may be available (Contact | + | Depending on the Intel processor, ECC as a memory option may be available (contact |
- | **Can it use 10 GbE or IB?**\\ | + | **Can it use 10-GbE, 25-GbE, or IB?**\\ |
- | We support 10 GbE using a low-noise switchless design. Single byte latencies range from 8-10 & | + | We support 10-GbE and 25-GbE using a low-cost switchless design. Single byte latencies range from 8-10 µsec (using Netpipe). IB is not currently supported. |
- | ====Power/Heat/Noise ==== | + | ====Power Heat Noise ==== |
**How much power does a Limulus use?**\\ | **How much power does a Limulus use?**\\ | ||
- | When running HPL (16 cores) we measure 320 Watts for the model 100. Of course it also depends on what you put in the system (i.e. disk, video card, etc.) | + | When running HPL (16 cores) we measure 320 watts for the model 100. Of course, it also depends on what you put in the system (i.e. disk, video card, etc.). |
- | As new generations of processors become available (with faster clocks and more cores), we continue to use 65 Watt versions to keep Limulus systems within the same power envelope. | + | As new generations of processors become available (with faster clocks and more cores), we continue to use 65-watt versions to keep Limulus systems within the same power envelope. |
**How many standard wall plugs (receptacles) do Limulus systems use?**\\ | **How many standard wall plugs (receptacles) do Limulus systems use?**\\ | ||
- | One. Unless | + | One, unless |
**Can I manually turn nodes off and on?**\\ | **Can I manually turn nodes off and on?**\\ | ||
Line 139: | Line 140: | ||
**Does it create a lot of heat?**\\ | **Does it create a lot of heat?**\\ | ||
- | Like all electronic devices, it generates heat. Unlike a high-end | + | Like all electronic devices, it generates heat. Unlike a high-end |
**How loud is it?**\\ | **How loud is it?**\\ | ||
- | It is very quiet. The use of large fans helps reduce noise considerably. It can sit next to a desk in an office without any significant impact on the ambient noise environment (i.e., it will not disturb conversations, | + | It is very quiet. The use of large fans helps reduce noise considerably. It can sit next to a desk in an office without any significant impact on the ambient noise environment (i.e. it will not disturb conversations, |
Line 148: | Line 149: | ||
**What software does it run?**\\ | **What software does it run?**\\ | ||
- | Linux of course. It comes installed with HPC cluster stack based on OpenHPC (you can use all OpenHPC packages).. All base packages are open source and built on top of CentOS 7.x. Other RPMS and SRPMS are freely available. All Limulus Hadoop systems use an open source Hadoop distribution. | + | Linux, of course. It comes installed with an HPC cluster stack based on OpenHPC (you can use all OpenHPC packages). All base packages are open source and built on top of CentOS 7.x. Other RPMs and SRPMs are freely available. All Limulus Hadoop systems use an open-source Hadoop distribution. |
**Will updated software be available? | **Will updated software be available? | ||
Line 158: | Line 159: | ||
**Is administrative | **Is administrative | ||
- | Yes, if we can remotely access the system(s) vis ssh and/or VPN. See our | + | Yes, if we can remotely access the system(s) vis ssh and/or VPN. See our available |
- | [[https:// | + | [[https:// |
**Is it the same software that runs on big clusters? | **Is it the same software that runs on big clusters? | ||
Yes. Applications can be moved from/to other clusters with little or no effort. | Yes. Applications can be moved from/to other clusters with little or no effort. | ||
- | **Will there be other open source application software available? | + | **Will there be other open-source application software available? |
Yes. | Yes. | ||
**Can I install my own software? | **Can I install my own software? | ||
- | Yes, this is an open source platform, you control your destiny! | + | Yes, this is an open-source platform; you control your destiny! |
**Can I run commercial software? | **Can I run commercial software? | ||
- | If your software can run on a large Linux cluster, it can probably run on a Limulus system. Currently, we use CentOS 7.X, which is a community rebuild of Red Hat 7.X. Of course it all depends on the software as well as vendor policies. | + | If your software can run on a large Linux cluster, it can probably run on a Limulus system. Currently, we use CentOS 7.X, which is a community rebuild of Red Hat 7.X. Of course, it all depends on the software as well as vendor policies. |
**Can I run Windows on it?**\\ | **Can I run Windows on it?**\\ | ||
Line 179: | Line 180: | ||
**Does it come with hardware support? | **Does it come with hardware support? | ||
- | Yes. One year return to depot support is included. | + | Yes. One year of return-to-depot support is included. |
You must pay shipping to the depot. | You must pay shipping to the depot. | ||
+ | |||
**Does it come with software support? | **Does it come with software support? | ||
- | Yes. Ninety days of software support | + | Yes. Ninety days of software support |
Extended [[https:// | Extended [[https:// | ||