Escolar Documentos
Profissional Documentos
Cultura Documentos
HIGH-PERFORMANCE
COMPUTING
HANDBOOK
OPTIMIZE YOUR PRODUCT DESIGN CYCLE.
P U B L I S H E D I N PA R T N E R S H I P W I T H
TABLE OF CONTENTS
PROLOGUE 4
CHAPTER 1 7
Create a Computing Workflow to Support Simulation-led Design
CHAPTER 2 22
Building a Balanced Workstation
CHAPTER 3 34
Parallelization Primer
HPC HANDBOOK
every 24 months. most bang for your buck when running specific engineering applications.
How parallel software paired with modern processors can improve engineering
DOWNLOADING
ONE CHAPTER GIVES
USERS ACCESS TO
FUTURE CHAPTERS,
productivity.
GORDON MOORE, Intel co-founder ALL AT NO COST.
What virtualization means to the design engineer and why IT wants to deploy it.
An analysis ofprofessional workstations vs. consumer PCs.
How to tap into additional computing power when on the go.
A roundup of the latest workstation hardware.
A
Simulation success storiesthat show how HPC enables simulation-led design in
s the world marks the 50th anniversary of Moores Law, its difficult not various industries.
to be amazed and even bewildered by the advances in computing tech- Simulation benchmarking studies.
nology. Today we take for granted thecomputing power now available in
cheap, easy-to-use smartphones. Soon, the power of supercomputers will
be just as accessible. What will that mean for design engineering? Why the HPC Handbook?
Design engineers are facing a more disruptive technological landscape today thanwhen
While most organizations dont have access to 36,000 cores today, it wont be long Moores Law was coined. The exponential increase in accessible computing powercou-
before these extreme core counts are commonplace, said Wim Slagter, product manag- pled with ubiquitous connectivity has fueled an exponential increase in product com-
er, High-Performance Computing (HPC), ANSYS in theFebruary 2015 issue ofDesktop plexity. Its no longer enough to design and develop products. Todays engineering teams
Engineering. And even todays users who are running at much lower core counts will are designing and developing systems from self-drivingcars to lightweight aircraft to
see direct benefits through considerably greater efficiencies. The results will be more all the connected devices that create the Internet of Things.
amazing products delivered to customers much faster than ever.
Advances insimulation-led design, optimization technologies and data management are
Achieving those results will require more than just advances in computing hardware. It helping design engineering teams innovate more quickly and powerful, affordable,
requires accessibility and affordability. Accessibility is enabled byengineeringsoftware accessible engineeringcomputing hardware and software makes it all possible.Thats
thattakes advantage of those hardware advanceswhilebeing so easy to use that theyre- whyThe Design Engineers High-Performance ComputingHandbookwas created. Design
quire no special knowledge to do so. Affordability is a relative term based on total cost engineering teams need a constantly evolving reference resource that explains
of ownership vs. return on investment, but theres no disputing the fact that computing whatworkstations, clusters and cloud computing can do when used with the latest
prices continue to decreaseas computing power increases. simulation, visualization and rendering software.
In fact, thats the pointMoore was trying to make when he inadvertentlylaid down the
law via a wild extrapolation.
T
he process of taking an inventory of needs will vary from organization to
organization. A small engineering team may get everyone in the same room to
get the groups needs out in the open. A large, engineering-centered enterprise
may opt to create a planning team or hire a consultant to observe, survey and interview DOWNLOADING
its engineers to reveal the same information. No matter what form the process takes, its ONE CHAPTER GIVES
USERS ACCESS TO
important to differentiate between wants and needs. FUTURE CHAPTERS,
ALL AT NO COST.
Needs are simply the differences between your current achievements and your desired
accomplishments, according to A Guide to Assessing Needs3, a free resource available
via theWorld Banks open knowledge initiative that deeply delves into the process of
3 Watkins, Ryan; West Meiers, Maurya; Visser, Yusra Laila. 2012.A Guide to Assessing
1 Mastering Product Complexity, Roland Berger Strategy Consultants. Needs : Essential Tools for Collecting Information, Making Decisions, and Achieving Devel-
2 2015 Siemens PLM Connection Americas User Conference presentation. opment Results. World Bank. World Bank. https://openknowledge.worldbank.org/han-
dle/10986/2231 License: CC BY 3.0 IGO.
F
or those need gaps that can be closed with computing technology, its important tasks to two GPUs: an NVIDIA using the Quadro GPU.
to consider more than just hardware. Hardware is only made useful by software,
so the software youre using now, the software you should be using now, and the
software you plan to use in the future should help guide your hardware investments.
Conceptual Design easy geometry editing. If you want fit [a product that must connect, join, or fit into a
Conceptual design software applications have become much more than digital nap- predefined space], you may need a parametric modeler. If you want function [the opera-
kins, as theyre sometimes called. In Form, Fit or Function, which appeared in the tion of the product], you could explore simulation, he says. KEY WORDS
May 2015 issue of Desktop Engineering, Dr. Ken Versprille, executive consultant at parallel processing:
CIMdata, said conceptual design means different things to different people. While conceptual designs definition has broadened beyond sketching out and sharing dividing program
instructions
If your major criteria is form [the shape or the look of the product], you would want ideas, its still the main class of engineering software that makes use of tablet comput-
among multiple
ings mobility and touchscreen interfaces (see Digital Napkins sidebar). Tablets can fit processors in order
well into a design engineering workflow in situations where mobility is critical, such as to complete the
instructions faster.
capturing data in the field.
Specialized simulation apps a fairly recent development are also making tablets
more useful to design engineers. Such apps, often created by simulation analysts, allow
TABLETS non-experts to change variables and run particular simulations. The apps can be particu-
larly useful on the shop floor or in customers offices.4
+ PROS:
More portable than laptops
When deciding on a tablet or ultraportable, consider the fact that an ultraportable lap-
Touchscreen interface
top or tablet-laptop hybrid may fulfill both needs for a high level of mobility and basic
Long battery life
CAD functionality, albeit at a slightly higher price and weight than a tablet.
Many specialized apps
- CONS:
With the advent of Windows 8, most PC manufacturers released tablets and convert-
ible systems combining touchscreens with small, often detachable keyboards, wrote
Limited functionality
Limited processing power
Limited onboard storage
4 For more information on simulation apps, see Desktop Engineerings Expert-Built Apps
Limited expandability
Expand the Reach of Simulation, The Appification of Simulation, and Engineering for
Everyone.
It took more than 10 hours to complete the five drawings using AutoCAD 2010 com-
pared to 6.5 hours to complete the same five drawings using AutoCAD 2015, represent-
ing time savings of 36%, without any change to the computer on which the software
WORKSTATIONS was run, according to the report, Getting the Most from AutoCAD 2015 with Dell
PROS: Precision Workstations. When the workstation was upgraded to the more modern Dell
+ Versatile Precision T1700, the time required to complete the five drawings using AutoCAD 2015
Affordable Power was further reduced to 5.3 hours, a total time saving of 48% compared to using Auto-
UPGRADING FROM OLDER
Ease of Setup and Use CAD 2010 on an older workstation. WORKSTATIONS OR FROM
CONSUMER PCs TO PRO
Expandable/Customizable WORKSTATIONS
Another example shows similarly impressive results. Lenovo pitted a 2010 ThinkStation PROVIDES A QUICK
- CONS: S20 against a 2013 ThinkStation S30 running SolidWorks 2013. Both workstations were ROI.
Software patches often equipped with graphics cards from the middle of the range of cards they support, sol-
consist of individual updates id-state drives (SSDs) and the same amount of RAM. The newer workstation completed
Not easily portable the SPECviewperf12 benchmarks for SolidWorks 2013 more than twice as fast as the
Not infinitely scalable three-year-old workstation.
Because of the workstations central place in most design engineers work, upgrading
consumer-level PCs to professional engineering workstations (see High-end PC vs.
larger models typical to many industries. In the engineering workflow, tablets are often Entry-level Workstation sidebar), or investing in new workstations every three years
confined to quick concept work and reviewing designs on the go while ultrabooks add can provide a big speed boost to support the latest versions of software for detailed
some additional CAD functionality. However, cloud computing, Software-as-a-Service CAD work as models get larger.
(SaaS) and specialized apps continue to evolve, making it possible to even do more with
mobile computing power even some simulation work. Unlike ultraportables and tablets, workstations are designed to be customized. Most
vendors offer purpose-built baseline models with the option to change the processor
and graphics, add more memory, use different hard drive technology and more. The
Detailed CAD challenge is to buy what your particular needs require without over investing in features
KEY WORDS
The bulk of CAD work is still performed on engineering workstations that come in you wont use.
cloud computing: small, desktop form factors as well as larger, deskside towers and mobile variations, each
Using remote
computing with a number of different internal configurations of processors, storage, memory and If your needs include anything beyond CAD and small simulation runs,
resources, such graphics. This versatility is what has made workstations the workhorses of engineering the optimal workstation recommendations will change. Small simula-
as a network of design. There are very few, if any, engineering workflows that would be improved by tions are those in which you set up models, add and couple physics, and HPC RESOURCES
servers via the
Internet rather than completely bypassing the workstation. investigate different scenarios. + PROS:
a local computing Scalability
resource.
If your inventory of needs includes speeding up design time, then investing in both the latest Cost saving potential
software and the latest workstations is an option worth investigating. Software vendors are Simulation and Rendering Flexibility
SaaS: Stands for constantly updating their engineering applications to take advantage of the latest hardware For most engineers, the question isnt whether to incorporate workstations Reduced software
Software-as-a- improvements. Investing in one without the other will not allow you to realize your full per- into a simulation-led design engineering workflow, but when to incorpo- maintenance
Service, which
formance potential. Using outdated hardware has even more significant consequences when rate other high-performance computing (HPC) options such as servers,
describes a means
of subscription working with larger, more complex models. clusters and cloud computing. Often, those needs coincide with the need - CONS:
software licensing to do more simulations simultaneously to arrive at an optimized design, to Can be daunting to setup
and delivering the Overcoming security
software from a
For example, Desktop Engineering Contributing Editor David Cohn worked with Au- simulate more complex models, or to create more realistic renders.
todesk and Dell to test the productivity gains a typical user would experience when concerns
central location.
upgrading to Autodesk AutoCAD 2015 software. Using older systems and a newer Dell Many of our customers come to us after they have lost projects totheir Dependent on connectivity
Precision T1700 workstation, Cohn timed the repeated creation of common drawings, competition on a time-to-market basis, Dominic Daninger, vice Often dependdent on
off-site support
If you have modern workstations, but your simulation and/or rendering workload is still The shadow looming over cloud computing since its inception has been security, but
bogging them down and youre using software that is able to take advantage of mul- that concern is lessening. Security at popular public cloud computing platforms, such
tiple processing cores then offloading certain intensive computing tasks is a workflow as Amazon Web Services and Microsoft Azure, and service providers is generally better
slam dunk. However, those are a lot of criteria, and even if theyre met, which type of than what most SMBs (and even many large enterprises) can support in-house. Howev-
HPC resource should you turn to? er, some companies are still leery of putting their intellectual property in the cloud. For
those companies, a private cluster is a practical option.
As a general rule of thumb, public cloud computing is especially well suited for small-
and medium-sized businesses (SMBs). The business case is hard to resist: virtually
unlimited computing power available as needed without a significant IT infrastructure Clusters/Private Cloud Computing
or staffing investment. Intellectual property protection is one of the key reasons that customers choose to go
with an in-house private cluster vs. a cloud solution, Nor-Techs Daninger said. An-
Chris Teague, senior applications engineer at Saratech, a Solid Edge Reseller headquar- other reason is very few cloud HPC offerings have InfiniBand fabric (for networking).
tered in Mission Viejo, CA, outlines the perfect cloud computing customer in Desktop Cloud solutions typically will offer 10GB Ethernet, which has much longer latency KEY WORD
Engineerings July 2015 issue: Certainly the guy who is running part-time CAD and times than current InfiniBand fabric, he said. InfiniBand: A
cant justify buying the software and hardware all at once, he says. Smaller companies fast networking
communications
Rod Mach, principal at TotalCAE, a provider of private cloud and engineering IT standard used
services, said private clusters also allow companies to tap into HPC resources without within and between
modifying their engineering workflow. There are no extra CAE licensing complexities, high-performance
computers.
all work can be done on the same central system, he said. An on-premise professionally
KEEP MOBILE IN MIND managed cluster is much cheaper for your baseline constant engineering computation
needs.6
If youre not prepared to work anywhere, your At the same time, engineers appreciate the ability to
competitors might be. Mobile workstation take their work on the road, or even just down the hall. SMBs arent the only organizations weighing their HPC options. Even large enterprises
speeds increasingly compete with basic desktop work- With the prices for mobile power dropping, design with their own data centers should consider on-demand HPC resources for the engi-
stations. More and more, engineers are finding they engineers are finding fewer reasons to not make mobile neering department. Shared, enterprise-wide resources can easily be consumed with
dont have to choose between power and portability. part of their design arsenal. multiple simulation runs. For many companies, offloading the most intensive tasks to a
Jamie Gooch dedicated HPC resource whether onsite or in the cloud results in a net gain for
According to Tom Salomone, Engineering and AEC and productivity because smaller jobs can be run via internal servers and arent being held up
Manufacturing Segment Marketing Manager at Lenovo, by the larger ones.
more than two-thirds of design engineers with mobile
computers also use a desktop workstation. The key is to an optimal workflow is to find the hardware and software configuration
that is optimal for your specific environment, without purchasing more than you need,
Most people have mobile and desktop workstations, or investing in a solution that will not provide sufficient performance improvements to
Salomone said in a white paper produced by Desktop justify the additional cost. Take a balanced approach to get the most productivity for
Engineering8. Mobile still has some limitations. People your investment.
want bigger screens and access to more options; whats
happened is they are putting more on the desktop to
get better productivity, and you cant carry all
of that.
Y
ouve analyzed your needs, determined the right hardware for your software customers. We tell them not to worry about the licensing issues. We work with vendors
and decided on the best configuration for you computing resources. Youre Dassault, MSC, ANSYS, and others to figure out the best licensing plan for our clients.
done, right? Wrong. Your needs analysis should have determined why a partic-
ular computing resource is needed, but that doesnt mean your team will automatically If you like the idea of a turnkey solution, HPC Appliances are also an option. Physical
understand how to use those resources effectively, or how to navigate software vendors appliances provide private, in-house access to more computing power, while virtual
licensing requirements, which can quickly become complex. appliances do the same on the cloud. Both types of appliances are essentially pre-con-
figured hardware clusters designed specifically to plug and play with a particular design
Even putting something as simple an inexpensive computer tablet in the hands of the engineering software platform. HPC Appliances are an attractive option for simu-
engineers on your team is a waste of money and time without proper training. Likewise, lation-dependent businesses that dont want to invest in full-scale data centers, but
an engineer given an upgraded workstation may not fully realize and therefore not arent prepared to work exclusively with SaaS either. For those caught in the tug of war
MANY ENGINEERING TEAMS fully utilize its capabilities. Many engineering teams drop the ball when it comes to between in-house servers and the cloud, the plug-and-play simulation hardware might
DROP THE BALL WHEN IT just be their safe harbor.
COMES TO TRAINING AND training and support.
SUPPORT.
Finish strong in the deployment stage to make the most out of your local hardware.
Review
On the other end of the spectrum, many engineering teams are wary about deploying This chapter of The Design Engineers High-Performance Computing Handbook was writ-
cluster-based solutions. In the past, HPC clusters were notoriously difficult to imple- ten to provide a broad overview of the computing options available to support a sim-
ment, requiring specially trained IT personnel to set up, manage and configure jobs. ulation-led design workflow. Computing solutions geared toward conceptual design
engineering, CAD, CAE and rendering were provided to allow you to investigate the
In a typical HPC cluster scenario, a variety of open source tools are employed one options that will fulfill your specific needs.
program might handle provisioning of the cluster nodes while another package deals
with network configurations and yet another tool takes on scheduling and load balanc- Future chapters will delve more deeply into topics such as building a balanced worksta-
ing. Each package is equipped with a different user interface and corresponding learning tion, parallelization, virtualization, mobile computing and more. As a subscriber to the
curve, which means someone in IT has to be versed in the entire portfolio of tools or HPC Handbook, you will be notified when future chapters are available. In the mean-
a firm must have several HPC specialists on staff, which is cost prohibitive for most time, please visit hpc.deskeng.com for more high-performance computing resources for
design engineering teams.
SMBs. To add to the challenge, clusters have become increasingly complex as the num-
KEY WORDS ber of nodes and cores grows and the mix of components on which to distribute jobs
PaaS: Stands expands to include both CPUs and graphics accelerators.
for Platform-
as-a Service, a
computing model
Yet advances in HPC configurations and cluster management software are addressing
in which hardware these barriers to entry, making it far easier for smaller companies to get on board. For
and software tools example, IBM Technical Computing is now delivering high performance systems inte-
are provided to
users as a service. grated with workload and resource management tools that put HPC capabilities within
reach of SMBs from both a price/performance and ease of manageability perspective.98
HPC Applicances: Many service providers109 also specialize in helping engineering teams get up and run-
Hardware pre-
configured with ning on clusters or the cloud. Some even offer popular engineering design and simu-
software, often to lation software-as-a-service (SaaS) and Platform-as-a Service (PaaS) implementations
perform a specific that help customers, large and small, create and run customized, repeatable, multi-solver
function such as
providing additional simulation and optimization cycles.
compute power
for simulation or We can run [a simulation] using the customers existing licenses, or we can run it using
rendering.
9 For more information on clusters, see Desktop Engineerings The Future is Now white
paper.
10 See Desktop Engineerings Services Directory for providers that help setup HPC resources:
deskeng.com/services
The HP Z1 G2 is We try to go SSD when we can and when the budget allows, Chris Teague, a senior
an all-in-one
workstation aimed applications engineer at Solid Edge Reseller Saratech tells Desktop Engineering. You
at CAD users. Read can get a smaller SSD for the boot drive, and if you need a larger amount of space you
the full review can do a traditional hard drive for data. At least get an SSD for boot. If the budget
in the July 2014
edition of Desktop allows, then we have configured systems with four SSD drives in a RAID array for data,
Engineering. and a smaller one for boot.
1
Answers to Your Workstation Questions, Desktop Engineering, August 2015
The GPU
The size and complexity of the models are the biggest
consideration when it comes to GPU selection. The system
should provide a 15 frames per second (fps) to 20 fps re-
fresh rate; anything below that would look slow or clunky,
although what level of performance is good enough is a
subjective measure.
KEY WORDS There are also monitors available with 4k and 5k resolution and wide aspect ratios. As To get beyond the budgetary and cultur-
4k and 5k: you increase the resolution of the display, you are putting the same sort of pressure on al shortsightedness, look to the future.
resolutions of the GPU to draw that many pixels. Models are going to continue to grow in
40962304 and
5120x2880 (16:9
size, and modern design software capa-
aspect ratio), We now have GPUs that have so much rasterization that we can drive two or three bilities will continue to take advantage of
respectively. 4k displays off a single GPU, Waters says. But you cant get that performance from the latest advances in computing hard-
entry-level products. ware.
Rasterization:
converting an
image into pixels/ One display issue that sometimes gets overlooked is the signal range of the display. The Over the last three years, those hardware
dots for display on a bandwidth connection on that cable has a lot of data going across it, Waters says. You advances include more productive
video display
have to be careful with lower-cost displays, because they may only be able to send a 2k computational and graphics processing
Upconvert: scaling signal and then upconvert it. You may struggle with some instability. via new architectures and more cores;
a lower resolution faster memory speeds with error-
signal to fill a higher correcting code memory that helps
resolution screen
Software Optimization
The last piece of the workstation optimization puzzle isnt part of the hardware at all.
Software settings can provide another big boost to performance, although exactly what
those settings are will vary by application.
The LENOVO THINKSTATION P300
SFF WORKSTATION is targeted at
Some OEMs can help automate the process of matching the software to the machine. entry-level 3D and 2D CAD users.
Dell, for example, has a performance optimizer on its Precision workstations that Read the full review.
ROI CALCULATION EXAMPLE Selecting the most practical workstation with the BOXX TECHNOLOGIES overclocks the processors in its workstations, which
right features to match your application usage can boost productivity in applications like CAD. Read the full review.
TIME SPENT DOING ANNUAL BENEFIT FROM can provide hours of increased productivity. The effi-
DESIGN WORK: INCREASING DESIGN ciency gains should be top of mind, particularly for organizations that are considering cutting
A third of 250 working days PRODUCTIVITY: corners on the hardware in order to reduce costs.
= about 83 days per year $35 per hour for 8 hours
a day for 29.88 days According to Desktop Engineerings series of reports benchmarking various simulation FOCUS ON PRODUCTIVITY:
ANNUAL COST OF = $8,366.40. THE INVESTMENT IN A WORK-
and design software by comparing three-year-old software running on three-year-old
STATION IS INSIGNIFICANT
AN ENGINEERS hardware against their current equivalents, engineers are seeing simulation time savings COMPARED TO THE COST
DESIGN WORK: ADDITIONAL TIME of up to 6X by upgrading.5 OF THE ENGINEER
$35 per hour for 8 hours SPENT DOING DESIGN WORK USING IT.
We keep making our data problems bigger and bigger, Reinders says. Because of But how far can this go? Is there an upward limit at which simply adding more cores
that, computers can get more use from parallelism as time goes on. As long as we use isnt going to provide any more value?
more and more data, then parallelism will be required.
In theory there is no upward limit. There are super computers, for instance, that use
SOFTWARE MUST BE
DESIGNED TO TAKE The majority of engineering and design software has been architected to take advantage tens of thousands of nodes. However, there is a point at which particular problems or
ADVANTAGE OF PARALLEL of parallelism. Some software providers have struggled with building tools to take ad- applications no longer see a return on the investment in computational horsepower.
PROCESSING.
vantage of this approach because of inexperience or because the software was originally When you look at simulations, there is a level at which you can break the problem
designed when single-core was the standard. down to, where you are still getting good bang for your buck, Reinders says. If you
keep breaking it down into smaller pieces, there can be too much overhead involved in
The question becomes how much does this perturb the way the program was written orig- moving the data around.
inally, Reinders says. There are a lot of applications that were written when there was just
one core in a machine. This can affect the architecture of the application in a profound way. According to Amdahls Law, once you have infinitely fast computation, the bottleneck
is going to move somewhere else, Ramey adds. Total execution time might be limited
Developing software that takes advantage of these capabilities also requires sustained and by the storage system. Another area might be communication between nodes, when
continued HPC software development to effectively leverage the hardware. The soft- adjacent nodes need to exchange some state information. At the extreme end, with hun-
ware should be able to support simulation resources where they are located, Slagter says. dreds of thousands of cores, its possible that the bottleneck is going to be the speed of
Certifying remote software solutions is important, along with expertise and support from the interconnect or bandwidth between nodes.
HPC partners like Intel, NVIDIA, Hewlett Packard, etc., so you can make sure that you
have an optimized reference architecture for the software and good support. Still, with access to thousands of cores, there is a definite payoff in performing more
simulations at the same time. But if there is only a limited amount of data you want to
process, then there will be a limit to how many cores you can throw at the problem and
see a noticeable difference in how fast the problem is solved, Reinders says.
With cloud-based resources, uploading and downloading data and results can create
bottlenecks as well. Its very clear that the cloud, much like on-premise HPC infra-
CALCULATION 1 structure, is going to provide high bandwidth, storage, fast processors and low latency,
Slagter says. But the cloud may put a limit on the data because the huge amount of data
can affect the performance of the system. The time required to move files and download
CORE 1 results can take many hours. That may cause a productivity hit and impede the use of
CORE 2 CALCULATION 2 HPC in the cloud.
DATA DATA
STREAM STREAM
CORE 3 CALCULATION 3 The solution is to leave the data where it is and perform operations in the cloud. There
are specific requirements for cloud computing in terms of job scheduling to optimize
CORE 4
use of cloud infrastructure, Slagter says. Its important that you take care of data man-
agement and simulation job management.
CALCULATION 4
Parallelism has helped engineers improve and accelerate large computational tasks, with
very little downside. As software vendors continue to take advantage of these advances
in CPU and GPU capacity, simulation and rendering work will continue to be faster
and more responsive, helping designers to increase iterations and improve design.
PARALLEL PROCESSING In parallel computing, multiple cores can be used to cooperatively solve large
computations by dividing them into smaller computations that can be solved simulataneously, thus
speeding the overall solution time.