Since 1986 - Covering the Fastest Computers in the World and the People Who Run Them
September 20, 2010
MATLAB users with a taste for GPU computing now have a perfect reason to move up to the latest version. Release R2010b adds native GPGPU support that allows user to harness NVIDIA graphics processors for engineering and scientific computing. The new capability is provided within the Parallel Computing Toolbox and Distributed Computing Server.
MathWorks released R2010b in early September, and is taking advantage of this week's NVIDIA GPU Technology Conference in San Jose, California, to demonstrate the new GPU computing support. Early adopters, though, have already had a chance to check out the software. A beta version of the GPGPU support was unveiled at SC09 last November, attracting hundreds of customers who wanted to give the new capabilities a whirl.
According to Silvina Grad-Freilich, senior manager for Parallel Computing at MathWorks, that was about five or six times more beta registrations than they were anticipating. They also were somewhat surprised to see such a wide range of users sign up. "We were expecting to receive requests from people in very defined areas like finance or academia," said Grad-Freilich. "Interestingly enough, customers from all of the industries that we sell to registered for the beta."
The initial support for GPUs is confined to NVIDIA gear, and only for those CUDA-supported devices with a compute capability of 1.3 or higher. In the Tesla product line, that equates to the 10-series and 20-series (Fermi) GPUs. The rationale for limiting support to the late-model CUDA GPUs had to do with lack of double-precision floating point support and IEEE compliance in pre-1.3 CUDA GPUs. The MATLAB team felt both were required to make GPU computing a worthwhile capability for its customer base of scientists, engineers, and quantitative analysts.
Access to the GPU can be accomplished in two ways: via invocation of existing CUDA kernels and through high-level programming support that has been incorporated into MATLAB. Using the first method, users who are ahead of the curve GPGPU-wise will be able to leverage already-developed CUDA software, allowing them to call CUDA kernels inside MATLAB applications. But according to Grad-Freilich, they expect most MATLAB users will want to employ the new high-level support to get access to the graphics processors.
For native MATLAB GPU support, code changes to existing apps should be relatively minor. At minimum, the developer needs to invoke one call (gpuArray) to transfer the data array to the GPU and another call (gather) to transfer it back to the CPU host. The computations in between can use existing MATLAB built-in functions that have been overloaded to work on GPU arrays. GPUs can also be accessed with custom MATLAB functions provided by the user, simply by plugging the GPU array parameters into the function invocation. In the initial release, MathWorks has overloaded over 100 of the most commonly-used mathematical functions for GPU computing. Here is a simple GPU computing code snippet:
>> A = someArray(1000, 1000);
>> G = gpuArray(A); % Transfer data to GPU memory
…
>> F = fft(G); % computation on the GPU
>> x = G\b; % computation on the GPU
…
>> z = gather(x); % Bring back into the MATLAB host
The new support also includes the ability to distribute an application across a GPU cluster or a multi-GPU workstation, using MATLAB's parallel for loop (parfor). In this scenario, computations in the parallelized loop are executed on multiple GPUs in the user's setup. Because of the abstraction of MATLAB parallelization, the source code is portable across different types of multi-GPU configurations -- workstations, clusters and grids.
By offering this simple interface, MATLAB is able to hide all the gritty GPU details of hardware initialization, data transfer and memory management from the user. And since the average MATLAB user is a domain specialist rather than a professional C/C++ programmer, this allows them to remain in their software comfort zone. On the other hand, many MATLAB apps are intended only for prototyping. When they go into production, they may end up as professionally-developed C/C++ programs, the idea being to improve performance.
One of the nice outcomes of GPU acceleration is that some MATLAB codes can be made fast enough for production deployment. The speedups for some algorithms are on par with other GPGPU accelerated apps. In MathWorks' own tests, they were able to demonstrate a 50-fold computational speedup on a GPU versus the CPU implementation. In this case, the program was a spectrogram application using FFT functions, and executed on a 16-node GPU cluster.
However, when the CPU-to-GPU data transfer time was factored in, the measured speedup was just five-fold. That still represents very respectable acceleration, but it illustrated the performance penalty of the data transfers back and forth across the PCIe link (as well as, in this case, the GigE network of the cluster). Perhaps the more salient metric is the number of FFTs that can be managed by the different processors. The CPUs can only process a handful of FFT functions at a time, while the GPUs can handle millions, giving the GPU implementation much greater scalability
Although GPGPU is a new feature for MATLAB, there is already a lot of capability included for users who happen to have access to the newer NVIDIA hardware. The intention is to grow this functionality across the next several releases. To get a more detailed look and what's available today, check out the MATLAB GPU Support web page.
(Digg, Technorati, more)
HPC Product in Review: Appro 1U Tetra GPU Server
The Appro 1U Tetra server combines four NVIDIA Tesla™ M2050 cards with 12 CPU-cores in a single 1U server. First 1U server to achieve over 1 TeraFLOP on Linpack!
Sep 24 | Power consumption of big supercomputers not that outrageous. Read more...
Sep 23 | Integrated graphics threatens GPU pricing subsidies. Read more...
Sep 21 | Microsoft announces the third release of its Windows server operating system for technical computing. Read more...
Sep 16 | For cosmologists, no supercomputer is too big. Read more...
Sep 15 | Cubicle Clustered Computing concept aimed at HPC's "missing middle." Read more...
Jul 20 | | BlueArc's network storage systems are compelling solutions for the evolving and unpredictable needs of an NGS environment. They offer significant performance, scalability, utilization and cost benefits, while catering to the manageability needs of various users in a research organization.
Jul 29 | | Panasas storage solutions deliver high throughput with many concurrent backup IO streams to standard backup applications such as Veritas NetBackup™ or EMC® NetWorker™. Download this whitepaper to understand the essential elements for effective backup and restore: the tape subsystem, networking, file system workload and administrative policy.
Discover the benefits of Appro’s hybrid CPU/GPU servers and clusters based on NVIDIA Tesla M2050 computing. Learn how to maximize HPC system performance while achieving reliability, density and easy upgradeability for small, medium, and large-sized installations.
In this webinar you will hear about the current storage challenges facing the HPC community, how Panasas storage solutions provide exceptional performance, scalability, and manageability, and how you can achieve the lowest total Cost of Ownership with a system that installs and configures in 15 minutes.
This webcast will present the key value and benefits of the new Appro GreenBlade System based on 8 to 12- cores AMD Opteron™ 6100 series processor. You will learn how to maximize the system performance scalability, reliability and serviceability while reducing electricity costs in your datacenter. In addition, we will go over GreenBlade System building block recipes that enables multiple clusters to be built based on the same cluster architecture for small, medium and large-sized HPC deployments across a broad range of vertical markets. Register for this Cloud Computing webinar now!
