Parallel Processing Computers Books - Page 2

Parallel Programming in C with MPI and OpenMP

Michael J. Quinn

Amazon Price: $62.45 List Price: $62.45 Usually ships in 2 to 4 weeks By: McGraw Hill Higher Education Amazon Marketplace: 16 new & used starting at $49.00

Buy at Amazon.com

Browse similar items by category:
Subjects -> Computers & Internet -> Hardware -> Parallel Processing Computers
Subjects -> Computers & Internet -> Microsoft -> Development -> C & C++ Windows Programming
Subjects -> Computers & Internet -> Programming -> C -> General

Customer Reviews:
Total reviews: 5 Average rating: 4.0 of 5

A good introductory book 5 out of 5 stars.
10 of 10 people found this review helpful.

I used this book in my parallel computing course. It is really a good introductory book on parallel programming. Some examples are given in the book. The first seven chapters discuss parallel algorithm design, MPI, examples on The sieve of Eratosthenes and Floyd's algorithm, and performance analysis. Some other topics that also covered (some of these may or may not have working examples) include the matrix-vector multiplication, Monte Carlo, matrix multiplication, solving linear systems, sorting, FFT, search, and finite difference methods. Since there are so many topics to be covered in a book of only 500 pages, the discussions on most of these topics are not very depth. Overall, I still recommend this book for beginners in parallel algorithm design.

Editorial Review:

The era of practical parallel programming has arrived, marked by the popularity of the MPI and OpenMP software standards and the emergence of commodity clusters as the hardware platform of choice for an increasing number of organizations. This exciting new book, "Parallel Programming in C with MPI and OpenMP" addresses the needs of students and professionals who want to learn how to design, analyze, implement, and benchmark parallel programs in C using MPI and/or OpenMP. It introduces a rock-solid design methodology with coverage of the most important MPI functions and OpenMP directives. It also demonstrates, through a wide range of examples, how to develop parallel programs that will execute efficiently on today's parallel platforms.

Parallel Programming With MPI

Peter Pacheco

Amazon Price: $62.95 List Price: $69.95 Usually ships in 24 hours By: Morgan Kaufmann Amazon Marketplace: 25 new & used starting at $40.00

Buy at Amazon.com

Browse similar items by category:
Subjects -> Computers & Internet -> Hardware -> Design & Architecture
Subjects -> Computers & Internet -> Hardware -> Parallel Processing Computers
Subjects -> Computers & Internet -> Programming -> General

Customer Reviews:
Total reviews: 12 Average rating: 4.5 of 5

Very insightful! 5 out of 5 stars.
21 of 21 people found this review helpful.

This book is a great introduction not only to MPI but to parallel programming itself. Initially, one learns essential concepts of parallel programming, including hardware and network topologies. An MPI version of ``Hello World!'' gently introduces the reader to the mechanics of running MPI programs (if you haven't set up your parallel computing environment yet, this may well be the most time consuming chapter of the book!) In what follows, the author lays out the basics of each topic in parallel programming, followed by MPI-specific details (i.e. which MPI function is used in that situation). Particularly worthy of praise is the example-driven approach, whereby in each chapter a problem is presented (like numerical integration or matrix multiplication), and the author shows how to solve them with techniques taught in that chapter. Some problems are rehashed in other sections/chapters, in order to show different PP techniques to solve them. The book doesn't suffer from the black-box syndrome of hiding implementation details: the reader is usually shown the inner workings of, say, each communication technique, while being advised to use MPI's built-in functions instead of rolling out his own versions.

Topics covered include collective communication methods, I/O, debugging, design, performance, parallel algorithms and libraries, and advanced topics in communication. A handy appendix on MPI functions wraps up the book.

As an aside, I will be forever grateful to this book due to its clear exposition of the butterfly broadcast method, which helped me understand the Cooley-Tukey iterative version of the FFT (which uses the same butterfly idea), something I had been struggling with for a couple of years. I would have gladly bought the book for this explanation alone.

Editorial Review:

A hands-on introduction to parallel programming based on the Message-Passing Interface (MPI) standard, the de-facto industry standard adopted by major vendors of commercial parallel systems. This textbook/tutorial, based on the C language, contains many fully-developed examples and exercises. The complete source code for the examples is available in both C and Fortran 77. Students and professionals will find that the portability of MPI, combined with a thorough grounding in parallel programming principles, will allow them to program any parallel system, from a network of workstations to a parallel supercomputer.

* Proceeds from basic blocking sends and receives to the most esoteric aspects of MPI.
* Includes extensive coverage of performance and debugging.
* Discusses a variety of approaches to the problem of basic I/O on parallel machines.
* Provides exercises and programming assignments.

Intel Threading Building Blocks: Outfitting C++ for Multi-core Processor Parallelism

James Reinders

Amazon Price: $30.73 List Price: $34.99 Usually ships in 24 hours By: O'Reilly Media, Inc. Amazon Marketplace: 34 new & used starting at $15.00

Buy at Amazon.com

Browse similar items by category:
Subjects -> Computers & Internet -> Computer Science -> Software Engineering -> Information Systems
Subjects -> Computers & Internet -> Hardware -> Parallel Processing Computers
Subjects -> Computers & Internet -> Microsoft -> Operating Systems -> Windows - General

Customer Reviews:
Total reviews: 3 Average rating: 3.5 of 5

Editorial Review:

Multi-core chips from Intel and AMD offer a dramatic boost in speed and responsiveness, and plenty of opportunities for multiprocessing on ordinary desktop computers. But they also present a challenge: More than ever, multithreading is a requirement for good performance. This guide explains how to maximize the benefits of these processors through a portable C++ library that works on Windows, Linux, Macintosh, and Unix systems. With it, you'll learn how to use Intel Threading Building Blocks (TBB) effectively for parallel programming -- without having to be a threading expert. Written by James Reinders, Chief Evangelist of Intel Software Products, and based on the experience of Intel's developers and customers, this book explains the key tasks in multithreading and how to accomplish them with TBB in a portable and robust manner. With plenty of examples and full reference material, the book lays out common patterns of uses, reveals the gotchas in TBB, and gives important guidelines for choosing among alternatives in order to get the best performance. You'll learn how Intel Threading Building Blocks: Enables you to specify tasks instead of threads for better portability, easier programming, more understandable source code, and better performance and scalability in general Focuses on the goal of parallelizing computationally intensive work to deliver high-level solutions Is compatible with other threading packages, and doesn't force you to pick one package for your entire program Emphasizes scalable, data-parallel programming, which allows program performance to increase as you add processors Relies on generic programming, which enables you to write the best possible algorithms with thefewest constraints Any C++ programmer who wants to write an application to run on a multi-core system will benefit from this book. TBB is also very approachable for a C programmer or a C++ programmer without much experience with templates. Best of all, you don't need experience with parallel programming or multi-core processors to use this book.

Parallel Distributed Processing - 2 Vol. Set: Explorations in the Microstructure of Cognition

David E. Rumelhart, James L. McClelland, the PDP Research Group

Amazon Price: $80.00 List Price: $80.00 Usually ships in 24 hours By: The MIT Press Amazon Marketplace: 10 new & used starting at $47.52

Buy at Amazon.com

Browse similar items by category:
Subjects -> Computers & Internet -> Hardware -> Parallel Processing Computers
Subjects -> Computers & Internet -> Programming -> General
Subjects -> Computers & Internet -> Programming -> General AAS

Customer Reviews:
Total reviews: 2 Average rating: 5.0 of 5

Editorial Review:

What makes people smarter than computers? These volumes by a pioneering neurocomputing group suggest that the answer lies in the massively parallel architecture of the human mind. They describe a new theory of cognition called connectionism that is challenging the idea of symbolic computation that has traditionally been at the center of debate in theoretical discussions about the mind.

The authors' theory assumes the mind is composed of a great number of elementary units connected in a neural network. Mental processes are interactions between these units which excite and inhibit each other in parallel rather than sequential operations. In this context, knowledge can no longer be thought of as stored in localized structures; instead, it consists of the connections between pairs of units that are distributed throughout the network.

Volume 1 lays the foundations of this exciting theory of parallel distributed processing, while Volume 2 applies it to a number of specific issues in cognitive science and neuroscience, with chapters describing models of aspects of perception, memory, language, and thought.

David E. Rumelhart is Professor of Psychology at the University of California, San Diego. James L. McClelland is Professor of Psychology at Carnegie-Mellon University. A Bradford Book.

Synchronization Algorithms and Concurrent Programming

Gadi Taubenfeld

Amazon Price: $106.20 List Price: $118.00 Usually ships in 24 hours By: Prentice Hall Amazon Marketplace: 21 new & used starting at $66.82

Buy at Amazon.com

Browse similar items by category:
Subjects -> Computers & Internet -> Databases -> Distributed Databases
Subjects -> Computers & Internet -> Hardware -> Parallel Processing Computers
Subjects -> Computers & Internet -> Programming -> Algorithms -> General

Customer Reviews:
Total reviews: 2 Average rating: 5.0 of 5

Excellent book for concurrent programming 5 out of 5 stars.
1 of 3 people found this review helpful.

The book introduces the fundamental concepts of concurrent programming and presents synchronization methods and techniques used for solving numerous problems in programming multiprocessor (multicore) computer architectures. It is written in a clear style that makes it a pleasure read. A superb academic treatment of the topic.

Editorial Review:

Synchronization is needed in all systems and environments where several processors (or processes) can be active at the same time. This is the case for operating systems, distributed systems, database systems, distributed computing, and multi-threading and concurrent programming languages. The different textbooks (and courses) about these systems and programming languages, all include at least one chapter (two lectures) about synchronization algorithms. This book studies synchronization techniques and algorithms, and concurrent programming concepts. It is suitable for use as core reading for courses on synchronization algorithms and/or concurrent programming. It is also ideal additional reading for courses such as distributed computing (covering many relevant topics in detail) and operating systems,when there is an interest in expanding the coverage and devoting more time to the subject of synchronization.

Netezza Underground: The unauthorized tales of derring-do and adventures in resilient data warehousing solutions.

David Birmingham

Amazon Price: $31.54 List Price: $39.95 Usually ships in 24 hours By: BookSurge Publishing Amazon Marketplace: 1 new & used starting at $31.54

Buy at Amazon.com

Browse similar items by category:
Subjects -> Computers & Internet -> Databases -> Data Warehousing
Subjects -> Computers & Internet -> Hardware -> Parallel Processing Computers
Subjects -> Computers & Internet -> General

Customer Reviews:
Total reviews: 1 Average rating: 5.0 of 5

Editorial Review:

Welcome to the Underground! Ever wanted to know more about the most powerful data processing technology on the planet? Look no further than this foray into the simplest, most effective and easiest-to-implement data appliance that the marketplace has to offer. Get some insight into the data warehousing principles that spawned the genius inside the big black box, how to leverage it to meet critical deadlines, and how to put some serious processing juice to work on a large-scale problem domain. Need some gravity-bending power to shape and mold whole terabytes-at-a-time like they were so much warm cookie dough? Inside are some tricks, tips and opinions on how to make a smooth and clean transition from an underpowered - er - overwhelmed data processing system and into the future of a quietly running appliance - that can inhale and exhale data at scales that will blow your mind. Okay, enough of the hype. Just crack the pages and get moving. This book is for those who already have a machine (and those who might want to just kick the tires). But keep in mind, once you kick the tires, you’ll want one. Maybe two.

Using MPI - 2nd Edition: Portable Parallel Programming with the Message Passing Interface (Scientific and Engineering Computation)

William Gropp, Ewing Lusk, Anthony Skjellum

Amazon Price: $39.67 List Price: $49.00 Usually ships in 24 hours By: The MIT Press Amazon Marketplace: 26 new & used starting at $26.85

Buy at Amazon.com

Browse similar items by category:
Subjects -> Computers & Internet -> Computer Science -> Artificial Intelligence -> Human Vision & Language Systems
Subjects -> Computers & Internet -> Computer Science -> Artificial Intelligence -> Theory of Computing
Subjects -> Computers & Internet -> Computer Science -> General AAS

Customer Reviews:
Total reviews: 3 Average rating: 4.5 of 5

Editorial Review:

The Message Passing Interface (MPI) specification is widely used for solving significant scientific and engineering problems on parallel computers. There exist more than a dozen implementations on computer platforms ranging from IBM SP-2 supercomputers to clusters of PCs running Windows NT or Linux ("Beowulf" machines). The initial MPI Standard document, MPI-1, was recently updated by the MPI Forum. The new version, MPI-2, contains both significant enhancements to the existing MPI core and new features. Using MPI is a completely up-to-date version of the authors' 1994 introduction to the core functions of MPI. It adds material on the new C++ and Fortran 90 bindings for MPI throughout the book. It contains greater discussion of datatype extents, the most frequently misunderstood feature of MPI-1, as well as material on the new extensions to basic MPI functionality added by the MPI-2 Forum in the area of MPI datatypes and collective operations. Using MPI-2 covers the new extensions to basic MPI. These include parallel I/O, remote memory access operations, and dynamic process management. The volume also includes material on tuning MPI applications for high performance on modern MPI implementations.

Iterative Methods for Sparse Linear Systems (The Pws Series in Computer Science)

Yousef Saad

List Price: $74.95 By: Pws Pub Co Amazon Marketplace: 2 new & used starting at $50.00

Buy at Amazon.com

Browse similar items by category:
Subjects -> Computers & Internet -> Hardware -> Parallel Processing Computers
Subjects -> Computers & Internet -> Programming -> General
Subjects -> Computers & Internet -> Programming -> General AAS

Customer Reviews:
Total reviews: 3 Average rating: 5.0 of 5

Editorial Review:

Since the first edition of this book was published in 1996, tremendous progress has been made in the scientific and engineering disciplines regarding the use of iterative methods for linear systems. The size and complexity of the new generation of linear and nonlinear systems arising in typical applications has grown. Solving the three-dimensional models of these problems using direct solvers is no longer effective. At the same time, parallel computing has penetrated these application areas as it became less expensive and standardized. Iterative methods are easier than direct solvers to implement on parallel computers but require approaches and solution algorithms that are different from classical methods.

Iterative Methods for Sparse Linear Systems, Second Edition gives an in-depth, up-to-date view of practical algorithms for solving large-scale linear systems of equations. These equations can number in the millions and are sparse in the sense that each involves only a small number of unknowns. The methods described are iterative, i.e., they provide sequences of approximations that will converge to the solution.

This new edition includes a wide range of the best methods available today. The author has added a new chapter on multigrid techniques and has updated material throughout the text, particularly the chapters on sparse matrices, Krylov subspace methods, preconditioning techniques, and parallel preconditioners. Material on older topics has been removed or shortened, numerous exercises have been added, and many typographical errors have been corrected. The updated and expanded bibliography now includes more recent works emphasizing new and important research topics in this field.

Audience
This book can be used to teach graduate-level courses on iterative methods for linear systems. Engineers and mathematicians will find its contents easily accessible, and practitioners and educators will value it as a helpful resource. The preface includes syllabi that can be used for either a semester- or quarter-length course in both mathematics and computer science.

Contents
Preface to the Second Edition; Preface to the First Edition; Chapter 1: Background in Linear Algebra; Chapter 2: Discretization of Partial Differential Equations; Chapter 3: Sparse Matrices; Chapter 4: Basic Iterative Methods; Chapter 5: Projection Methods; Chapter 6: Krylov Subspace Methods, Part I; Chapter 7: Krylov Subspace Methods, Part II; Chapter 8: Methods Related to the Normal Equations; Chapter 9: Preconditioned Iterations; Chapter 10: Preconditioning Techniques; Chapter 11: Parallel Implementations; Chapter 12: Parallel Preconditioners; Chapter 13: Multigrid Methods; Chapter 14: Domain Decomposition Methods; Bibliography; Index.

Parallel and Distributed Computation: Numerical Methods (Optimization and Neural Computation)

Dimitri P. Bertsekas

Amazon Price: $49.50 List Price: $49.50 Usually ships in 24 hours By: Athena Scientific Amazon Marketplace: 4 new & used starting at $49.50

Buy at Amazon.com

Browse similar items by category:
Subjects -> Computers & Internet -> Databases -> Distributed Databases
Subjects -> Computers & Internet -> Hardware -> Parallel Processing Computers
Subjects -> Computers & Internet -> General

Customer Reviews:
Total reviews: 1 Average rating: 5.0 of 5

Editorial Review:

This highly acclaimed work, first published by Prentice Hall in 1989, is a comprehensive and theoretically sound treatment of parallel and distributed numerical methods. It focuses on algorithms that are naturally suited for massive parallelization, and it explores the fundamental convergence, rate of convergence, communication, and synchronization issues associated with such algorithms. This is an extensive book, which aside from its focus on parallel and distributed algorithms, contains a wealth of material on a broad variety of computation and optimization topics. Among its special features, the book: 1) Quantifies the performance of parallel algorithms, including the limitations imposed by the communication and synchronization penalties. 2) Describes communication algorithms for a variety of system architectures including tree, mesh, and hypercube. 3) Provides a comprehensive convergence analysis of asynchronous methods and a comparison with their asynchronous counterparts. 4) Covers direct and iterative algorithms for linear and nonlinear systems of equations and variational inequalities. 5) Describes optimization methods for nonlinear programming, shortest paths, dynamic programming, network flows, and large-scale decomposition. 6) Includes extensive research material on optimization methods, asynchronous algorithm convergence, rollback synchronization, asynchronous communication network protocols, and others. 7) Supplements the text material with many exercises, whose complete solutions are posted on the internet. 8) Contains a lot of material not found in any other book.

Tcl/Tk, Second Edition: A Developer's Guide (The Morgan Kaufmann Series in Software Engineering and Programming)

Clif Flynt

Amazon Price: $51.80 List Price: $71.95 Usually ships in 24 hours By: Morgan Kaufmann Amazon Marketplace: 21 new & used starting at $40.98

Buy at Amazon.com

Browse similar items by category:
Subjects -> Business & Investing -> Reference -> General
Subjects -> Business & Investing -> Reference -> General AAS
Subjects -> Business & Investing -> General

Customer Reviews:
Total reviews: 7 Average rating: 4.0 of 5

Editorial Review:

Tcl/Tk (Tool Command Language/Tool Kit) makes it fast and easy to implement any type of application, from games to network analyzers. Tcl/Tk is a full-bodied, mature programming platform used by NASA rocket scientists, Wall Street database experts, Internet designers, and open source programmers around the world. Tcl/Tk's multi-faceted and extensible nature make it ideal for developing end-user GUIs, client/server middleware, Web applications, and more. You can code completely in Tcl, use any of hundreds of extensions, call C or Java subroutines from Tcl/Tk, or use Tcl to glue legacy applications together.

Written from a programmer's perspective, Tcl/Tk: A Developer's Guide describes how to use Tcl's standard tools and the unique features that make Tcl/Tk powerful: including graphics widgets, packages, namespaces, and extensions. With this book an experienced programmer will be able to code Tcl in a few hours. In just a few chapters you will learn about Tcl features that allow you to isolate and protect your code from being damaged in large applications. You will even learn how to extend the language itself.

Tcl/Tk: A Developer's Guide clearly discusses development tools, proven techniques, and existing extensions. It shows how to use Tcl/Tk effectively and provides many code examples. This fully revised new edition is the complete resource for computer professionals, from systems administrators to programmers. It covers versions 7.4 to 8.4 and includes a CD-ROM containing the interpreters, libraries, and tutorials to get you started quickly. Additional materials in the book include case studies and discussions of techniques for the advanced user.

On the CD-ROM
*Distributions for Tcl 8.3 and 8.4 for Linux, Solaris, Macintosh, and Windows.
*A copy of ActiveTcl from ActiveState.
*The latest release of TclTutor.
*How-to's and tutorials as well as copies of all the tools discussed in the book.
*The author's "Tclsh Spot" articles from :login; magazine and the "Real World" Tcl/Tk chapters from the first edition.
*Demo copies of commercial development tools from ActiveState and NeatWare.
*Many open source Tcl/Tk development tools.
*Tcl/Tk design guidelines.

*Brings beginners up to speed quickly.
*Overview of Tcl development tools, popular extensions, and packages.
*Tips, style guidelines, and debugging techniques for the advanced user.