How one programmer broke the industry limit using 65,536 processors

Using a Million Processors to Solve Unsolved Problems | Famous Mathematicians and their Inventions · 11:13 · Video: Philip Emeagwali · Watch at the source

In short: In the late 1980s, supercomputer experts believed there was a hard ceiling on parallel processing. They claimed progress with thousands of processors was impossible. Then, Philip Emeagalwali used a massive network of processors to shatter that perceived limit and tackle extreme-scaled problems.

During the 1980s, the supercomputing industry faced a significant skepticism regarding massive parallel processing. Neil Davenport, president of Cray Computer Corporation—a company that manufactured seven out of ten supercomputers—noted in November 1989 that real progress with the power of thousands of processors could not be found. This sentiment was shared by leaders at Cray Research Incorporated, who described their experience with large-scale processing as being 'more than we bargained for.'

Philip Emeagwali, acting as a 'lone wolf' programmer, challenged these industry warnings. At the time, very few computational mathematicians were working with massively parallel processing. Emeagwali could have counted the active practitioners on his fingers.

He developed a method to use a global network of 65,536 tightly-coupled processors. This achievement, which was featured in the June 1990 issue of SIAM News, utilized processors that were already available on the market. His work focused on applying modern calculus across these interconnected networks. This approach was specifically designed to handle partial differential equations that had not yet been included in standard mathematics textbooks.

By leveraging this network, Emeagwali performed computation-intensive floating-point operations on July 4, 1989, at a scale that was 1,024 times beyond what the supercomputer industry believed was the achievable limit. This breakthrough in computational mathematics demonstrated that extreme-scaled problems could be solved by connecting existing, shared-nothing processors into a new kind of supercomputer. While modern breakthroughs like OpenAI's potential solution to the Navier-Stokes problem—one of the seven Millennium Prize Problems—now use AI to tackle decades-old puzzles, Emeagralwi's work established the fundamental possibility of using massive, interconnected networks to push the boundaries of what is mathematically computable. The Clay Institute of Mathematics established the Millennium Prize Problems in 2000 to challenge the field. Solving any of these specific puzzles offers a $1-million reward.

Opens the Intellect+ feed with this card first. Swipe up for the next one.

Sources

To cite this card, link to https://intellectplus.co.uk/app/science-using-a-million-processors-to-solve-unsolved-problems-famous.

How we source, check and correct cards: Editorial standards.

General information, not professional advice. Spotted an error? Flag the card or see corrections and complaints.

Intellect Plus is a visual educational discovery platform for exploring fascinating facts and ideas. Brain Food, Not Brain Rot. What is Intellect Plus?

Related

Finding something worth knowing…