How far can Pervasive DataRush scale?
Pervasive DataRush was invented to be able to automatically and continually scale applications that are both data and computation heavy, as long as you are willing to throw more (increasingly inexpensive and commoditized) hardware at the application. All data and computation heavy applications are eventually either IO-bound or CPU-bound or both. Pervasive DataRush can help with both, given the right mix of auto-parallelizing components, but is probably going to be more explosive around CPU-boundedness, given the rapid advances we are seeing and continuing to forecast around multicore chips and the massively multi-threaded future they promise. While benchmarking results don’t necessarily translate across applications we anticipate that many but NOT all data-intensive applications will enjoy, provided no IO constraints, approximately 60%+ linear throughput gains for every doubling of cores. Our internal testing has so far confirmed this on 2-, 4-, 8- and 16-way machines, and we are conti
