VCs have given nearly half a billion dollars to a stealth startup called SambaNova Systems to build “a new kind of computer to replace the typical Von Neumann machines expressed in processors from Intel and AMD, and graphics chips from Nvidia.”
The last thirty years in computing, said CEO Rodrigo Liang, have been “focused on instructions and operations, in terms of what you optimize for. The next five, to ten, to twenty years, large amounts of data and how it flows through a system is really what’s going to drive performance.” It’s not just a novel computer chip, said Liang, rather, “we are focused on the complete system,” he told ZDNet. “To really provide a fundamental shift in computing, you have to obviously provide a new piece of silicon at the core, but you have to build the entire system, to integrate across several layers of hardware and software….”
[One approach to training neural networks with very little labeled data] is part of the shift of computer programming from hard-coded to differentiable, in which code is learned on the fly, commonly referred to as “software 2.0.” Liang’s co-founders include Stanford professor Kunle Olukotun, who says a programmable logic device similar to a field-programmable gate array could change its shape over and over to align its circuitry [to] that differentiated program, with the help of a smart compiler such as Spatial. [Spatial is “a computing language that can take programs and de-compose them into operations that can be run in parallel, for the purpose of making chips that can be ‘reconfigurable,’ able to change their circuitry on the fly.”]
In an interview in his office last spring, Olukotun laid out a sketch of how all that might come together. In what he refers to as a “data flow,” the computing paradigm is turned inside-out. Rather than stuffing a program’s instructions into a fixed set of logic gates permanently etched into the processor, the processor re-arranges its circuits, perhaps every clock cycle, to variably manipulate large amounts of data that “flows” through the chip…. Today’s chips execute instructions in an instruction “pipeline” that is fixed, he observed, “whereas in this reconfigurable data-flow architecture, it’s not instructions that are flowing down the pipeline, it’s data that’s flowing down the pipeline, and the instructions are the configuration of the hardware that exists in place.
Read more of this story at Slashdot.
Source: Slashdot – Stealth Startup Plans Fundamentally New Kind of Computer with Circuit-Rearranging Processor