Tesla’s Dojo supercomputer represents a significant investment and commitment to innovation in the field of AI computation, positioning Tesla as a key player in shaping the future of neural net hardware.
Questions to inspire discussion.
Continue reading “Tesla’s Dojo Supercomputer: A Game-Changer in AI Computation” »
An AI-driven supercomputer dubbed Earth’s ‘digital twin’ could help us avoid the worst impacts of climate catastrophes headed our way.
Today is the ribbon-cutting ceremony for the “Venado” supercomputer, which was hinted at back in April 2021 when Nvidia announced its plans for its first datacenter-class Arm server CPU and which was talked about in some detail – but not really enough to suit our taste for speeds and feeds – back in May 2022 by the folks at Los Alamos National Laboratory where Venado is situated.
Now we can finally get more details on the Venado system and get a little more insight into how Los Alamos will put it to work, and more specifically, why a better balance of memory bandwidth and compute that depends upon it is perhaps more important to this lab than it is in other HPC centers of the world.
Los Alamos was founded back in 1943 as the home of the Manhattan Project that created the world’s first nuclear weapons. We did not have supercomputers back then, of course, but plenty of very complex calculations have always been done at Los Alamos; sometimes by hand, sometimes by tabulators from IBM that used punch cards to store and manipulate data – an early form of simulation. The first digital computer to do such calculations at Los Alamos was called MANIAC and was installed in 1952; it could perform 10,000 operations per second and ran Monte Carlo simulations, which use randomness to simulate what are actually deterministic processes.
Microsoft is reportedly planning to build a $100 billion data center and supercomputer, called “Stargate,” for OpenAI.
A combination of advances in magnetic resonance imaging to help track the movement of fluids in the brain and supercomputer-powered simulations are modifying our understanding of cognitive decline.
😗😁😘 year 2023.
The world’s first supercomputer capable of simulating networks at the scale of the human brain has been announced by researchers at the International Centre for Neuromorphic Systems (ICNS) at Western Sydney University.
DeepSouth uses a neuromorphic system which mimics biological processes, using hardware to efficiently emulate large networks of spiking neurons at 228 trillion synaptic operations per second — rivalling the estimated rate of operations in the human brain.
Ching-Yao Tang and Ke-Jung Chen used the powerful supercomputer at Berkeley National Lab to create the world’s first high-resolution 3D hydrodynamics simulations of turbulent star-forming clouds for the first stars. Their results indicate that supersonic turbulence effectively fragments the star-forming clouds into several clumps, each with dense cores ranging from 22 to 175 solar masses, destined to form the first stars of masses of about 8 to 58 solar masses that agree well with the observation.
Furthermore, if the turbulence is weak or unresolved in the simulations, the researchers can reproduce similar results from previous simulations. This result first highlights the importance of turbulence in the first star formation and offers a promising pathway to decrease the theoretical mass scale of the first stars. It successfully reconciles the mass discrepancy between simulations and observations, providing a strong theoretical foundation for the first star formation.
A recently tenured faculty member in MIT’s departments of Mechanical Engineering and Materials Science and Engineering, Kim has made numerous discoveries about the nanostructure of materials and is funneling them directly into the advancement of next-generation electronics.
His research aims to push electronics past the inherent limits of silicon — a material that has reliably powered transistors and most other electronic elements but is reaching a performance limit as more computing power is packed into ever smaller devices.
Today, Kim and his students at MIT are exploring materials, devices, and systems that could take over where silicon leaves off. Kim is applying his insights to design next-generation devices, including low-power, high-performance transistors and memory devices, artificial intelligence chips, ultra-high-definition micro-LED displays, and flexible electronic “skin.” Ultimately, he envisions such beyond-silicon devices could be built into supercomputers small enough to fit in your pocket.
Computer simulations are giving us new insight into the riotous behavior of cannibal neutron stars.
When a neutron star slurps up material from a close binary companion, the unstable thermonuclear burning of that accumulated material can produce a wild explosion that sends X-radiation bursting across the Universe.
How exactly these powerful eruptions evolve and spread across the surface of a neutron star is something of a mystery. But by trying to replicate the observed X-ray flares using simulations, scientists are learning more about their ins and outs – as well as the ultra-dense neutron stars that produce them.
Process, and store data, most of which is handled by the rapidly expanding cloud. A stable, secure, real-time system may allow for interfacing the cloud with the human brain. One promising strategy for enabling such a system, denoted here as a “human brain/cloud interface” (“B/CI”), would be based on technologies referred to here as “neuralnanorobotics.” Future neuralnanorobotics technologies are anticipated to facilitate accurate diagnoses and eventual cures for the ∼400 conditions that affect the human brain. Neuralnanorobotics may also enable a B/CI with controlled connectivity between neural activity and external data storage and processing, via the direct monitoring of the brain’s ∼86 × 109 neurons and ∼2 × 1014 synapses. Subsequent to navigating the human vasculature, three species of neuralnanorobots (endoneurobots, gliabots, and synaptobots) could traverse the blood–brain barrier (BBB), enter the brain parenchyma, ingress into individual human brain cells, and autoposition themselves at the axon initial segments of neurons (endoneurobots), within glial cells (gliabots), and in intimate proximity to synapses (synaptobots). They would then wirelessly transmit up to ∼6 × 1016 bits per second of synaptically processed and encoded human–brain electrical information via auxiliary nanorobotic fiber optics (30 cm3) with the capacity to handle up to 1018 bits/sec and provide rapid data transfer to a cloud based supercomputer for real-time brain-state monitoring and data extraction. A neuralnanorobotically enabled human B/CI might serve as a personalized conduit, allowing persons to obtain direct, instantaneous access to virtually any facet of cumulative human knowledge. Other anticipated applications include myriad opportunities to improve education, intelligence, entertainment, traveling, and other interactive experiences. A specialized application might be the capacity to engage in fully immersive experiential/sensory experiences, including what is referred to here as “transparent shadowing” (TS). Through TS, individuals might experience episodic segments of the lives of other willing participants (locally or remote) to, hopefully, encourage and inspire improved understanding and tolerance among all members of the human family.
“We’ll have nanobots that… connect our neocortex to a synthetic neocortex in the cloud… Our thinking will be a… biological and non-biological hybrid.”
— Ray Kurzweil, TED 2014
