Toggle light / dark theme

A new way to create realistic 3D shapes using generative AI

Creating realistic 3D models for applications like virtual reality, filmmaking, and engineering design can be a cumbersome process requiring lots of manual trial and error.

While generative artificial intelligence models for images can streamline artistic processes by enabling creators to produce lifelike 2D images from text prompts, these models are not designed to generate 3D shapes. To bridge the gap, a recently developed technique called Score Distillation leverages 2D image generation models to create 3D shapes, but its output often ends up blurry or cartoonish.

MIT researchers explored the relationships and differences between the algorithms used to generate 2D images and 3D shapes, identifying the root cause of lower-quality 3D models. From there, they crafted a simple fix to Score Distillation, which enables the generation of sharp, high-quality 3D shapes that are closer in quality to the best model-generated 2D images.


A new AI method enables the generation of sharp, high-quality 3D shapes that are closer to the quality of the best 2D image models. Previous approaches typically generated blurry or cartoonish 3D shapes.

This New AI Is SCARY — Like SORA But LIMITLESS

The Matrix is a groundbreaking AI model capable of generating infinite, high-quality video worlds in real time, offering unmatched interactivity and adaptability. Developed using advanced techniques like the Video Diffusion Transformer and Swin-DPM, it enables seamless, frame-level precision for creating dynamic, responsive simulations. This innovation surpasses traditional systems, making it a game-changer for gaming, autonomous vehicle testing, and virtual environments.

🔍 Key Topics Covered:
The Matrix AI model and its ability to generate infinite, interactive video worlds.
Real-time applications in gaming, autonomous simulations, and dynamic virtual environments.
Revolutionary AI techniques like Video Diffusion Transformer, Swin-DPM, and Interactive Modules.

🎥 What You’ll Learn:
How The Matrix AI redefines video generation with infinite-length, high-quality simulations.
The transformative impact of real-time interactivity and domain generalization in AI-driven worlds.
Why this breakthrough is a game-changer for industries like gaming, VR, and autonomous systems.

📊 Why This Matters:
This video uncovers a groundbreaking AI innovation that merges real-time interactivity with infinite video generation, setting the stage for a future of responsive and immersive virtual environments.

DISCLAIMER:
This video delves into The Matrix AI model, highlighting its advancements, capabilities, and potential to revolutionize technology and industry through innovation.

#ai.

Ultra-compact optical design enhances virtual and augmented reality device cameras

Researchers from Seoul National University College of Engineering announced they have developed an optical design technology that dramatically reduces the volume of cameras with a folded lens system utilizing “metasurfaces,” a next-generation nano-optical device.

By arranging metasurfaces on the so that light can be reflected and moved around in the glass substrate in a folded manner, the researchers have realized a with a thickness of 0.7mm, which is much thinner than existing refractive lens systems. The research was published on Oct. 30 in the journal Science Advances.

Traditional cameras are designed to stack multiple glass lenses to refract light when capturing images. While this structure provided excellent high-quality images, the thickness of each lens and the wide spacing between lenses increased the overall bulk of the camera, making it difficult to apply to devices that require ultra-compact cameras, such as virtual and augmented reality (VR-AR) devices, smartphones, endoscopes, drones, and more.

Engineering wiredengineers on October 4, 2024: Disney’s HoloTile is a groundbreaking 360-degree treadmill designed for virtual reality

It allows multiple users to walk in any direction without colliding, enhancing VR immersion. Developed by Disney Imagineer Lanny Smoot, this innovation could revolutionize VR experiences and stage performances. (Video Credit: Disney Parks/YouTube)

Metalenses harness AI for high-resolution, full-color imaging for compact optical systems

Modern imaging systems, such as those used in smartphones, virtual reality (VR), and augmented reality (AR) devices, are constantly evolving to become more compact, efficient, and high-performing. Traditional optical systems rely on bulky glass lenses, which have limitations like chromatic aberrations, low efficiency at multiple wavelengths, and large physical sizes. These drawbacks present challenges when designing smaller, lighter systems that still produce high-quality images.

Virtual training uses generative AI to teach robots how to traverse real world terrain

MIT CSAIL researchers have developed a generative AI system, LucidSim, to train robots in virtual environments for real-world navigation. Using ChatGPT and physics simulators, robots learn to traverse complex terrains. This method outperforms traditional training, suggesting a new direction for robotic training.


A team of roboticists and engineers at MIT CSAIL, Institute for AI and Fundamental Interactions, has developed a generative AI approach to teaching robots how to traverse terrain and move around objects in the real world.

The group has published a paper describing their work and possible uses for it on the arXiv preprint server. They also presented their ideas at the recent Conference on Robot Learning (CORL 2024), held in Munich Nov. 6–9.

Getting robots to navigate in the real world at some point involves teaching them to learn on the fly, or by training them with videos of similar robots in a real-world environment. While such training has proven to be effective in limited environments, it tends to fail when a robot encounters something novel. In this new effort, the team at MIT developed virtual training that better translates to the real world.

Who’s afraid of Artificial Intelligence?

Artificial Intelligence is everywhere in Europe.

While some are worried about its long-term impact, a team of researchers at the University of Technology in Vienna is working on responsible ways to use AI.

Watch more 👉


From industry to healthcare to the media and even the creative arts, artificial intelligence is already having an impact on our daily lives. It’s hailed by advocates as a gift to humanity, but others worry about the long-term effects on society.

Developed and fiercely defended by some, criticised if not openly feared by others, the phrase on everyone’s lips, AI, Artificial Intelligence, generates passionate hopes but also widespread concerns throughout the European Union. Who are the potential winners, and who are the potential losers of this new digital revolution in the making? We travelled to Austria and Estonia to try to find out.

Around 3/4 of European employees have already had practical experience with AI. Artificial Intelligence already develops new virtual reality tools. It helps transcribe medieval manuscripts. It contributes to the design of autonomous vehicles, or futuristic buildings. But its use is also raising concerns in schools and universities, while workers and trade unions fear its effect on certain job categories.