On July 11th, Magic Leap made its third live broadcast on twitch. Lei Feng.com editors watched the entire live broadcast discovery. This is estimated to be the most out of the hardware software information released by Magic Leap!
The core points are as follows:
Delivery time: The Magic Leap One creator version will be delivered this summer (before September 22)
Hardware configuration: Compute unit Lightpack equipped with Nvidia Tegra X2 multi-core processor
Software configuration: 64-bit operating system based on Linux operating system
Content: Magic Kit The first tutorial content Dodge debut, can identify multiple planes at the same time, place virtual content, create a room-level experience
One hour of live broadcast, the Magic Leap One creator version is less than a minute to wear, like a toy
Dodge's presentation is still a recorded video, no live demonstrations with heads-up
Interaction design with ARKit, can't see big difference
In April, Magic Leap announced that it will be broadcast live on twitch on the first Wednesday of each month. Because the first two live broadcasts have no technical dry goods and product details, they are seriously squandered by the industry.
Today, Magic Leap conducted the third live broadcast, and finally came up with a little sincerity, and began to face the hardware core and software operations.
At the beginning of the live broadcast, the host gave the most critical information, Magic Leap will deliver the Magic Leap One creator version this summer, the host joked that summer is normal summer time (June 21-September 22), instead of The state of Florida spans the summer of the year. Lei Feng.com edited the finger and counted it. We can see the complete product in 102 days at the latest.
The live broadcast is divided into several sections, which introduce the CPU and GPU, the dynamics of the developer community, and the new content Dodge.
Equipped with Nvidia Tegra X2 multi-core processor
Lei FengwangReportedThe Magic Leap One creator version features a split-style design that includes AR glasses Lightwear, a 6Dof handle and a lightpack that can be placed around the waist.
Magic Leap has been promoting cool AR technologies such as space computing and digital light field, and it will definitely require powerful chip computing capabilities. At present, in order to achieve a good space perception and optical display effect, HoloLens almost put a computer into the head display, which also caused the head to weigh more than 500 grams. Magic Leap uses a split mode to place the computing unit in the Lightpack, which is designed to be worn at the waist, which somewhat reduces the weight of the head. But we have not known what kind of chip solution Magic Leap will adopt.
Alan Kimball, Magic Leap's developer technical strategy, explains that the Nvidia Tegra X2 is used in its computing unit LightPack, a powerful module that includes three processors: a quad-core ARM A57 CPU, a dual-core Denver 2 CPU and NVIDIA Pascal's GPU with 256 CUDA cores. He also mentioned that each core has different power consumption and performance characteristics, developers can choose between the kernels as needed, the code can run on the GPU, can run on ARM, or Denver.
The current version of HoloLens uses Intel's Atom processor chip. In contrast, the Nvidia Tegra X2 used by Magic Leap is more powerful, but HoloLens has also enhanced its design with the HPU (holographic image processing unit) used with Atom. The ability to display holograms. Lei Feng also reported that Microsoft is also developing a dedicated AI chip for HoloLens. How the computing power of Magic Leap One depends on the real machine effect.
In addition, the live broadcast also introduced Magic Leap's underlying software architecture is a 64-bit operating system based on the Linux operating system, with a unified memory system. They did not disclose how much memory the device would contain, but suggested that no one complained about insufficient memory. Magic Leap has promised a few hours of battery life, depending on the application being used.
Interactive design exposure
Since 2014, Magic Leap has released a number of videos showing its AR effects, including sharks splashing in the stadium, elephants in the palm of your hand, and robots hiding behind the legs of office desks. These early videos give the impression that Magic Leap's AR effect is awesome, the display is very realistic, and it can be obscured by real objects, completely integrated with the real world. But how are these objects placed in the real world?
In June 2017, Apple released ARKit, which defined the basic interaction design of AR: plane recognition, motion tracking, and illumination estimation.
This time, Magic Leap came up with the first Demo for developers, and we finally saw Magic Leap's AR interaction design for its spatial calculations and digital light field.
Magic Leap Chief Interaction and Experience Designer Colman Bryant introduced the first teaching content of the Magic Leap Developer Suite. Dodge, in his opinion, represents the most basic experience of mixed reality applications on Magic Leap.
Many people are looking forward to real-time live Demo demonstrations from the perspective of Magic Leap. Unfortunately, Magic Leap, known as the “Video” company, has chosen the recorded video Demo this time. There is video recording in the Magic Leap SDK. This demo is recorded by Magic Leap's camera, which combines the AR content with the real scene recorded by the camera. So the video perspective we see is the perspective of the person wearing Magic Leap.
From the demonstration, Magic Leap One is similar to Apple ARKit. The first step is to identify the actual surface in the room, support horizontal and vertical planes, and then display 3D digital objects on top of it.
As you can see from the figure, there is a blue grid when identifying the plane, followed by a denser red grid that turns green when the system determines that it is a usable plane.
Unlike Apple ARKit and Google ARCore, Magic Leap One can support multiple flat locations at the same time, allowing virtual content to be created across the entire room.
After creating the plane, we saw that the Dodge appeared from different points such as the sofa, the floor, and then, and then threw the stone at people, and the ground creaked. Since Magic Leap has 3D spatial sound, even if your eyes don't look at the virtual object, the sound will guide you to find the direction in which the virtual object appears. Bryant said that the Dodge Demo is just a "seed", developers can use Dodge's teaching files to develop more fun games.
Bryant also showed gesture recognition, which gestures are similar to HoloLens's only gestures, pinching the thumb and index finger to indicate a click. It is said that Magic Leap's Gesture Recognition SDK also tracks individual fingers and joints, fists and other full gestures, as well as eye tracking and head tracking.
It is understood that to load content into Magic Leap One, you can use the USB-C port on the LightPack or transfer files via Wi-Fi. Since multiple Magic Leap Ones can join the same Wi-Fi network, developers say that multiplayer and shared mixed reality environments are possible and interesting.
From the interaction design shown by Dodge, Magic Leap is not much different from ARKit. The innovation is that Magic Leap can support multiple plane recognition at the same time, creating a room-level experience, but scanning users at multiple locations will also feel the operation. Difficult.
Although the hardware and software information is published, Magic Leap's main core technologies such as spatial computing and digital light field are still a mystery, and it is these technologies that determine whether Magic Leap can be worth close to $1 billion. value.
We have reported that from the previously published patent documents,Instead of using fiber optic scanning, which has been used for many years, Magic Leap uses a multi-layer optical waveguide.HoloLens' glasses use holographic optical waveguides, and there are rumors that Apple will also produce glasses for optical waveguide solutions. Lei Feng.com editors can't help but worry about the future of Magic Leap.
Finally, Magic Leap and AT&T announced today that they will be the exclusive offline distributor of Magic Leap One devices for US consumers and are investing unspecified amounts in the company. AT&T claims that developers will get the equipment ahead of the consumer, and the AT&T store will launch Magic Leap sales in five US cities.