Revolutionizing Game Development: Unity’s AI Advancements with Unity Muse and Unity Sentis

AI has already begun to be applied in areas where it is necessary to analyze and generate content. In particular, artificial intelligence is implemented in game and app development. AI is getting popular primarily due to its ability to significantly speed up and facilitate the content development process. Instead of spending several hours manually creating graphics for games and applications, you can use AI to generate the necessary components on its own simply. Then the developer will make their edits.

Therefore, it is not surprising that the number of companies using AI is growing. According to  Forbes Advisor, by 2027 the artificial intelligence market will be estimated at 407 billion USD. And 64% of enterprises believe that artificial intelligence will increase their productivity.

Unity, one of the most famous app manufacturers for portable gadgets, is among the companies that are already gradually introducing AI into their work. 

In this article, we will take a detailed look and analyze the new artificial intelligence developments from Unity and what they mean for the development of XR applications.

Leveraging Unity AI for App Development

Unity has been using AI for a few years now, but, firstly, it was mostly for marketing and non-game content to a wider audience. Like, for example, Luna, a platform that aims to improve the advertising strategy of brands. Or Supersonic which is a stand-alone platform that automates and accelerates game advertising.

Secondly, artificial intelligence and neural networks for gaming have previously been created only for developers who have special qualifications for working with applications. Like, for example, ML agents, which allow you not to code the behavior of digital elements, because these elements themselves (smart agents) are independently learning the algorithms of behavior in the environment. For example, in a game from Unity, you can hone the behavior of a digital corgi that runs after a stick. Or the behavior of racing cars, as in this video.

Read also: Transforming Reality: How AI Revolutionizes XR for Next-Level Experiences

“In the carting micro game, our ML agent scenes are typically set up with a few major components: the training environment, the level, that we want our agents to observe and familiarize with. Which, in our case, is our racetracks. The agents are the game objects we want to train. So, that they can accomplish a goal, such as driving without colliding with the track walls. And, finally — our academy, which collects all observations, done by our agents and trains them”, said Unity’s official video.

In March 2023, Unity announced their own AI game and application development features. Then there was the first presentation of an ecosystem with artificial intelligence, which operates according to the principle of many AI generators, such as Midjourney and ChatGPT.

A few days ago, new AI tools for developing games and applications were announced: Unity Muse and Unity Sentis, which we will discuss in more detail below. 

Unity Muse: Empowering AI Creativity

Unity Muse is the newest platform with artificial intelligence, the main purpose of which is to accelerate the creation of applications with 3D graphics. In particular, the option of this platform includes such basic functions as:

  • automatic creation of animated characters and digital doubles;
  • creation of the movements of the animated model — for example, jumps or backflips;
  • creating a texture for the environment;
  • addition to ready-made 3D models — for example, the video shows how you can highlight the roof area on the digital model of the house, enter a prompt and select several options for a red roof from the database.

“The Muse platform provides quick access to detailed information from the documentation and can also generate 2D sprites and 3D animations. This allows developers to quickly get the resources they need to create prototypes or new experiences without waiting for final versions of models and sprites. With Muse chat, developers can effectively communicate with other team members and get the help they need during development”, said Qualium Systems Unity tech lead Arcueid D’athemon.

The main difference between Unity Muse and ML agents is ease of use. The newest platform looks like a chat with a neural network and the principle of operation resembles the sensational ChatGPT. As mentioned above, the user enters the required prompt to generate the 3D content required for the application.

Harness the Power of Unity Sentis AI

Unity Sentis is a cross-platform tool that integrates AI into Unity applications. According to Unity’s official announcement, Sentis enables in-app digital models to work flawlessly on all operating systems, browsers, and devices that support Unity, from smartphones and tablets to game consoles and XR glasses.

Thus, applications with built-in AI models work more efficiently due to the fact that data is processed in real-time.

However, according to Arcueid D’athemon, Unity tech lead at Qualium Systems, the range of  Sentis options is wider, and the platform can also generate voice acting and animation for a character.

“It opens up opportunities to quickly create dynamically generated actions in the application that will depend on the environment or interaction with the user. With Sentis, developers can effectively create realistic character movements and high-quality voice acting that enriches the user experience”, said Arcueid D’athemon.

In the end, the combination of the input of the own neural network can change the process of the application use. For example, the user can directly interact with an NPC, while would respond to him with lines that are not pre-recorded. It enhances the immersive experience of gameplay, using the example of a virtual AI character named Orb.

Unity’s interest in AI in app development is evident with recent innovations such as Unity Muse and Unity Sentis. The first tool allows developers to quickly and efficiently create 3D models of game and non-game characters, environments, and textures. As for Sentis, this program allows you to modify the gameplay by introducing NPCs with their own artificial intelligence. Unity’s AI ecosystem continues to evolve, inspiring game and app developers to explore new horizons and reimagine what’s possible in interactive entertainment.

Latest Articles

From Pain Relief to Rehabilitation: A Portrait of VR Therapeutics in 2026
May 27, 2026
From Pain Relief to Rehabilitation: A Portrait of VR Therapeutics in 2026

VR therapeutics is becoming a real category of reimbursable medicine. It now has FDA authorization pathways, dedicated billing codes, and growing support from commercial insurers. This shift didn’t happen overnight. It has built up over several years through a series of regulatory, clinical, and commercial milestones that together make 2026 a turning point for the industry. The market is starting to reflect that. Estimates vary by methodology, but SNS Insider projects the broader VR healthcare market to grow from $4.27B in 2024 to $46.4B by 2032 (a 33% CAGR). VR telerehabilitation alone is projected to grow from $1.2B in 2026 to $2.67B by 2030, a 22% CAGR that captures the segment this article focuses on. Three moments tell the story of how we got here. 2021: The first prescription VR therapy gets FDA cleared. AppliedVR’s RelieVRx became the first VR product authorized as a prescription medical device in the US. 2023: Medicare opens the reimbursement door. Centers for Medicare and Medicaid Services created the first VR-specific billing code, placing prescription VR into the Durable Medical Equipment category. The practical effect: doctors gained a way to prescribe VR therapy, and insurers gained a code to pay against. 2025: Commercial insurers begin following Medicare’s lead. In September, Cigna became one of the first major commercial payers to cover FDA-approved digital therapeutics. In this article, we’ll walk through six therapeutic domains where that infrastructure is taking shape. Each has its own clinical logic, its own leading players, and its own path to scale.  Market architecture Before we walk through the six therapeutic domains, it’s worth understanding the shape of the market they sit inside: what’s growing, where the money is concentrated, and what changed structurally between 2023 and 2025 to make any of this viable. Where therapy and rehab sits inside VR healthcare VR healthcare as a whole spans everything from surgical training simulators to anatomical education tools. But within that broader market, VR therapeutics and rehabilitation is the fastest-growing application segment, and it’s also where regulatory and reimbursement infrastructure is forming most actively. Inside therapy-and-rehab itself, two sub-segments are consistently identified by independent market research as the fastest-growing: pain management and mental health therapy. Both have something the other categories don’t yet: FDA-cleared products in the market, peer-reviewed efficacy data, and at least nascent reimbursement pathways. Geographically, the market is concentrated in two regions for very different reasons. North America is leading adoption mainly because the FDA has started approving prescription VR therapies, and dedicated billing codes now allow healthcare providers to get reimbursed for using them. Europe is catching up via different infrastructure, particularly Germany’s DiGA framework, which provides a parallel route to physician prescription and statutory health insurance coverage. France’s PECAN and the UK’s DTAC are developing in a similar direction. The pattern is clear: once regulators create a formal pathway, companies and investment tend to follow. What the hardware cycle unlocked The clinical use cases for VR therapy didn’t really change between 2020 and 2025. What changed is that the hardware finally became viable for the business models the clinical work demanded. Consumer-grade standalone headsets brought the price floor down to where at-home prescription models work. Meta Quest 3, Meta Quest 3S, and Pico 4 helped bring standalone VR headsets to more affordable consumer price levels—an important step for prescription VR therapies that patients are expected to use at home. RelieVRx, for example, is a self-administered program delivered to patients in their living rooms; that model is described in detail in MDIC’s case study of the product. Major headset manufacturers are doubling down on healthcare partnerships rather than building healthcare-specific hardware. A useful signal here is HTC VIVE’s April 2025 expansion with Mynd Immersive, Select Rehabilitation, and AT&T into more than 150 US senior living communities—the largest deployment of immersive therapeutics into senior care to date. The interesting strategic detail isn’t the size of the rollout but its structure: a hardware OEM (HTC), a content/care platform (Mynd), a clinical services partner (Select Rehab), and a connectivity provider (AT&T). That’s the four-party stack that scaled clinical VR is going to require, and partnerships like this one are essentially templates that the rest of the industry will be copying. Body: pain & physical rehab 1. Pain management Pain is the single largest unmet need in clinical medicine. In the United States alone, roughly 50 million adults live with chronic pain, and the toolkit physicians have to treat it is uncomfortably narrow: opioids carry addiction risk, non-opioid pharmaceuticals are inconsistently effective, and behavioral therapies are scarce and slow. Procedural pain is its own category, often managed with anesthesia or sedation, which adds cost, risk, and recovery time. This is the gap VR fills. The clinical evidence for VR as a pain intervention rests on two well-documented neurological mechanisms. The first is gate control theory: pain signals traveling up the spinal cord compete with other sensory inputs for processing capacity, and immersive visual and auditory stimulation can effectively crowd them out before they reach the brain as pain. The second is cognitive load: a fully immersive VR experience occupies enough of that capacity to leave less available for processing pain as pain. Together, these mechanisms make VR more than just a distraction. They turn it into a real neurological intervention, which helps explain why VR can reduce pain in clinical settings where simpler distractions like music or conversation often cannot. There are two distinct applications emerging from this. The first is procedural pain, where Medtronic provides the clearest commercial example. Medtronic’s VR solution makes office hysteroscopy more comfortable by immersing the patient in a virtual environment during the procedure. According to Medtronic, the immersive sedation-analgesia content reduces patient anxiety and decreases pain-related brain activity. The second application is chronic pain. RelieVRx, which we talked about above, is a shining example, receiving Breakthrough Device Designation and De Novo authorization specifically for chronic lower back pain. A regulatory pathway the AppliedVR team has documented in detail in the peer-reviewed literature. The clinical data behind…

How Extended Reality Is Reshaping Modern Marketing
March 31, 2026
How Extended Reality Is Reshaping Modern Marketing

The global extended reality market (including VR, AR and MR) is expected to reach $84.86 billion by 2029, growing at an estimated annual rate of 28%. But the bigger point isn’t just that the market is expanding, it’s that XR is already proving its value in the places marketers care about most: engagement, conversion, and customer confidence. In ecommerce, interacting with products via AR leads to a 94% higher conversion rate compared to products without AR. That makes sense: when people can better understand what they’re buying, they’re more likely to move forward and less likely to regret the purchase later.  XR also gives brands something that’s getting harder to win online: attention. VR campaigns generate about 46% higher engagement than traditional digital campaigns. People who interact with AR content spend around 2.7 times longer on product pages.  XR is now showing up in real results. That is why marketing is moving beyond static content toward immersive experiences. In the following sections, we will share how these technologies can be applied to marketing strategies and explore what the future of immersive experiences might look like. How XR is transforming modern marketing: 4 use cases that prove it works With XR, businesses can turn traditional campaigns into fully immersive experiences, where customers can explore products, interact with brands, and connect with content in memorable ways. Its value goes far beyond visual appeal, directly impacting the business growth and customer journey itself. And while this may not be immediately obvious, XR can also save significant resources, reducing the need for physical prototypes, showrooms, or large-scale events, making marketing more efficient. This is why more businesses are integrating immersive technologies into their marketing strategies, even despite certain challenges, such as development and VR hardware costs, as well as complex technology integration. Below, we highlight several successful use cases of immersive technologies in marketing. Virtual try-ons One of the most persistent barriers to online purchasing is uncertainty. Will these glasses suit my face shape? Will this sofa fit in my living room? Will this shade of lipstick actually complement my skin tone? These are questions that traditionally required a physical store visit. Virtual try-on eliminates that leap entirely. The technology behind this falls into a few distinct forms. The most accessible is smartphone-based AR. Customers point their phone at themselves or their surroundings, and the app overlays a true-to-scale digital product in real time. A striking example is the FindYourGlasses app developed by Qualium Systems. A step further are dedicated AR headsets and glasses, which immerse the customer in a mixed-reality environment where products can be explored in even greater depth and spatial accuracy.  These technologies help customers understand what they are buying before making a purchase, enabling them to make decisions based on accurate, personalized visualization rather than guesswork. Real-world example: IKEA Place AR App IKEA Place AR app lets shoppers visualize furniture in their own physical spaces before buying. Customers simply point their phone camera at a room, select a piece of furniture, and see it rendered in realistic scale within their actual environment. This removes the biggest friction point in furniture shopping: not knowing whether a sofa or shelf will actually fit or match the existing interior design. Results: After launch, the app was downloaded millions of times and became one of the most widely adopted retail AR experiences globally. IKEA reported increased customer engagement and reduced returns because customers could see how items fit before purchase. The company reported also that customers who use the IKEA Place app are 11% more likely to complete a purchase compared to those who do not use the app. Virtual showrooms & Tours Some purchases simply feel too significant to make without experiencing the space or context first. Traditionally, that meant showing up in person. Virtual showrooms and immersive tours remove that requirement. The technology here ranges from 360° web-based tours (viewable in any browser without additional hardware) to fully immersive VR experiences delivered through headsets. Visitors can walk through a branded space, interact with products, and access information on demand, without leaving their couch or office. Automotive brands use virtual showrooms to let buyers explore vehicle interiors, switch trims and colors, and get a feel for the cabin before visiting a dealership. Real estate platforms offer immersive property walkthroughs that let buyers shortlist homes remotely. Hotels and resorts use virtual tours to sell the experience upfront.  The value is especially pronounced in the machinery and heavy equipment sector, where physically demonstrating a product has always been costly: shipping industrial equipment to trade shows, organizing on-site demos, and flying prospects to manufacturing facilities all consume significant budgets. VR removes that overhead entirely: a potential buyer can step inside a virtual factory floor, operate a machine in a simulated environment, and evaluate complex equipment in full detail. Real-world example: Virtual showroom for MAKEEN Energy industrial equipment MAKEEN Energy, a global corporation delivering industrial gas solutions and heavy infrastructure equipment, built a true-to-scale virtual showroom. Using 3D models of their equipment in a virtual environment, they were able to pack their sprawling machinery into a portable VR headset and bring it to any trade fair.  Results: By no longer shipping heavy equipment around the world and reducing travel with virtual product demonstrations, MAKEEN Energy was able to cut logistics costs significantly. The virtual showroom also accelerated complex, multi-stakeholder sales by giving engineers, technicians, and purchase managers across different countries a shared, detailed view of the product. What began as a trade fair tool evolved into a company-wide asset for sales, training, and communications. For industrial businesses looking to adopt XR, Qualium Systems serves as a trusted technology partner, delivering VR and Web3D solutions that simplify the presentation of complex equipment, enhance product understanding, and support more effective digital engagement. Immersive brand storytelling XR gives brands the ability to place customers at the center of a narrative, transforming passive content consumption into a first-person experience that is far harder to forget. A VR film or AR…

September 10, 2025
Immersive Technology & AI for Surgical Intelligence – Going Beyond Visualization

Immersive XR Tech and Artificial Intelligence are advancing MedTech beyond cautious incremental change to an era where data-driven intelligence transforms healthcare. This is especially relevant in the operating room — the most complex and high-stakes environment, where precision, advanced skills, and accurate, real-time data are essential. Incremental Change in Healthcare is No Longer an Option Even in a reality transformed by digital medicine, many operating rooms still feel stuck in an analog past, and while everything outside the OR has moved ahead, transformation has been slow and piecemeal inside it. This lag is more pronounced in complex, demanding surgeries, but immersive technologies convert flat, two-dimensional MRI and CT scans into interactive 3D visualizations. Surgeons now have clearer spatial insight as they work, which reduces the risk of unexpected complications and supports better overall results. Yet, healthcare overall has changed only gradually, although progress has been made over the course of decades. Measures such as reducing fraud, rolling out EMR, and updating clinical guidelines have had limited success in controlling costs and closing quality gaps. For example, the U.S. continues to spend more than other similarly developed countries. Everything calls for a fundamental rethinking of how healthcare is structured and delivered. Can our healthcare systems handle 313M+ surgeries a year? Over 313 million surgeries will likely be performed every year by 2030, putting significant pressure on healthcare systems. Longer waiting times, higher rates of complications, and operating rooms stretched to capacity are all on the rise as a result. Against this backdrop, immersive XR and artificial intelligence are rapidly becoming vital partners in the OR. They turn instinct-driven judgement into visual data-informed planning, reducing uncertainty and supporting confident decision-making. The immediate advantages are clear enough: shorter time spent in the operating room include reduced operating-room time and lower radiation exposure for patients, surgeons, and OR staff. Just as critical, though less visible, are the long-term outcomes. Decreased complication rates and a lower likelihood of revision surgeries are likely to have an even greater impact on the future of the field. These issues have catalyzed the rise of startups in surgical intelligence, whose platforms automate parts of the planning process, support documentation, and employ synthetic imaging to reduce time spent in imaging suites. Synthetic imaging, for clarity, refers to digitally generated images, often created from existing medical scans, that enrich diagnostic and interpretive insights. The latest breakthroughs in XR and AI Processing volumetric data with multimodal generative AI, which divides volumes into sequences of patches or slices, now enables real-time interpretation and assistance directly within VR environments. Similarly, VR-augmented differentiable simulations are proving effective for team-based surgical planning, especially for complex cardiac and neurosurgical cases. They integrate optimized trajectory planners with segmented anatomy and immersive navigation interfaces. Organ and whole-body segmentation, now automated and fast, enables multidisciplinary teams to review patient cases together in XR, using familiar platforms such as 3D Slicer. Meanwhile, DICOM-to-XR visualization workflows built on surgical training platforms like Unity and UE5 have become core building blocks to a wave of MedTech startups that proliferated in 2023–2024, with further integrations across the industry. The future of surgery is here The integration of volumetric rendering and AI-enhanced imaging has equipped surgeons with enhanced visualization, helping them navigate the intersection of surgery and human anatomy in 2023. Such progress led to a marked shift in surgical navigation and planning, becoming vital for meeting the pressing demands currently facing healthcare systems. 1) Surgical VR: Volumetric Digital Twins Recent clinical applications of VR platforms convert MRI/CT DICOM stacks into interactive 3D reconstructions of the patient’s body. Surgeons can explore these models in detail, navigate them as if inside the anatomy itself, and then project them as AR overlays into the operative field to preserve spatial context during incision. Volumetric digital twins function as dynamic, clinically vetted, and true-to-size models, unlike static images. They guide trajectory planning, map procedural risks, and enable remote team rehearsals. According to institutions using these tools, the results include clearer surgical approaches, reduced uncertainty around critical vasculature, and greater confidence among both surgeons and patients. These tools serve multidisciplinary physician teams, not only individual users. Everyone involved can review the same digital twin before and during surgery, working in tight synchronization without the risk of mistakes, especially in complex surgeries such as spinal, cranial, or cardiovascular cases. These pipelines also generate high-fidelity, standardized datasets that support subsequent AI integration, as they mature. Automated segmentation, predictive risk scoring, and differentiable trajectory optimizers can now be layered on top, transforming visual intuition into quantifiable guidance and enabling teams to leave less to chance, delivering safer and less invasive care. The VR platform we built for Vizitech USA serves as a strong example within the parallel and broader domain of healthcare education. VMed-Pro is a virtual-reality training platform built to the standards of the National Registry of Emergency Medical Technicians; the scenarios mirror real-world protocols, ensuring that training translates directly to clinical practice. Beyond procedural skills, VMed-Pro also reinforces core medical concepts; learners can review anatomy and physiology within the context of a virtual patient, connecting textbook knowledge to hands-on clinical judgment. 2) Surgical AR: Intra-operative decision making Augmented reality for surgical navigation combines real-time image registration, AI segmentation, ergonomically designed head-worn glasses, and headsets to convert preoperative DICOM stacks into interactive holographic anatomy, giving surgeons X-ray visualization without diverting gaze from the field – a true Surgical Copilot right in the OR. AI-driven segmentation and computer-vision pipelines generate metric-accurate volumetric models and annotated overlays that support trajectory planning, instrument guidance, and intraoperative decision support. Robust spatial registration and tracking (marker-based or depth-sensor aided) align holograms with patient anatomy to submillimetre accuracy, enabling precise tool guidance and reduced reliance on fluoroscopy. Lightweight AR hardware, featuring hand-tracking and voice control, preserves surgeon ergonomics and minimizes distractions. Cloud and on-premises inference options balance latency and computational power to enable real-time assistance. Significant industry investment and agile startups have driven integration with PACS, navigation systems, and multi-user XR sessions, enhancing preoperative rehearsal and team…



Let's discuss your ideas

Contact us