Imagine a world where the boundaries between cutting-edge research and everyday visual effects production blur into oblivion—welcome to the thrilling evolution of compositing with Foundry's latest Nuke 17.0 beta, now featuring built-in support for Gaussian Splats! But here's where it gets exciting: this isn't just another software update; it's a game-changer that could redefine how artists craft immersive worlds. Stick around to discover why this might just be the seismic leap VFX professionals have been dreaming of.
The Foundry team has rolled out the open beta for Nuke 17.0, introducing seamless integration with Gaussian Splats. What does that mean for you? Well, you can now effortlessly bring in, visualize, tweak, and render these innovative 3D elements using a suite of fresh Field nodes that unlock total artistic freedom within your compositing pipeline. This opens doors to groundbreaking approaches for expanding virtual sets, creating stunning matte paintings, and blending elements with unprecedented ease, all without the hassle of juggling multiple tools.
To understand Gaussian Splats at their core—especially for those new to the concept—think of them as the building blocks of a revolutionary way to depict 3D scenes. Instead of relying on traditional shapes like polygons or voxel grids, these splats represent environments through countless tiny, fuzzy 3D blobs, each modeled as a soft, oval-shaped 'splat' in space. Every one of these blobs holds crucial details like color, how see-through it is, and its form, drawing from techniques like 3D Gaussian Splatting (3DGS), which exploded in popularity back in 2023. Picture it like scattering millions of colorful, translucent droplets to reconstruct a room or landscape—it's a method that's transforming fields such as 3D modeling, AI-driven rendering, and instant graphics.
This integration marks a massive upheaval in how visual effects specialists and creators manage 3D volumetric elements. By embedding Gaussian Splatting directly into Nuke's revamped 3D framework, Foundry is pulling one of graphics' most disruptive innovations straight into the core of production workflows. No longer confined to scholarly journals or separate viewing apps, these splats now function as full-fledged 3D objects within Nuke. You can import them, rotate them, conceal parts, blend them, render them, and even adjust their colors—just like handling any standard asset. And this is the part most people miss: it eliminates the back-and-forth with external software, making your creative process smoother and more intuitive.
What's more, this release comes at a pivotal time when Gaussian Splatting has eclipsed Neural Radiance Fields (NeRFs) as the preferred method for quick, adaptable 3D scene reconstruction. While NeRFs delivered stunning visuals, they often dragged on with slow rendering, making them impractical for fast-paced projects. Splats, on the other hand, achieve similar lifelike quality at lightning-speed frame rates and allow for straightforward edits—something NeRFs inherently struggled with. Production houses are flocking to splats for tasks like capturing real-world environments, powering virtual shoots, and whipping up rapid on-set builds. They offer the perfect combo: speedy training, instant previews, and the ability to handle rich, photo-realistic 3D spaces without the bulk of conventional mesh creation. Integrating this into Nuke lets artists manipulate these powerful tools right in their compositing context, streamlining everything from start to finish.
In practical terms, Nuke 17.0 lets you import splats effortlessly via the new GeoImport or GeoReference nodes, accommodating formats like .ply and .splat. Often, these imports appear with a default alignment, so a quick spin using a GeoTransform node—now behaving more like adjusting a regular 3D scene—gets things oriented just right. Once in, the splat acts as a flexible 3D data set within Nuke's combined viewer.
But here's where it gets controversial: the real breakthrough isn't merely getting them in; it's the deep editing capabilities unlocked. Nuke reveals the inner workings of splats through novel nodes in its Field System, enabling non-destructive editing of enormous point clouds. For instance, by employing a Field Shape node to craft a volumetric mask, you can pinpoint specific areas of a splat, zoom inside, and execute detailed adjustments all within Nuke. In one demo, this was demonstrated by masking and erasing an unwanted trash bin from a captured scene, with field information channeling into the GeoEditPoints node for spot-on refinement. Is this the dawn of democratizing 3D editing, or does it risk oversimplifying complex technical skills? We'd love to hear your take in the comments!
Diving deeper into cleaning, color correction, and experimentation in 3D, a standout feature is the new GeoGrade node, currently under the Labs banner (meaning it's experimental and not yet production-ready). Labs nodes hint at Foundry's vision for a more artistic, data-smart approach within Nuke's 3D realm. With all plugins enabled, you can explore GeoGrade alongside other prototype Field nodes, paving the way for future workflows where tasks like adjusting splat colors, re-lighting scenes, sculpting densities, and tweaking transparency occur directly in the compositor.
The cleanup example illustrates this beautifully: after outlining the bin's area with a Field Shape, GeoGrade smooths and polishes the splat to form a convincing reconstructed shot. This hands-on, interactive style, once the playground of academics, is now woven into Nuke's professional toolkit, making advanced 3D manipulation feel accessible.
Nuke 17.0 treats splats not as unchangeable snapshots but as dynamic components. Combine multiple splat scenes using GeoMerge—in the demo, a bike.splat was inserted into a street setup, positioned via GeoTransform, and subtly shaded with GeoGrade to add realistic shadows. This layer-like compositing approach unlocks rapid environment enhancements, set expansions, and pre-visualization. For blending into 2D projects, the custom SplatRender node renders splats using a standard Camera, adding depth, motion blur, and adjustable thickness. These outputs slot perfectly into Nuke's 2D layers, allowing splats to serve as matte paintings, CG passes, or projection backgrounds. In the showcased composite, the rendered splat formed the base layer, integrated with 2D elements for a seamless final image.
NeRFs shook up the industry with their innovation, but Gaussian Splatting goes a step further by being both groundbreaking and practical. With Nuke 17.0 ushering splats into the compositing mainstream, Foundry is elevating them from niche academic wonders to essential VFX staples—fully editable, combinable, maskable, renderable, and intertwined with your workflow. But is this integration a true revolution, or could it sideline other emerging technologies? And how do you think it will impact your own projects—do you see it sparking creativity or complicating things? Share your thoughts below; we're eager to debate!
