Seed2GS: Camera-Free, Training-Free Object Extraction
from 3D Gaussian Scenes via a Single Reference-View Grounding

Seed lift converts the reference mask $m^{\star}$ into a conservative 3D Gaussian support before generating new supervision views. Three constraints localize foreground Gaussians projected into the reference view. Let $\pi_{i}$ and $z_{i}$ denote the projected center and depth of $g_{i}$, and let $D_{r}$ denote the rendered reference depth map. The mask and depth constraints retain candidates satisfying $m^{\star}(\pi_{i})=1$ and $|z_{i}-D_{r}(\pi_{i})|\leq\epsilon_{d}$. Connected-component filtering on the resulting 3D candidate graph then retains the component attached to the target body and removes projection outliers. The resulting support $\mathcal{G}_{0}$ initializes the foreground logits. The support also estimates the object center $\mathbf{o}$ and 3D extent that parameterize the VAAS virtual orbits.

VAAS expands 3D coverage without making another semantic decision. Re-detecting the target in every rendered view would require one open-vocabulary call per view. Seed2GS instead grounds the target once and propagates that result. Given the lifted support $\mathcal{G}_{0}$ and object center $\mathbf{o}$, VAAS renders object-centric virtual views from the frozen scene $\mathcal{G}$. SAM2 video tracking (17) propagates the reference seed $m^{\star}$ to these views.

VAAS (Visibility-Adaptive Ascending Spiral) constructs a reference-anchored flat orbit and an ascending spiral orbit around $\mathbf{o}$. Both trajectories start at the reference camera $c_{r}$, where SAM2 receives the canvas $I_{r}$ and seed mask $m^{\star}$. The flat orbit mainly provides horizontal observations, while the ascending orbit complements it with vertical observations of top, bottom, and occluded regions.

Orbit height adapts to missing visibility. A flat orbit sees the object from the side but can miss top, bottom, and self-occluded surfaces, so poorly observed targets may require a taller climb. VAAS measures $\bar{V}$ as the mean fraction of $\mathcal{G}_{0}$ visible under depth-consistent projection across the flat-orbit views and sets the ascending pitch amplitude to

Well-covered targets have large $\bar{V}$ and keep the trajectory near-planar; poorly covered targets have small $\bar{V}$ and climb higher. When $A<5^{\circ}$, VAAS omits the near-duplicate ascending clip and uses only the flat clip. Otherwise, it renders both reference-anchored clips. The skip rule spends additional views only when the flat orbit indicates missing coverage. The masks propagated over all VAAS views form the supervision set $\{Y^{(c)}\}$ for refinement.

Gaussian refinement uses the masks propagated by VAAS to optimize per-Gaussian foreground membership. The initial support $\mathcal{G}_{0}$ only initializes the foreground logits and parameterizes the virtual orbits. The original scene geometry, color, and opacity remain frozen throughout. Let $q_{i}=\sigma(l_{i})$ denote the foreground probability of Gaussian $g_{i}$, and let rasterization produce the soft foreground mask $P^{(c)}$ for view $c$. Occlusion and tracking drift can corrupt propagated masks, so Seed2GS weights each view by its running BCE residual $D_{c}$. Specifically, using the median residual $m_{D}$ and a MAD-based robust scale $s_{D}$, we define the view weight as

where $\operatorname{Norm}[\cdot]$ denotes mean normalization. This weight reduces the influence of high-residual views that conflict with the current 3D foreground estimate. The nonzero floor $r_{\min}$ preserves supervision from difficult viewpoints early in optimization. The foreground logits are optimized with a reliability-weighted multi-view mask objective,

where $Y^{(c)}$ is the propagated supervision mask for view $c$. After convergence, thresholding the foreground probabilities gives the target Gaussian subset:

The experiments evaluate the ground-once, propagate, and fit design on two datasets without original reconstruction cameras or scene-level semantic training. Unless otherwise stated, every experiment uses a frozen 3DGS scene as input. Each query consists of a text prompt and one reference view with its camera pose. The headline LERF-MASK result uses one user-selected reference per query, chosen from rendered RGB views in which the target is visible. Reference selection uses neither evaluation masks nor downstream 3D scores, but the result does not average over reference choices. A fixed-test-reference control and a 230-run favorable-reference sweep separately test this dependence. Beyond this reference pose, Seed2GS accesses no original reconstruction images or cameras and no ground-truth masks. It performs no scene-specific semantic training. The evaluation counts queries without valid predictions as zero in the corresponding scene average.

LERF-MASK (20) annotates 23 text-query targets in three LERF scenes (11): Figurines, Ramen, and Teatime. The targets cover common objects, thin structures, relational prompts, and semantic ambiguities between containers and contents. 3D-OVS (12) contains four scenes: Bed, Bench, Sofa, and Lawn. For 3D-OVS, we follow the public B3-Seg setting for scene selection, test split, and supplied reference camera poses, but not its inference procedure. Metric definitions and computation follow the public Gaussian Grouping protocol (20).

We report mean IoU (mIoU), mean boundary IoU (mBIoU), and per-query runtime. For each target, evaluation first averages all official test views and then averages targets within each scene, counting missing predictions as zero. The dataset-level Mean weights all scene scores equally. Both native evaluators threshold foreground probability at 0.40. Seed2GS runtime is measured on an NVIDIA H800 PCIe GPU and includes query-time model inference, virtual-view processing, and Gaussian refinement. It excludes process startup, model and scene loading, evaluation rendering, and metric computation. For scene-training-free baselines, we quote query latency from published results; for scene-specific baselines, Table 1 reports their per-scene representation-construction time.

We compare Seed2GS with language-driven and instance-level 3DGS segmentation methods, including LERF (11), SA3D (4), LangSplat (16), Gaussian Grouping (20), Gaga (14), Unified-Lift (23), ObjectGS (22), OpenSplat3D (15), LBG (5), FlashSplat (18), and B3-Seg (9). The tables expose two operating assumptions: whether each method requires semantic or instance training for the target scene and whether its reported inference pipeline depends on original reconstruction views. FlashSplat and B3-Seg are the closest baselines that do not require scene-level semantic training, and B3-Seg also avoids original reconstruction cameras.

LERF-MASK. Seed2GS leads the camera-free, scene-training-free setting on LERF-MASK (Table 1), reaching 92.1% mIoU and 88.6% mBIoU under the evaluated reference views. Against B3-Seg, Seed2GS gains 7.6 points on both metrics; their separately reported runtimes are 9.3 and 12.1 seconds, respectively. These end-to-end results show that the reported accuracy and latency are achievable without repeated detection. They do not isolate the effect of any single component. Seed2GS also exceeds scene-trained ObjectGS by 3.7 mIoU points despite building no persistent semantic or instance representation.

3D-OVS. On 3D-OVS, Seed2GS leads the camera-free comparison by a narrower margin (Table 2). The method reaches 95.7% mean mIoU, 0.7 points above B3-Seg, and records the best per-scene result on Lawn. All methods in Table 2 exceed 91% mIoU on this four-scene setting. LERF-MASK produces larger empirical separation among methods; its queries include thin structures, relational phrases, and container/contents ambiguities.

On an H800, the loaded pipeline averages $9.26\pm 0.97$ seconds across the 23 LERF-MASK targets; QD-SAM3 and VAAS account for 47.7% and 52.3% of runtime (Table 3). B3-Seg code is unavailable, so its reported 12.1 seconds and our measured 9.3 seconds are not same-hardware measurements.

Three complete passes per view budget produce 138 successful runs. The default 24-view setting adds only 0.373 seconds of backend time over 12 views, while improving LERF-MASK by 0.24 mIoU and 0.19 mBIoU points (Table 4). Across both budgets, within-scene correlations between initial foreground count and warm latency remain small ($|\rho|\leq 0.321$, all $p\geq 0.482$). On Teatime, the initial support spans 212–26,874 Gaussians ($126.8\times$), yet the $<1$K, 1K–10K, and $>10$K groups average 8.754, 9.108, and 8.807 seconds per full query. Together, these measurements tie runtime primarily to scene-wide rendering and the rendered view budget rather than target size; the supplementary material provides both audits in detail.

Fixed test references. Using one fixed test reference per scene, QD-SAM3 reaches 91.14% mIoU (Table 5). Replacing only its seed with the reference ground truth raises mIoU by 0.72 points and mBIoU by 0.86 points, leaving limited headroom from the initial mask alone. All three fixed-reference scene means remain above 90% mIoU, so the result does not depend on one favorable scene.

Favorable-reference sweep. Across 230 runs, Seed2GS averages 91.17% scene-equal mIoU with a 1.16-point within-target deviation (Table 5 and Figure 4). Only five of 23 targets exceed one point of mIoU deviation, and the two largest deviations occur on Ramen. Even the target-equal worst-reference average remains 88.98% mIoU and 83.90% mBIoU, and all 230 runs return valid extractions. The fixed and multi-reference controls therefore preserve the main accuracy advantage while removing dependence on a single selected seed or view.

QD-SAM3 improves max-confidence selection by 4.41 mIoU points; Qwen3-VL and confidence are its strongest source and score term, respectively (Table 6).

Under fixed scenes and downstream settings, VAAS gains come from adapting its trajectory rather than simply rendering more views. Adaptive VAAS improves LERF-MASK mIoU by 2.17 points over the flat orbit and by 1.41 points over the fixed ascending orbit, while using 27.1 rather than 48 views on average. The view-count sweep supports the same conclusion: 24 views performs best on LERF-MASK; 48 views adds 0.28 mIoU points on 3D-OVS but slightly lowers boundary IoU (Table 7).

Replacing one continuous clip with two reference-anchored clips improves mIoU by 10.56 points on LERF-MASK and 17.50 points on 3D-OVS, while view reliability weighting adds 1.25 and 1.40 points, respectively (Table 8).