User Tools

Site Tools


tamiwiki:projects:scanning-tami

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
tamiwiki:projects:scanning-tami [2025/04/04 15:53] wissotskytamiwiki:projects:scanning-tami [2025/04/04 18:18] (current) wissotsky
Line 3: Line 3:
 </WRAP> </WRAP>
  
-{{tamiwiki:projects:mermaid-diagram-2025-04-03-220229.png}}+{{tamiwiki:projects:enqvwett3dgqvudxdpmwrsozaihfjyfszimqkpblh0dqy5wdsgwpgmx5jzlhqva_b7ckp2bga2quwfkr3_11i0yqzbjg2slv5bxgz9s3uwbvakx-eecnut0ycxoec2m1s0kv0tdhr79uaj7qhpzn2837ln67eslxckxzwc3rbzaafyc6tjgf0jaorpvpqbf5iixtewrphb1zzmvnyc.svg}}
  
 <blockquote> <blockquote>
Line 49: Line 49:
                 end                 end
                                  
-                checkIteration -->|Yes| output[("Pairs of Essential Matricies Between Images")]+                checkIteration -->|Yes| output[("Image Pairs With Estimated Essential Matricies and Keypoint Inlier Masks")]
             end             end
                  
Line 58: Line 58:
     subgraph sg2["Depth Estimation"]     subgraph sg2["Depth Estimation"]
         direction LR         direction LR
-        pm["Patchmatch"] --RANSAC Polyfit--> nde["Monocular Depth Estimate"] --> gsd["3D Gaussian Splat Depth"] --> kde["KDE Outlier Filtering"]+        pm["PatchMatch Multi-View Depth Estimation"] 
 +        nde["DepthAnything v2 Neural Monocular Depth Estimate"
 +        pm & nde --> preprocessing 
 + 
 +        subgraph ConfidenceWeightedDepthCorrection["Confidence-Weighted Depth Map Correction"
 +            direction LR 
 +             
 +            preprocessing["Downscale Neural Estimate to PatchMatch resolution"] --> ransacLoopPolyfit["RANSAC Loop"
 +             
 +            subgraph RANSACProcessPolyfit["RANSAC Polynomial Fitting"
 +                ransacLoopPolyfit --> sampleSelection 
 +                sampleSelection["Random sample selection 
 +                from depth maps"] --> weightSamples 
 +                 
 +                weightSamples["Weight samples by 
 +                confidence map values"] --> fitModel 
 +                 
 +                fitModel["Fit polynomial offset model 
 +                to weighted samples"] --> evaluateModel 
 +                 
 +                evaluateModel["Evaluate model by weighted error"] --> checkConvergence 
 +                 
 +                checkConvergence{"Max Iterations Reached?"} -->|No| ransacLoopPolyfit 
 +                 
 +                checkConvergence -->|Yes| bestModel["Select best polynomial 
 +                offset model"
 +            end 
 +             
 +            bestModel --> applyCorrection["Apply polynomial correction to full-res neural depth map"
 +             
 +            applyCorrection --> outputPolyfit["Merge Depth and Color into RGBD"
 +        end 
 + 
 +        outputPolyfit --> rgbdpcd["RGBD Point Cloud Projection"] --> gsd["3D Gaussian Splat Training + Depth Rasterization"] 
 +        gsd --> kde["KDE Outlier Filtering"]
         kde --> storergbd[(RGBD Images)]         kde --> storergbd[(RGBD Images)]
     end     end
tamiwiki/projects/scanning-tami.1743771226.txt.gz · Last modified: 2025/04/04 15:53 by wissotsky