Skip to content

Need advice on custom data with poor result #51

@HungNgoCT

Description

@HungNgoCT

Hi,
Thank you for amazing work.
I have used instant-ngp, nerfstudio to generate mesh. However, sdfstudio impress me by mesh generation.
When I use sample data, I always get good render and mesh.
However, when I use custom data, results were always poor although I have done experiments and follow all discussions in this page.

Could you give me advice to process with this data: https://drive.google.com/file/d/1hLnwXon29bc4SiyuxiV32VAfQnZY2gTd/view?usp=share_link
As screen shot of above shared data like this:
Screenshotelephant

The steps I have done as followings:

  • Used colmap to generate transforms.json file as usual in instant-ngp
  • Tested with instant-ngp, give a very good result (video 1 below)
  • Tested with nerfstudio by:
    ns-train neus-facto --pipeline.model.sdf-field.inside-outside False --vis viewer instant-ngp-data --data D:\Hung\sdfstudio\data_cu\elephantNERFSDF\PNG_colmap
    Give a not good render
  • I also use scripts ns-process-data, then render with nerfstudio, give a good result
  • used script process_nerfstudio_to_sdfstudio.py to convert from nerfstudio json file to meta_data.json file, and run with sdfstudio (neus-facto), got a very poor result (video 2).

I have checked very careful discussion in #2 (#2), and #49 (#49), but rendering result is very poor like #49.

Below videos are rendering with instant-ngp
Video 1: https://user-images.githubusercontent.com/110378166/222356933-3112bdb8-3c96-4c30-a516-fc3af3e88706.mp4

And rendering with sdfstudio
video 2: https://user-images.githubusercontent.com/110378166/222357045-c8175d1c-f59c-49db-82ab-1f9c5b81f6fa.mp4

The mesh I got from sdfstudio like this:
ScreenshotElephantMesh

Highly appreciate with any help.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions