I also tried just outputting images + poses for the camera and objects and using cv2.projectPoints to calculate the keypoint locations but it seems like there’s a mismatch between how Isaac and OpenCV calculate image point locations for the same camera extrinsics and intrinsics, even when using the “opencv” lens models in Isaac. I wrote up another issue on this with a minimal example to reproduce the problem I’m having with this approach: Isaac Sim "opencv_fisheye" lens distortion model is not consistent with OpenCV's projectPoints
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Replication output data types - pose? | 9 | 1256 | April 6, 2023 | |
| About the Synthetic Data Generation (SDG) category - Omniverse Replicator | 3 | 3674 | August 31, 2022 | |
| Export camera pose in Isaac Sim | 0 | 418 | December 29, 2022 | |
| Replicator - how to get cameraViewTransform | 9 | 2100 | October 19, 2023 | |
| Fisheye Distortion for Replicator skeleton_data annotator | 1 | 59 | September 3, 2025 | |
| Synthetic data generation 2d/3d labels on own customized object | 3 | 637 | November 30, 2023 | |
| Sythetic data recording for BBox3D | 13 | 2506 | October 25, 2021 | |
| Modelling depth cameras in Isaac sim | 4 | 2173 | April 5, 2024 | |
| Depth Map to Pointcloud Issues | 8 | 3824 | January 7, 2022 | |
| Get sensor data from isaac sim | 4 | 1814 | April 5, 2024 |