I recently bought an intel D435i for a project of mine. I want to use this, a DSLR and open 3D as basis for creating scenes which I then hope to augment using differentiable rendering.
Right now I am experimenting with the python code examples (I am new to coding in general). I have a vision for a pipeline which I want to share with you.
Right now streaming options for me contain too much data! At present I think the only data I need stream continuously is the IMU odometry.
So the idea is that i have a script for capturing single depth and colour frames from the D435i and DSLR (which should be aligned) and use the odometry from the IMU to ‘estimate’ the position for these frames. From this, I would hope registration would be pretty easy and very fast!
I’m guessing that what i describe are basics for most SLAM applications, but I am not interesting in it being real time. I am interested in accurate scenes with very little noise.
Ps. any help and advice would be greatly appreciated.