Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Trajectories Generation #136

Open
ZyuanW opened this issue Feb 8, 2025 · 6 comments
Open

New Trajectories Generation #136

ZyuanW opened this issue Feb 8, 2025 · 6 comments
Labels

Comments

@ZyuanW
Copy link

ZyuanW commented Feb 8, 2025

Hello,

Thank you for your excellent work! I have a question regarding modifying val_data to generate new trajectories. Specifically, I would like to simulate a lane change by shifting the camera to the left and then generate new videos or images.

Could you suggest a simple way to achieve this? What modifications would be necessary in val_data, such as in val_data["camera_parameter"]?

Thanks in advance!

@ZyuanW
Copy link
Author

ZyuanW commented Feb 8, 2025

i tested add offset to camera_param before enter into pipe,but the generated images are still original view point

@flymin
Copy link
Member

flymin commented Feb 12, 2025

Please consider building them like real trajectories such as those from the validation set. It may not work on arbitrary parameters.

@ZyuanW
Copy link
Author

ZyuanW commented Feb 12, 2025

Please consider building them like real trajectories such as those from the validation set. It may not work on arbitrary parameters.

Thanks for your suggestion!
i tried modified the cam pose and transform the bbox in val_data, In some scenarios, a small offset can work, but a large offset may cause problems in the model's cross-view and scene structure generation.

Image

@flymin
Copy link
Member

flymin commented Feb 12, 2025

Like I said, please do your best to mimic a real trajectory and see what will happen. I think you should be able to find real trajectory as examples for turning, speed changing, lane changing in the dataset.

@flymin
Copy link
Member

flymin commented Feb 12, 2025

Please understand I can only offer help to basic usage of our models, and may not have time to look into details of your use cases.

Since this is an open sourced work, it would be helpful to share details of your experiences/issues/solutions. Others may reuse your experience or shed some light on it.

Copy link

This issue is stale because it has been open for 7 days with no activity. If you do not have any follow-ups, the issue will be closed soon.

@github-actions github-actions bot added the stale label Feb 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants