Skip to content

[proto] Enable lazy loading for the data pipeline of CUB200 and Imagenet #6569

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from

Conversation

ejguan
Copy link
Contributor

@ejguan ejguan commented Sep 12, 2022

Change the logic that will trigger pipeline iteration during the construction of the data pipeline. This PR would guarantee that all data or even meta data is loaded lazily until iteration starts.

@ejguan ejguan requested a review from pmeier September 12, 2022 20:06
@ejguan ejguan changed the title [Prototype] Enable lazy loading for the data pipeline of CUB200 and Imagenet [proto] Enable lazy loading for the data pipeline of CUB200 and Imagenet Sep 12, 2022
@ejguan ejguan requested a review from NicolasHug September 12, 2022 20:07
Copy link
Collaborator

@pmeier pmeier left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Erjia, but I'm not sure if there is any benefit of this PR over #6076. Did I miss something? Otherwise, I'm inclined to close this and continue over there.

@ejguan
Copy link
Contributor Author

ejguan commented Sep 13, 2022

Thanks Erjia, but I'm not sure if there is any benefit of this PR over #6076. Did I miss something? Otherwise, I'm inclined to close this and continue over there.

Oh, thanks pointing out! I completely forget the PR. Let me close this one, though.

@ejguan ejguan closed this Sep 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants