Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Erro Loading annotation in Videos #148

Closed
llsantos opened this issue Mar 11, 2022 · 12 comments
Closed

Erro Loading annotation in Videos #148

llsantos opened this issue Mar 11, 2022 · 12 comments
Assignees
Labels
bug Something isn't working

Comments

@llsantos
Copy link

Hi, I'm having this problem:

Could not load video: blob:https://vidat.davidz.cn/c5eb8afc-b3f1-4af7-85a7-41c6425cb582: Failed to open channel

This happens when I load the video annotation.

@DavidZhang73 DavidZhang73 self-assigned this Mar 12, 2022
@DavidZhang73 DavidZhang73 added the bug Something isn't working label Mar 12, 2022
@DavidZhang73
Copy link
Collaborator

Could you provide the video file for me to debug? It seems related to the format of the video.

@llsantos
Copy link
Author

Sure, here is the link: https://drive.google.com/drive/folders/1Zl07Br36Ydz1CVv0Usocjexy2aR40Mzl?usp=sharing
The error only happen in vidat2, in vidat1 i can load video and annotation, but i dont know if is right.
note: The annotation were created in vidat2.

DavidZhang73 added a commit to DavidZhang73/vidat that referenced this issue Mar 12, 2022
@DavidZhang73
Copy link
Collaborator

DavidZhang73 commented Mar 12, 2022

@llsantos Thanks for your feedback. It is a bug, not related to the video format.

Now you should be able to load the annotation file after loading the local video.
The video is really large, and it takes a long time for Vidat to process, some suggestions:

  1. set defaultFPS to some small number, like 2. Maybe not, since changing #frame leads frame indexes not match.
  2. downscale the size of the video, since you are labelling actions, resolution does not matter, ffmpeg is recommended.
  3. set action only mode, i.e. set all three other modes to false.
  4. use hot keys.

Please leave comments if it still fails to work, close this issue otherwise.

@llsantos
Copy link
Author

Unfortunately, the error remains.

@DavidZhang73
Copy link
Collaborator

@llsantos Are you using the Vidat hosted by us? Please use Aliyun Host, it is synced with the latest development version, ANU Host only sync with latest release version.

@llsantos
Copy link
Author

I used the vidat2 hosted by you and me, both happen the same error.
In Alyun Host, "happen out of memory".

@DavidZhang73
Copy link
Collaborator

@llsantos Aliyun Host is the latest version and unfortunately, limited by the browser and hardwares, out of memory might happen due to the fact that the video is quite large (2560x1440@30fps x 1hour). Vidat needs to cache every single frame (107289 frames in total) and store them in memory. I still recommend

  1. set defaultFPS to some small number, like 2. Since you are labelling actions only, change the frames directly in the annotation file can bypass the frame check.
  2. downscale the size of the video, since you are labelling actions, resolution does not matter, ffmpeg is recommended.

@llsantos
Copy link
Author

II had shortened the video to 30 min, and "out of memory" happens before I set the FPS.(In Aliyun Host)
Is the bug fixed in this latest version?
Is the latest version available for download?

@DavidZhang73
Copy link
Collaborator

II had shortened the video to 30 min, and "out of memory" happens before I set the FPS.(In Aliyun Host)

Please change the defaultFPS before load the video, since vidat uses that fps for frame caching. This is because in browser environment, we cannot obtain the real fps of a video, besides, it can be VFR. And it is by design to let user specify a fps to control labelling accuracy.

Is the bug fixed in this latest version?

The original issue is Could not load video: blob:https://vidat.davidz.cn/c5eb8afc-b3f1-4af7-85a7-41c6425cb582: Failed to open channel which has been resolved. The issue we are discussing for now is out of memory, which is beyond my capability.

Is the latest version available for download?

The Vidat version 2 is still in alpha stage, its latest development code stores in main branch. And whenever a new commit is pushed to this repo, a compiled pre-release is provided and named as Development Release v2.x.x-xxx and deployed on Aliyun Host. ANU Host is managed manually, which means it can be of any version.

Whenever we decide to release a new version like (v2.0.1), we will create a release named as Release v2.x.x-xxx and deploy it to ANU Host.

@llsantos
Copy link
Author

"The original issue is Could not load video: blob:https://vidat.davidz.cn/c5eb8afc-b3f1-4af7-85a7-41c6425cb582: Failed to open channel which has been resolved."
No, this is only issue. I wrote that i can load the video and annotation in a old vidat 1.0, not in vidat 2.0, even having created the annotations in vidat 2.0.

@DavidZhang73
Copy link
Collaborator

I see. I set up an experiment, using the video and annotation Json file provided by you and manually replace the frames in that Json file with 35763.

It takes around 7GB of memory when 51% frames are cached.

memory1

I did not run into the out of memory issue.

No, this is only issue. I wrote that i can load the video and annotation in a old vidat 1.0, not in vidat 2.0, even having created the annotations in vidat 2.0.

You can use VideoLoader V1 instead of V2 (in Preferences - Video Decoder), which is used in Vidat version 1.

@llsantos
Copy link
Author

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants