SoK/2021/StatusReport/Pranav Gade

Adding support for video annotation to marK

Background

marK(https://invent.kde.org/education/mark) is a scientific tool for data annotation. It currently supports annotating text and images. I am currently working on adding video annotation support to marK. Video annotation would enable users to select and annotate sections of a video by selecting particular frames and drawing to select regions of the frame, just as one would annotate videos. Majority of the user interface would be similar to Image annotation. Alongside that, a timeline/scroll bar will be available to select or seek to the correct frame.

Mentor

Caio Jordão Carvalho

Progress

The work is currently at https://invent.kde.org/pranavgade/mark and is expected to be merged into the main repository at the end SoK.

The user can open video files and use the UI to go to a particular time in the video. The user can add annotation with different classes(see image below) and export it to either json/xml formats.

Screenshots

Commits

The up-to-date commits can be found in this merge request https://invent.kde.org/education/mark/-/merge_requests/6

What I've learnt

As I had expected, this was a challenging project. Since I am not used to contributing to a preexisting codebase, a lot of my time was spent on trying to figure out how the existing application worked, and learning what the most appropriate method would be. I wasn't very good at Qt either, but thanks to my mentor, Caio, I was able to figure out and learn a lot of things.

Contact

You can send mea an email at [email protected], or find me on telegram at @pranavgade20