vlc is a Qt 5 application. According to ArchWiki, to run any Qt application in wayland
you need to install qt5-wayland
or qt6-wayland
and use the QT_QPA_PLATFORM=wayland
environment variable to accomodate for wayland applications. For applications misbehaving in wayland, use QT_QPA_PLATFORM=xcb
before running the application.
Source: https://unix.stackexchange.com/questions/598099/could-not-find-the-qt-platform-plugin-wayland
sudo apt install -y qtwayland5
See if it works.