Ubuntu Server - ARM64 for Pi4

make sure you have python-dev(python3-dev) and git and try the manual way:

git clone git://github.com/adafruit/adafruit-beaglebone-io-python.git
cd adafruit-beaglebone-io-python
sudo python setup.py install

Source