This is done by installing and setting locales

sudo locale-gen en_US en_US.UTF-8
dpkg-reconfigure locales