This is based on this tutorial, recommended by Glutanimate in a comment to the question for making a 'local' installation of a specific version.
I will consider only the case of the deb files package (there are multiple such files archived in a package).
To get the latest versions go here.
To get other versions go here. (I found about this address from here.)
Unpack the archive. You'll get a folder, and in it another called 'DEBS' with many deb files.
Create a folder called 'install' (optional name) inside the 'DEBS' folder.
Open a terminal window inside the 'install' folder. In that terminal, run:
for i in ../*.deb; do dpkg-deb -x $i . ; done
A new folder named "opt" is thus created there with several other folders and files that contain the entire LibreOffice installation.
If you don't want your existing LO configuration to be affected by the parallel installation you will have to change the user profile location of the new install.
To do so open up the bootstraprc file located at ./install/opt/libreoffice/program/ in a text editor. You might have to change the file permissions first to be able to read and write to the file (right click on file → Properties → Permissions). Then change the UserInstallation entry to:
UserInstallation=$ORIGIN/..
To run Writer find and execute something like DEBS/install/opt/libreoffice4.0/program/swriter. The others (sdraw, smath, scalc, simpress etc) are in the same directory.
In this way, multiple versions of LibreOffice can be used in parallel, even opened at the same time.
It is, just do sudo apt-get install libreoffice=version. It will downgrade, remove and install to whatever version you want.
Best Answer
You can uninstall the old version with
sudo apt-get remove --purge libreoffice-commonif it was installed via apt-get.You can find a good tutorial on how to install Libre Office 4 here.