Download source file from rsync official website: https://download.samba.org/pub/rsync/src/

In my case latest version is 3.1.1:

Unzip the source file and change to that directory, make sure not to use -z option:

$ tar -xf rsync-3.1.1.tar.gz 
$ cd rsync-3.1.1

Start compilation process:

$ ./configure
$ make
$ sudo checkinstall

Done, now check your rsync version, it should be installed:

$ rsync --version

Note: When compiling, you may use $ ./configure –help | less to show options, for example installation location may be chosen.  In this case I did not choose to enter any options, just plain ./configure.

With command $ sudo checkinstall, default options were chosen by pressing Enter, at the first run of checkinstall, you may be asked to enter EOF, press Ctrl + D. $ sudo checkinstall will create .deb file and makes removal of the installed package easy, at the end of the process it will even give you command to uninstall the package and location of the .deb file. Use checkinstall instead of sudo make install.

For example:

...
You can remove it from your system anytime using: dpkg -r rsync