After installing LAMP server, I want to be able to use secure SSL connection to access my services like phpmyadmin using https://my.ip.address/phpmyadmin.

To achieve this, ssl module has to be enabled and apache needs to be told, how to handle traffic from port 443, this is done by enabling default-ssl site.

After restart, you should be able to access your web server using self-signed SSL certificate, browsers should warn you in red colors about this certificate, because it is not signed by any authority like Verysign or GeoTrust, ... but do now worry, you may trust it only if you trust yourself, I trust me and my server, so it is good enough for me for now on. 

If you have firewall enabled, you should allow incoming TCP connection on port 443.

Newbies watch out using ufw, if you enable firewall on remote machine and do not allow incoming TCP on port 22, you may end up disconnected from your server!