What is OpenVPN, and how does it work?

OpenVPN is one of the most popular virtual private network (VPN) protocols for creating VPN tunnels to establish secure connections between networks. But what is OpenVPN, what advantages does it offer, and should you ever use it?