Here is a quick WordPress and Xampp tutorial to install WordPress locally on your computer. Using the free application Xampp you can easily run WordPress on your PC and this also includes the database. Having WordPress installed on your computer gives you the option to modify your WordPress website and/or play around with the whole design, basically, you can learn and experiment with WordPress installations.

Especially when you are starting new, instead of purchasing a host, you can create a whole new website on your own computer. And if everything is all great, you can then choose to transfer the site to a host. This will save you time and you can freely experiment with your website too.