Your site must always have a Home page, so if you to remove/replace the home page you must first assign another page as Home.
Use a different page as 'Home'
Click the Pages tab (1) and select a page (2). Click the page settings icon (3) to open the page settings panel
Scroll down to the bottom of the page settings panel
Click the Use as Home page checkbox (1) and then click Save (2).
Remove the original home page
Select the original Home page (1) and click the page settings icon (2)
Scroll to the bottom of the page settings panel. Click the Delete this page button (1)