Why did God not just remove sin and start all over again?
God is quite capable of doing this. But as CS Lewis points out: if God had removed the first sin, with all its repercussions, human nature is such that another sin would quickly have followed, then another, then another. Real choices are based on taking responsibility for the consequences of our actions. If God had intervened by taking those consequences away, then there would no longer be real choice.