In what ways is GPU programming similar to CPU programming?
Mark Harris’s chapter from GPU Gems 2, “Chapter 31: Mapping Computational Concepts to GPUs”, describes the various basic GPU programming constructs and relates them to CPU programming idioms with which you are likely already familiar. Look there for an excellent overview of the answers to this question.