I think it's useful to think not only about Spec(Z) but also about Spec(R), where R is Fq[t]; or, better yet, an order in a finite extension of Fq(t). Getting fluent at flipping back and forth between Dedekind rings like this and curves over Fq will be very helpful in understanding why the "geometric" features of Spec Z are so called.