Flurgrl, same happened to me when my local GP retired. Just for this contingency, when I was Dx'ed years before, I'd asked my rheumatologist to send an "FYI letter" to my local GP. (BTW, it's good to keep copies in your own files, too.) Alas, my new GP refused to read her predecessor's patient files, saying his files were "junk". Because she set a high-water mark for snark, I made her eat crow. A whole lot of it.
I agree with the advice you got, to humor him once, mainly because new doctors truly are on the hot seat no matter who originally diagnosed you, or when. Problem is, they're legally vulnerable, which makes them (understandably) cautious. Personally I wouldn't return UNTIL the key files are copied & forwarded, so as to avoid a repeat of appt. #1. Let us know how you make out, OK? Sending my best wishes to you, Vee