That last part just is not true. Brees didn't come on until his 4th year; which is why SD lost patience and drafted Rivers. Big Ben didn't become consistently really good until after his 3rd year. Matty wasn't putting up truly good numbers until his 3rd year. QB is one of THE hardest positions in the NFL, we have no idea what Rogers would have been if he was not sat for a few years. I remember him getting hurt in one of his early games and people talking about how GB was going from Iron man to a guy that couldn't finish a game. Would he have been really good eventually sure, but maybe he has more struggles and GB loses patience with him(ala Brees and NO's) while Farve is winning somewhere else. It's impossible to know.
Not not really true about Brees. He was doing good enough with the Chargers and had a Pro Bowl season that fourth year. The main reason why they traded him was because he dislocated his shoulder joint and had a 360 degree tear of his labrum and rotator cuff. They were afraid he wouldn't be the same again and instead of keeping him they got what they could for him and traded him. They had Rivers sitting behind him ready to start. Similar situation to what the Colts did with Manning.
Brees was a free agent when he signed with NO. They just let him walk. I'd think they got a good compensation pick because he got like a crazy high 60 million deal if I remember correctly.