He probably wasn't invited because Conservatives are outdone with him for 2 things especially. 1. His behavior before the election where many thought he was kissing up to Obama in the wake of Sandy and they think his out front promoting of Obama hurt the election.  2. Many are not thrilled with him "whining" so about needing more and more federal funds to repair after Sandy. There are many people in Louisiana that believe the help being given in the wake of Sandy vs. Katrina is extremely preferential to those in New Jersey. Add that to the pictures of him sitting by Michelle at dinner this week and it is harmful to him being trusted as a conservative.