It was a kind of condescending fondness at best. He didn't really seem to have much respect for Robb. It wasn't until he was in Winterfell and the associations started to come back that whatever real feelings he had re-emerged. They were always second to his own aggrandizement, however. And whatever his attitudes towards the Starks, nothing explains or justifies the murderers he commits to bolster his self-image.

Necessary for the unsubtle requirements of the show, but pretty much the nail in the coffin to his father's respect.