Did you know that the Astor family 's plans for 200 Madison Avenue were delayed for years because of J. P. Morgan Jr. , who lived across the street?