Kennedy was born in Brookline, Massachusetts, to Joseph P. Kennedy Sr. and Rose Kennedy. He graduated from Harvard University in 1940 and joined the U.S. Naval Reserve the following year. During World War II, he commanded a series of PT boats in the Pacific theater and earned the Navy and Marine Corps Medal for his service.