His father, the son of a Loyalist refugee, had moved as a boy with the family from Nova Scotia, settling in southwestern Ontario (then called Upper Canada), in a village known as Shewsbury, later Vienna, by 1811.Samuel Jr. eventually fled Ontario, because he took part in the unsuccessful Mackenzie Rebellion of 1837.