Statistics Canada attributes the drop to a fewer non-permanent residents. It's the largest decline since records began in 1946.