That was a "feature" (iPad-only) of iOS 8. It's never happened with iOS 9.

// @kdfrawg