Without this, we're unable to add actual migrations for the app. Backport of 808388c28c from master
808388c28c