Quick update : my game has been approved ! Like I said earlier, I’ve removed all the device requirement and the only limitation that I’ve got is an OS limitation (ios 9 only).
My game definitely doesn’t run very well on iPhone 4s but I guess it runs well enough for Apple (or the Apple reviwer) which is great !