Apple's TestFlight for External Testers - review time?

Does anyone have any experience with getting their builds out to external testers using Apple’s incarnation of Test Flight? I’m currently finding that the App Store review of my beta build is taking as long as a regular live release review!

<horacebury>: Now that the legacy TestFlight.com site is offline, I looked at Apple’s new service and found it didn’t match my workflow very well.

I looked into a bunch of alternatives, but most have iOS and Android SDKs that must be built into the app, which wasn’t an option for me (although presumably now it would be, with the Pro->Enterprise upgrade).

I ended up using https://www.installrapp.com/, which is easier and far more integrated into the damnable provisioning profile process than the old TestFlight. It also handles Android builds. Downside is you have to pay, and it’s limited to 100 iOS users (the Apple limit), but your time has value! Take a look. It’s basically a better TestFlight. Also Installr responded to multiple questions on Twitter within an hour.

I just waited 5 days for a build to be available to my external testers via Apple’s TestFlight. Being that I usually put out numerous builds a day, when iterating, and none of my testers have developer accounts, I’ve taken a look at TestFairy.com - looks similar in operation, though not style, to the original TestFlight.

Any more out there? I think some indie companies are seeing the opportunity that Apple has presented here for the indie/small company community who don’t have numerous in-house testers.

I thought that TestFairy was one of those that require you to build in their SDKs? See below. If you do end up using it with Enterprise, I’d be interested to hear what your thoughts are.

http://docs.testfairy.com/iOS_SDK/Integrating_iOS_SDK.html

Add the following frameworks:

  • CoreMedia.framework
  • CoreMotion.framework
  • AVFoundation.framework
  • SystemConfiguration.framework
  • OpenGLES.framework

The review time for the first submitted build of an app was quite exactly 1 day for every build we submitted yet. If you upload newer builds you will be asked if you changed major things in the app - if you can answer this with ‘no’ the new build is available immediately for external testers.

check out my blog on the Apple testflight

http://www.nobstudio.com/blog/view/apple-testflight-beta-review-must-know-tips

Usually it takes 1 ~ 2 days, longer if you submit during weekend.

I’m gearing up for beta and looked at different testing services. From what I read, doesn’t Apple’s TestFlight only work on iOS 8 now? That plus the whole human reviewer thing, and everything Nob Studio mentioned in his blog… Apple really likes to make things difficult.

I just signed up for TestFairy and it was pretty easy. If you don’t care to gather metrics or recording of user interaction with your app, then their SDK is not necessary. Just upload the apk and/or ipa file and invite your testers. You can test with up to 100 people on their free tier.

Huh! I didn’t know TestFairy had such a generous free tier.

I just paid ~$175 to Installrapp – a once-ever fee, not a monthly fee – and am delighted with it. Faster, easier, slicker than the old TestFlight. And unlimited Android and iOS installs (up to Apple’s 100-person limit) at the paid tier. Also the founders respond via email/Twitter themselves, which is nice.

PS: As far as I know you’re right about the new TestFlight. Another reason to avoid it.

Hmm, that looks pretty interesting. I might end up using them if my app ever becomes profitable lol. I’m trying to minimize my spending at the moment.

just checked out Installrapp. It seems to charge per app?

I am actually using Testfairy for android version now, it is painless and no need to add SDK anything. Basically just build and upload, that’s all, and it will auto update the app too, don’t have to send an email to notify tester to update it. The recording of testers playing the game is really awesome.

Yet to try iOS version.

Yes, Apple’s testflight only supports iOS 8. And read from other users sometimes the invitation email didn’t sent out.

I have a few that were interested to beta test, but didn’t try out the game, not sure if they received the email.

@Nob Studio, you can record Android players on TestFairy without integrating the SDK? I’ve only tested on iOS so far and this is the message I see in the dashboard: TestFairy SDK not integrated in build, no recordings will be performed.

Yup, I am surprised too. In the Build Settings just make sure Recording Status is enabled.

I am still on the free trial of start up plan. Once its over only 200 video recording per month allowed.

<horacebury>: Now that the legacy TestFlight.com site is offline, I looked at Apple’s new service and found it didn’t match my workflow very well.

I looked into a bunch of alternatives, but most have iOS and Android SDKs that must be built into the app, which wasn’t an option for me (although presumably now it would be, with the Pro->Enterprise upgrade).

I ended up using https://www.installrapp.com/, which is easier and far more integrated into the damnable provisioning profile process than the old TestFlight. It also handles Android builds. Downside is you have to pay, and it’s limited to 100 iOS users (the Apple limit), but your time has value! Take a look. It’s basically a better TestFlight. Also Installr responded to multiple questions on Twitter within an hour.

I just waited 5 days for a build to be available to my external testers via Apple’s TestFlight. Being that I usually put out numerous builds a day, when iterating, and none of my testers have developer accounts, I’ve taken a look at TestFairy.com - looks similar in operation, though not style, to the original TestFlight.

Any more out there? I think some indie companies are seeing the opportunity that Apple has presented here for the indie/small company community who don’t have numerous in-house testers.

I thought that TestFairy was one of those that require you to build in their SDKs? See below. If you do end up using it with Enterprise, I’d be interested to hear what your thoughts are.

http://docs.testfairy.com/iOS_SDK/Integrating_iOS_SDK.html

Add the following frameworks:

  • CoreMedia.framework
  • CoreMotion.framework
  • AVFoundation.framework
  • SystemConfiguration.framework
  • OpenGLES.framework

The review time for the first submitted build of an app was quite exactly 1 day for every build we submitted yet. If you upload newer builds you will be asked if you changed major things in the app - if you can answer this with ‘no’ the new build is available immediately for external testers.

check out my blog on the Apple testflight

http://www.nobstudio.com/blog/view/apple-testflight-beta-review-must-know-tips

Usually it takes 1 ~ 2 days, longer if you submit during weekend.

I’m gearing up for beta and looked at different testing services. From what I read, doesn’t Apple’s TestFlight only work on iOS 8 now? That plus the whole human reviewer thing, and everything Nob Studio mentioned in his blog… Apple really likes to make things difficult.

I just signed up for TestFairy and it was pretty easy. If you don’t care to gather metrics or recording of user interaction with your app, then their SDK is not necessary. Just upload the apk and/or ipa file and invite your testers. You can test with up to 100 people on their free tier.

Huh! I didn’t know TestFairy had such a generous free tier.

I just paid ~$175 to Installrapp – a once-ever fee, not a monthly fee – and am delighted with it. Faster, easier, slicker than the old TestFlight. And unlimited Android and iOS installs (up to Apple’s 100-person limit) at the paid tier. Also the founders respond via email/Twitter themselves, which is nice.

PS: As far as I know you’re right about the new TestFlight. Another reason to avoid it.

Hmm, that looks pretty interesting. I might end up using them if my app ever becomes profitable lol. I’m trying to minimize my spending at the moment.