The unedited video above is less than 4 minutes and demonstrates the methodology instructed to us by a Tier One carrier's engineering department. It is how they evaluated our product. If you have a WavCatcher case and want to test your smartphone's cellular or WiFi speed, it is important to review the instructions below so you correctly identify your phone's performance during that test instance. In accordance with the carrier's test methodology, we use the Ookla Speed Test app (free version)
Every WavCatcher speed test video utilizes this carrier-approved speed test methodology. Side-by-side testing is an excellent evaluation of phones attempting to connect or perform on a network at the same time. This is important as time is an important factor in signal traction.
No case to case testing, although a better long term indicator, is subject to the fluidity of network traffic. For instance, speeds can increase from 5 Mbps to 50 Mbps (or decrease) at any instant during peak periods with our without our signal case. The question is if the metrics captured in this activity are accurate if it occurs during these throughput spikes.
The minimum number of test instances (no case/with case or side-by-side) per location and/or orientation typically conducted by 3rd party evaluators is 10. At WavCatcher, we attempt a minimum of 20-30 test instances for no case/with case (off/on) and switch orientation every 10 instances (on table at 90 degress, in hand at 45 degrees, etc.).
For side-by-side tests, we conduct 50-100 consecutive instances to better document for video and the Ookla Speed Test reports. On our end, it’s been fascinating to witness the performance fluctuations and learn how much of a device’s performance is affected by network traffic and base station/router performance. Please keep in mind that if the service provider is throttling or providing hard data caps, no amount of signal improvement will increase your download/upload throughput.
SPEED TEST INSTRUCTIONS
Every WavCatcher speed test video utilizes this carrier-approved speed test methodology. Side-by-side testing is an excellent evaluation of phones attempting to connect or perform on a network at the same time. This is important as time is an important factor in signal traction.
No case to case testing, although a better long term indicator, is subject to the fluidity of network traffic. For instance, speeds can increase from 5 Mbps to 50 Mbps (or decrease) at any instant during peak periods with our without our signal case. The question is if the metrics captured in this activity are accurate if it occurs during these throughput spikes.
The minimum number of test instances (no case/with case or side-by-side) per location and/or orientation typically conducted by 3rd party evaluators is 10. At WavCatcher, we attempt a minimum of 20-30 test instances for no case/with case (off/on) and switch orientation every 10 instances (on table at 90 degress, in hand at 45 degrees, etc.).
For side-by-side tests, we conduct 50-100 consecutive instances to better document for video and the Ookla Speed Test reports. On our end, it’s been fascinating to witness the performance fluctuations and learn how much of a device’s performance is affected by network traffic and base station/router performance. Please keep in mind that if the service provider is throttling or providing hard data caps, no amount of signal improvement will increase your download/upload throughput.
SPEED TEST INSTRUCTIONS
- It is necessary to (A) turn off the WiFi when cellular speed testing; and important to (B) refresh the signal via airplane mode as demonstrated in the video to eliminate legacy traction. There will still be some stickiness, but that’s okay if the minimum test requirements are met. The key is that the majority of the test instances should reflect that a better signal yields better performance (i.e. minimum 6 out of 10 for no case/with case tests because of orientation; or our preference of at least 70 out of 100 for side-by side tests).
- WiFi Speed Testing is a bit more complicated. By simply turning on the WiFi, the speed test results are inconclusive. It is important to disable cellular service in the settings if you want to test your phone to a home or office router. Most of the carriers offload to WiFi to provide relief for network congestion. Therefore, a WiFi speed test is really two-fold: (a) standard connect to an in-building router, or (b) connect to a cell tower.
- One component that is not listed in the video but is helpful for feedback is if you can identify what frequencies the DL/UL are operating on. This can be found on the iPhone by entering on the keypad: *3001#12345#* then SEND, which will open the Field Test window. If you select Serving Cell Info, in most (but not all) cases, the download and upload frequencies are provided.