Test Bench 0.9.1
Changelog

Updated

See the previous 0.9 changelog.

What's Changed?

Test Bench 0.9.1 is a minor update to change our criteria for what constitutes a DNS, IP address, and/or kill switch leak. Feedback from the community helped us realize that we were too harshly considering calls to a VPN's own server leaks, which isn't aligned with most users' risk tolerance. As such, we've adjusted our definition of what a leak is:

IP and DNS Leaks

If the VPN calls back to the company's server or APIs outside the tunnel while the VPN is connected, we no longer consider this behavior a leak.

A screenshot showing the previous test results for ExpressVPN.
In 0.9, we considered ExpressVPN to leak since it made DNS calls to their own servers.
A screenshot showing the new test results for ExpressVPN.
In 0.9.1, we no longer consider this a leak.

Kill Switch Robustness

If a VPN needs to make DNS queries or connect to API servers to re-establish the VPN connection after losing internet access or the app crashes, we no longer consider it a leak.

A screenshot showing old test results for Windscribe.
In 0.9, we considered the calls that Windscribe made to its own API servers after a system reboot a leak.
A screenshot showing the new test results for Windscribe.
In 0.9.1, we no longer consider these calls a leak.

20 VPNs Updated

We have retested popular models. The test results for the following models have been converted to the new testing methodology. However, the text might be inconsistent with the new results.