Use AB testing to compare different versions of your app and see which one performs better.

To get started, simply add a field version_id with the name of your version in the metadata when logging to phospho.

log = phospho.log(
    input="log this",
    output="and that",
    version_id="YOUR_VERSION_ID"
)

Using this version_id, you will be able to compare the average success rate of the different versions.

Note that the difference in success rate must be statistically significant to be considered as a real difference. That’s why phospho also computes the standard deviation.

To see the results of your AB test, go to the Phospho dashboard and click on the “AB Testing” tab.