How Do We Audit AI?

Back in the day, Ryan Carrier of ForHumanity  told me to stop saying I do AI “audits.” 

I replied, “Why? What’s the difference between an audit and an assessment?” And then he showed me the way.

He’ll show you the way, too, in this episode, which I found particularly edifying. Most helpful, for me, was the explanation for how auditors address areas in which there are ethical disagreements.

Ryan founded ForHumanity after a 25 year career in finance. His global business experience, risk management expertise and unique perspective on how to manage the risk led him to launch the non-profit entity, ForHumanity, personally. Ryan focused on Independent Audit of AI Systems as one means to mitigate the risk associated with artificial intelligence and began to build the business model associated a first-of-its-kind process for auditing corporate AIs, using a globally, open-source, crowd-sourced process to determine “best-practices”. Ryan serves as ForHumanity’s Executive Director and Chairman of the Board of Directors, in these roles he is responsible for the day-to-day function of ForHumanity and the overall process of Independent Audit. Prior to founding ForHumanity, Ryan owned and operated Nautical Capital, a quantitative hedge fund which employed artificial intelligence algorithms. He also was responsible for Macquarie’s Investor Products business in the late 2000’s. He worked at Standard & Poor’s in the Index business and for the International Finance Corporation’s Emerging Markets Database. Ryan has conducted business in over 55 countries and was a frequent speaker at industry conferences around the world. He is a graduate from the University of Michigan. Ryan became a Chartered Financial Analyst (CFA) in 2004.