We’ll look at the science behind AWS CodeGuru Reviewer, a web service for publishing code review comments. In particular we’ll look at how the service evolved from an ML-only product to where it is today, which is a mixture of program analysis and ML. We’ll also look at what makes a service like this hard to build, what customers like and dislike, and lastly how it is evolving both under the hood and as a product.