comparepdf is a command line tool for comparing two PDF files. By default it compares their texts but it can also compare them visually (e.g., to detect changes in diagrams, images, fonts, and layout). It should prove useful for automated testing.

If you want a GUI application that shows the detailed differences between PDFs use DiffPDF instead.