The most-mentioned books on r/math.
Looking for more? Similar subreddits are algorithms, Astronomy, chemistry, cryptography, and PhysicsStudents.