Number theory concepts like prime numbers, modular arithmetic, and theorems like Fermat's and Euler's are important foundations for cryptography. Primality testing and the Chinese Remainder Theorem can help efficiently generate and operate with large prime numbers. While exponentiation is easy, the inverse problem of computing discrete logarithms is computationally difficult, making it suitable for cryptographic applications.