Understand the mathematical functions that introduce non-linearity into neural networks, enabling them to learn complex relationships.