Greedy algorithms make locally optimal choices at each stage in order to find a global optimum, often used for optimization problems due to their simplicity and efficiency. They can lead to quick solutions, but may not guarantee optimal outcomes and can get stuck in local optima. The document discusses the characteristics, advantages, and disadvantages of greedy algorithms, along with examples like the coin change problem, knapsack problem, and Kruskal's algorithm.