There are many jobs which are naturally stressful, like being a Fireman/woman or a Police Officer. There are, however, many jobs which are not inherently stressful, but the working environment makes them so. This is the main cause of stress in the workplace, I would say.
If colleagues are pitted against each other in compitition to earn bonuses, a cut throat, winner take all culture will develop. If colleagues are encouraged to collaborate and find fair outcomes for customers, then a supportive and uplifting culture will develop.
Another consideration is whether things like the values and operating rhythm of the workplace match your own. In other words, are you a good fit for your workplace and your role. Figuring out your own values and how you work best is a great place to start.
Sometimes though, the problem is the view you have of the work you do. I work in complaints and I could say that I speak to angry and rude people all day long, but I don’t. In fact, I speak to people who have problems, often caused by the company I work for, and it is my job to fix the problems and rebuild the relationships between the customers and the company. In other words, see them as human beings first and take responsibility for fixing their issues.
The views we have can blind us to the opportunities that problems provide.