Worst part? Why would someone think there is even a worst part of being a UI designer? I think it is super awesome to be a UI designer. You design the interfaces, keep up to date with trends in the world of interfaces, experiment with different layouts, styles, interactions … there is so much one can do.
The only thing you got to probably deal with is multiple iterations with a client on a design, but there is nothing so bad about that. Iterations only make you a better designer. You may start with one design, and end up with something awesome in the 5th iteration. These iterations make you think about how you can make multiple visuals of just one screen. UI design is a thinking job; you don’t just copy a wireframe to make the final design. You are made to think about how you can design screens in multiple ways. And I don’t see anything worst about it; embrace the job, keep designing, trying and learning new things along the way and you’ll definitely go a long way in the future.