NQ indecision

I have been offered a newly-qualified job at the firm I trained with. The only problem is it is in a department I really did not enjoy when I was there during my training contract. I like the firm and I know how difficult it would be to find another position but I know I would not enjoy working in the department. What do I do?