This year Louis hit Las Vegas, Tulisa took the girls to St Lucia and Nicole Scherzinger went to Dubai with the boys.
Taking guest mentor Ne-Yo along for the ride, the group lived it up at beachside luxury resort Jumeirah Zabeel Saray, on the western crescent of Palm Jumeirah in Dubai.
The boys were put through their paces in the hotel's Lebanese restaurant Al Nafoorah, whilst the 'deliberation' scenes were filmed in the opulent Talise Ottoman Spa.
Not too shabby for Nicole.
And now you can go and try living like a Pussy Cat Doll as the hotel has launched an X Factor holiday package.
Giving visitors the chance to replicate the experience of the X Factor contestants, judges and not forgetting the lovely Dermot O'Leary, the package includes 24 hour butler service, limousine transfers, fine dining experiences and relaxing with some signature treatments at the hotel's spa.
Oh! and you get unlimited access to Wild Wadi Waterpark - something we're sure Miss Scherzinger made full use of during her stay.
X Factor packages start at 950 AED per person (including tax), plus the best available room rate. for more information visit, Jumeirah.com