Try some warm compresses on it, using camomile tea bags and warm saline solution, put your teabag in the solution to heat it up and place on the piercing, the heat will draw out any pus and the salt will aid healing whilst the camomile soothes, do this everytime you have a flare up, 3 times each day, also take some high strength vitamin C capsules as this will aid healing, even going back through an already open piercing can cause problems, try jewelery made from PTFE or bio plast as this prevents the pus drying and sticking to jewelery which can damage the healing area. Make sure when you shower or bath you get rid of all soap residue as this will act as an irritant and avoid high waist trousers.