Sounds to me like it is a "keloid" scar. Basically it is scar tissue. You can not get rid of keloid scars and this is something you will want to tell a surgeon if you ever have to have surgery. Go to a doctor and have it checked out. :0)
Does anyone get a bump above their piercings? My nose piercing has a bump above it and it'll go away and then come back. Does anyone know why and how I could get rid of it for good?
As Yin said and Keloid's have a 99.99% chance of getting bigger and are horrific looking scars.
Best to remove the nose piercing immediately and visit a dermatologist.
Remember this, it's your NOSE😳.