This suggests that the initial position of of doped N atom is quite unstable. You may refer to the following paper (particularly look at Figure 11 ):
http://pubs.acs.org/doi/full/10.1021/jp512886tThe pyrollic N at monovacancy is a saddle point for the migration of a pyridinic N around vacancy site of monovacancy. That is say, a pyrollic N at monovacancy is much unstable, compared with a pyridinic N at monovacancy.
The way in my experience to generate the atomic structure of a pyrollic N at monovacancy in graphene:
1) replace one of carbon atom in graphene by a nitrogen atom and optimize the structure;
2) rotate one N-C bond in the optimized structure of 1st step by 90 degree (in plane) and optimize it to get the structure of N-doped Stone-Wales defect
3) remove the C atom in rotated N-C bond in the optimized structure of 2nd step and optimize it.
In such way, the initial position of pyrollic N will be placed in high symmetry position, which is better than the one generated by hand as you have done. And so you may have chance to get the optimized structure of a pyrollic N at monovacancy in graphene.