The high symmetry k points for hexagonal unit cell cannot be directly used in the band structure calculation of a rectangular unit cell.
If the rectangular unit cell is taken with the following unit vectors: a1 = (sqrt(3)* a, 0, 0); a2=(0, 3*a, 0); a3=(0, 0, c), where a is the lattice constant of graphene sheet, the line along Gamma---> Y (0.0, 0.5, 0.0) in the BZ of rectangular unit cell is parallel to the line along Gamma--M' (0.0, 0.5, 0.0) in the BZ of a hexagonal unit cell, also the line along Gamma--->X(0.5, 0.0, 0.0) in the BZ of rectangular unit cell is parallel to the line along Gamma-->K(2/3, -1/3, 0) in the BZ of a hexagonal unit cell. Here the fractional coordinates of M' and K in the BZ of a hexagonal unit cell [a1= (a, 0, 0); a2= (-1/2 *a, sqrt(3)/2 *a, 0); a3=(0,0,c)] are given according to the BZ in Fig1-1.jpg. To map the coordinates of k points of rectangular unit cell with those of a hexagonal unit cell, it may be better to first transform the above fractional coordinates of k points to their Cartesian coordinates, and then to use
them in the band structure calculations.