Hi there,
I would be looking at the depth of the step down onto the finished height of the paver's first, and establishing it was within the standards.
Next I would add a 100 minimum (more is better) run of concrete along the side of the house, this will stop most moisture and prevent the paver's moving in that direction as well a level guide when laying.
Compacted cracker dust with a little bit of water added will compact well with a small plate compactor, then use a straight edge to get a 10 mm fall to the fence.
Lay all the pavers and run the plate compactor over the lot, adding a bit of fine sand to fill in between the paver's so the lines stay straight.
Leave a small gap between the fence and the last paver, fill this with more concrete to prevent any movement on the outer edge.
Job Done.
Good luck and fair winds.
