Though this isn't what you're asking about, here is some feedback.
The usual thing to do is to override the paintComponent method of the panel and draw whatever part of the map is visible. Instead of changing the position of the panel, just store variables indicating which tile is currently at the top-left and draw whatever tiles are currently visible.
Additionally, it would be better if you couldn't scroll past the edge of the map, though that's a separate issue.
I didn't play the game; I just looked at it and scrolled around.
Noo, you misunderstand me
The 'InfoPanels' that show tile & unit information that's are the ones that flicker badly when moved using setPosition()
I do scroll using a leftTop Point.
Agreed need to fix the out of bound scrolling(having problems with it)
and draw whatever tiles are currently visible.
I just draw every Tile in the map, aren't drawing operations outside the panel bounds ignored?