Points are awarded for winning a variation. The number of points depends on the popularity of the position and the time spent calculating it. The starting position is the most valuable position because it is visited the most. If you lose a variation to someone else you lose some of the points you were awarded for winning this variation, so your points can fall when you are not active.