How far back should historical claims determine present-day rights?

That is a genuine question in political philosophy, legal theory, and historiography.

. Mosque → temple → earlier structure

My reasoning is:

If today's ownership is challenged because an earlier structure existed underneath, then why stop there? Earlier structures may themselves have replaced even earlier ones.

This is a challenge to the idea of selecting a particular historical moment as the legally decisive one.

It asks:

Why is one historical layer privileged over all earlier layers?

That is a legitimate philosophical question.