What should we do if tenant refuses key handover before deposit?

We gave our semi-furnished property on rent in June 2023. We executed an 11-month Leave and License Registered Agreement from June 7, 2023, to May 7, 2024. As requested by the tenant last month, we gave them a one-month extension without executing a new agreement, i.e., until June 7, 2024. Now, the tenant is asking us to do the inspection and return the full deposit amount before handing over the keys on June 7. We tried explaining that there could be damage during the moving process, so the inspection can only happen after they hand over the keys. We will return the deposit within 2-3 days after the inspection if there are no issues. However, the tenant isn't agreeing and claims that since the agreement is over, there is no legality involved, and they will not hand over the keys before the full security deposit is returned. What should we do in this case?