Do not caulk between siding and any built in receiving channels located at or around windows.
Seal gap between siding concrete.
How to seal and fix a gap between foundation and concrete sidewalk or patio.
The best solution here may be to clean up that area of all debris let it be fully dry and then apply a bead of qood quality exterior grade caulking material.
Loctite pl10 often the gap to be filled is quite deep.
Find the entrances mice use to enter your home.
Theoretically you could seal the tar paper to the foundation with foam spray caulking something similar.
To prevent further water damage install closed cell backer rod in the gap between the patio and house foundation and cover it with concrete crack sealant.
How to seal siding to keep out mice.
Not a vapor barrier as you say but it prevents water that makes it past the siding from getting any further into the wall.
All it takes is backer rod and concrete flex sealant.
I believe you have tar paper under your siding based on your description.
Note that there are various types of caulk.
Crawl around the exterior of your home and use a flashlight to find cracks holes and gaps.
They are typically mechanically robust adhere extremely well to almost everything especially wood and concrete and are stretchy enough for seasonal building movement.
In that case the use of backer rod before caulking is recommended.
Leave a 1 8 gap between the siding and the trim or other materials to allow for structural movement.
Since some of the siding looks like it will need re priming and painting make sure that you use a paintable type of caulk.
I am going to assume that you have a concrete patio which has a small gap where it meets the house foundation.
Vertical trim gap caulking.
In this case what i would use is a polyurethane caulk made for masonry like this one.
The urethane caulk sealants were developed for the joints between the panels in concrete tilt up construction.