It isn’t a matter of believing in them. I have had encounters. Yes, stuff goes on that we can’t explain. I lived in that house for seven years. The first three the presence was very active but eventually either left or just accepted that we were OK occupants of his/her/their domain.
Examples of what we found when we would go downstairs in the morning:
.kitchen chairs pulled out from the table
.coffee maker pulled out to the edge of the counter and turned sideways(every day for at least a year)
.items in the pantry moved
When I came in from work I often found things moved. Once I had stripped the bed in the morning but left the sheets on the floor to take care of that night. When I came home from work one of the sheets was downstairs by the washer.
One night when my husband was out of town I didn’t finish vacuuming the LR. I just unplugged it and left it there to finish the next morning. During the night the vacuum came on. This one scared me so badly it was all I could do to go down the stairs and turn it off.
I remember being in bed one night and hearing the kitchen chair being moved. My husband wouldn’t wake up so I just put my head under the cover and waited for daylight.
After we lived there about five years the prior owner told us he could never keep tenants in the house because they claimed it was haunted. We still talk and laugh about the ghosts in that place.