The land owner is in the wrong and should have stopped after she asked you to be careful of her boat.
I totally enjoy fishermen/fisherwomen coming by our place on Rattlesnake Island. Especially when they catch a biggie! I don’t fish, but I love seeing anglers enjoying the lake. Many of the boats that come by probably don’t realize that I consider them friends.