Be very careful. This could escalate out of all proportion and if you think it's bad now, you could find it impossible if it gets worse.
I wish I could offer a solution, but all I have is sympathy. We had years of basketball going in our neighbours driveway, and give me a bunch of teens...