New to the Forums, question about them

Is there a way to get notifed when somone replies to a forum discussion you commented on? I checked the box 'New Forum Reply' under manage alerts but I seem to get all replies even for topics I haven...