Reporting Unrelated comments

Does this feature require a specific number of reports before a post dissapears from the list ? There were 3 replies in the APsense group that obviously shouldn't have been there, i clicked on the link for one (which already had one strike) and it disapeared from the list. There were 2 others with no strikes, I clicked on these and it showed up as having been reported but they stayed in the list. I can remember reading something about this before, but i'm not sure if it was for the old spam reporting system or the unrelated comment section.