Back to Blog
Detection Engineering

Detection Rule Tuning: The Unending Work That Defines SOC Quality

Marcus Webb 8 min read
Detection rule tuning process illustration

Detection rule tuning is the work that separates security programs that function from ones that produce theater. A rule that fires on real threats with low false positives is an engineering artifact that took significant time to build. It did not arrive that way from a vendor. It did not arrive that way from Sigma or from any other open-source rule repository. Every detection rule is a draft that becomes production-quality through cycles of observation, analysis, and refinement against your specific environment.

Most security teams don't have a formal tuning program. They have a queue of "noisy rules" that analysts complain about, periodic bursts of tuning work after a particularly bad alert storm, and a gradual accumulation of suppression logic that reduces noise in the short term while silently degrading detection quality in the long term. That is not a tuning program. It is alert fatigue management by a different name.

What makes a good detection rule

A detection rule has three properties that can be measured: precision (what fraction of its alerts are true positives), recall (what fraction of actual attacks it catches), and latency (how long after an attack begins does it fire). These properties form a tradeoff space. High precision often requires narrowing the rule condition, which reduces recall. Low latency often requires detecting very early indicators of an attack, which are less distinctive and reduce precision. The tuning process is navigating this tradeoff for each rule given the threat it covers and the analyst capacity available to investigate its findings.

Most teams tune only for precision: they tune when a rule generates too many false positives, with the goal of reducing alert volume. This is the wrong primary objective. A rule that fires zero times is perfectly precise. It is also useless. The correct objective is maximizing the product of precision and recall subject to the constraint that analysts can actually process the alerts generated. That means tracking both precision and recall, which requires knowing when attacks occur that a rule should have caught but didn't.

The tuning cycle

An effective tuning cycle has four phases, and it must be run continuously, not episodically.

The first phase is alert classification. Every alert closed by an analyst should be classified as true positive, false positive, or benign true positive (the rule fired correctly but the activity was not malicious). This classification is the data that drives the rest of the cycle. Teams that don't do systematic alert classification have no tuning data and are tuning by gut feel.

The second phase is pattern analysis. After a week or two of classification data, patterns in the false positives become visible. The same service account triggering the same rule 40 times a day. The same CI/CD pipeline generating the same activity that looks like reconnaissance. These patterns are the inputs to tuning decisions.

The third phase is rule modification. The key discipline here is modifying the detection logic rather than adding suppression when possible. A suppression excludes a specific entity or pattern from triggering an alert. A logic modification changes the rule so it doesn't fire on benign activity at all. Both reduce false positive volume. But a suppression creates a bypass path: any attacker operating through the suppressed entity will avoid the rule entirely. A logic modification that distinguishes malicious from benign activity maintains detection while reducing noise.

The fourth phase is coverage verification. After modifying a rule, run it against a historical dataset that includes known true positive cases to confirm that the modification didn't break recall. This is testing, and it is frequently skipped because it's time-consuming. Teams that skip it routinely discover months later that a previously effective rule was quietly disabled by an overly aggressive suppression and missed a category of attacks entirely.

The suppression debt problem

Every suppression added to a rule is a debt entry. The suppression solves an immediate noise problem. It also removes a detection path that might matter in a future attack. Over time, rules accumulate suppression logic to the point where the condition they were originally written to detect can be satisfied by attacker behavior without triggering any alert.

The suppression debt problem is particularly acute with service account suppressions. Service accounts are heavily suppressed because they generate high-volume, predictable activity that triggers many rules. They are also high-value targets for attackers because they often have broad permissions and their activity is treated as background noise. An attacker who compromises a heavily suppressed service account has a window of operation that can last weeks before the activity becomes unusual enough to escape the suppression logic.

The antidote to suppression debt is periodic suppression audits. Review every suppression that's been in place for more than 90 days. For each one, ask whether the condition it suppresses is still benign, whether the entity it excludes is still well-governed, and whether there is a better way to write the rule that doesn't require the suppression. Suppression debt audits are not glamorous work. They are, however, how teams with good detection programs keep their rules honest over time.

More from the Cloakmint blog

Detection engineering, SOC strategy, and cloud security operations.

Browse all articles