Back to Blog
SOC Strategy Alert Triage

The SIEM Signal-to-Noise Problem Isn't Getting Better. It's Getting Worse.

Amara Bello 7 min read
SIEM signal to noise ratio problem

The SIEM was supposed to be the solution to the fragmented, high-noise detection problem. A centralized system that ingests all your logs, applies correlation rules, and surfaces only the meaningful security events. It was a compelling architecture in 2005. In 2025, the SIEM is often the largest contributor to analyst noise rather than the solution to it.

The failure mode is consistent: organizations buy a SIEM, onboard every log source they can connect to it, enable every detection rule the vendor ships, and discover that they now receive 2,000 alerts per day instead of the 200 they had before. The SIEM didn't filter signal from noise; it amplified noise by correlating it at scale.

Why the architecture fails

SIEMs are correlation engines. They are good at taking events from multiple sources and finding events that match a pattern across sources. The problem is that correlation rules written generically, without knowledge of your specific environment's normal behavior, produce high false positive rates because normal activity in your environment looks like the threat patterns the rules were written to catch.

A SIEM rule that fires when an account accesses more than 100 files in 10 minutes is designed to catch ransomware staging or mass exfiltration. In an environment where several batch processing jobs run at predictable times and routinely access tens of thousands of files, the same rule fires on legitimate activity hundreds of times per day. The rule is technically correct. The false positive rate is 99.9%. The rule is functionally useless.

Vendor-supplied rule libraries are optimized for broad coverage across industry segments, not for precision in your specific environment. They catch real threats in some environments and drown analysts in noise in others, and without extensive tuning investment, you don't know which category your environment falls into until you're six months into an analyst-drowning situation.

The ingest-everything fallacy

The second failure mode is the belief that more data always improves detection. "If we had that log source in the SIEM, we might have caught it" is a real lesson from incident retrospectives, and it leads to a policy of ingesting everything possible. But ingesting a log source without building quality detection rules for it doesn't improve detection; it adds volume to the noise floor and increases storage costs.

The relationship between log volume and detection quality is not linear. Detection quality is determined by the quality of your detection rules, not the volume of data they run against. A SIEM with 500GB/day of carefully selected, well-instrumented log sources and 50 precision-tuned rules will outperform a SIEM with 5TB/day of everything-you-could-connect and 2,000 vendor default rules. The first scenario costs less, processes faster, and produces fewer false positives.

Log source prioritization as a discipline

The teams with the best SIEM signal-to-noise ratios treat log source onboarding as a formal engineering process with a quality gate. Before a log source is connected to the SIEM, two questions must be answered: what specific detection use cases does this source enable that no existing source provides, and what detection rules will be built for this source within 60 days of onboarding?

If the answer to either question is "we're not sure yet" or "we'll build rules later," the source isn't ready to be onboarded. "Later" in SIEM engineering is almost never. Log sources that arrive without dedicated detection rules become background noise contributors indefinitely, because rule-building gets deprioritized in favor of the next onboarding project or the latest analyst-facing work.

What improving signal-to-noise actually looks like

Improving SIEM signal-to-noise is a deprecation project as much as a development project. For most organizations, the highest-leverage action is disabling or pausing the lowest-precision rules, not adding new ones. A rule with a measured false positive rate above 80% is not contributing to detection; it is contributing to noise. Disabling it does not reduce security. It reduces work.

The psychological resistance to disabling rules is real. A disabled rule feels like a coverage gap. But a rule that generates 400 alerts per week with a 0.25% true positive rate is producing one useful alert and 399 noise alerts. The analysts who close those 399 noise alerts are not just wasting time; they are developing habits of dismissal that make them less likely to catch the 1 real alert before they dismiss it too.

Signal-to-noise improvement is a long program, not a project with a completion date. It requires ongoing measurement, regular rule audits, and organizational acceptance that reducing alert volume while maintaining or improving true positive rate is a success, even though the output (fewer alerts) looks superficially like less work being done. It's more work being done better.

Rule lifecycle management as a practice

One of the structural gaps in most SIEM programs is the absence of rule lifecycle management. Rules are created, tested, deployed, and then effectively become permanent. The rule library grows over time as new threat techniques are covered and new log sources are onboarded, but old rules rarely get retired even when their false positive rates have climbed to the point of uselessness. The SIEM rule library is often the organizational equivalent of technical debt: understood to be a problem, difficult to prioritize fixing, easy to defer.

Teams that manage this well apply a quarterly review process to their rule library. Each rule is evaluated on three metrics: alert volume over the past 90 days, true positive rate (what fraction of alerts led to real escalations or confirmed incidents), and analyst burden (average investigation time per alert). Rules that fall below a defined true positive threshold get suppressed pending retuning. Rules that routinely consume analyst time without producing incidents get retired or scoped more narrowly.

The natural resistance to this process is the fear of coverage gaps. If we disable a rule, we might miss an attack that rule would have caught. That fear is legitimate but often overweighted. A rule with a 0.5% true positive rate is catching a real threat once every 200 alerts. The analysts handling the other 199 alerts are not providing security coverage; they are doing work that does not contribute to security outcomes and that degrades their capacity to handle the 0.5% that does matter. The coverage calculus changes when you account for the fact that a team drowning in false positives will miss true positives in the noise.

Baselining as the path to precision

The deepest structural problem with vendor-supplied SIEM rules is that they are not environment-aware. A rule that fires when a user accesses 500 files in five minutes has no knowledge of your environment's normal file access patterns. It applies a static threshold that was tuned against a population of environments, not your specific environment. In some environments, 500 files in five minutes is a plausible attack indicator. In others, it's what your backup job does every morning.

Environment-specific baselining is the mechanism that converts broad detection coverage into precise, low-false-positive detection. Rather than firing when any account exceeds a static threshold, a baselined detection engine fires when an account's behavior deviates from its own established pattern. An account that normally accesses 20 files per hour accessing 500 files in five minutes is a meaningful deviation. The same detection, applied per-account based on behavioral history, produces a fraction of the false positives of the static threshold variant.

Building and maintaining behavioral baselines requires infrastructure investment that most SIEM deployments don't have. It is one of the primary technical arguments for purpose-built detection and response tools rather than trying to retrofit behavioral analytics onto a SIEM architecture that was designed for log aggregation and static rule matching, not per-entity behavioral modeling.

More from the Cloakmint blog

Detection engineering, SOC strategy, and cloud security operations.

Browse all articles