
Analyzing AWS WAF Application Telemetry in Graylog
Operational Blueprint: Normalizing Web ACL Payloads via Illuminate to Transform Raw JSON Streams into Searchable Threat Intelligence
Security Operations Briefing: When public applications run behind Amazon CloudFront, Application Load Balancers (ALBs), API Gateway, or AWS AppSync, AWS WAF acts as the primary gatekeeper against web exploits. However, raw firewall logs are frequently stuck in unparsed cloud repositories, creating an engineering blind spot. The Graylog Illuminate AWS WAF Content Pack bridges this visibility gap by automatically decomposing complex JSON payloads, mapping web events to a canonical schema, and feeding active detections straight into the corporate SIEM pipeline.
The Strategic Advantage of Deep WAF Ingestion
Amazon Web Services Web Application Firewall (AWS WAF) evaluates incoming HTTP and HTTPS requests against managed or custom access control lists (Web ACLs). Every request triggers a discrete action—whether it is an explicit ALLOW, a hard BLOCK, an analytical COUNT, or step-up verification via CAPTCHA or JavaScript-based browser CHALLENGE modules.
Because the WAF tier sits directly at the edge of internet-facing services, its telemetry records the exact attack patterns targeting your cloud environment. Deep ingestion of these access logs gives security operations centers (SOCs) visibility into zero-day probing, credential-stuffing trends, and the performance of active application security rules.
Architectural Overview: The Illuminate Processing Pipeline
The AWS WAF Content Pack is built specifically for AWS WAF v2 architectures using Amazon Kinesis Data Firehose for real-time delivery. Upon activation, the suite executes automated extraction, enrichment, and normalization loops:
Automated Content Pack Artifacts
- Unified Ingestion Streams: Provisions the
Illuminate: AWS WAF Messagesstream, instantly managing incoming payloads without needing manual routing parameters. - Pre-indexed Data Retentions: Implements a dedicated index set optimized with a default daily rotation and a 90-day retention loop, ensuring performance remains stable during intense scanning events.
- Graylog Information Model (GIM) Standardization: Normalizes unparsed HTTP requests, origin parameters, and termination signatures against GIM schemas, translating raw cloud variables into standard enterprise alert categories.
- Unified Spotlight Dashboarding: Deploys a centralized analytical interface that summarizes block rates, challenge outcomes, geographic traffic anomalies, and rule matches in real time.
Data Ingestion Configuration
Integrating your AWS environment with Graylog requires an active Enterprise or Security license alongside the Illuminate processing framework. Follow this deployment sequence to establish data routing:
Step 1: Activate Web ACL Logging
Navigate to the target AWS Web ACL configuration panel. Enable logging and specify an Amazon Kinesis Data Firehose Delivery Stream as your target logging destination.
Step 2: Stream Records to Graylog
Configure the Kinesis Data Firehose stream to forward its records to the Graylog instance using the native AWS Kinesis/CloudWatch Input. Graylog’s input engine automatically tags traffic using the aws_kinesis_stream and aws_kinesis_message_type attributes, meaning you do not need to configure custom stream-matching rules.
Step 3: Verify the JSON Log Structures
AWS WAF delivers a single, detailed JSON object for every request it evaluates. The Graylog processing engine normalizes these variations automatically:
Example A: Rule Invalidation and Terminating BLOCK Decision
{
"timestamp": 1778140491525,
"formatVersion": 1,
"webaclId": "arn:aws:wafv2:us-east-1:517803882956:regional/webacl/prod-waf/3b8a9ef3-9057-4538-acdd-bda6c27c2131",
"terminatingRuleId": "AWS-AWSManagedRulesCommonRuleSet",
"terminatingRuleType": "MANAGED_RULE_GROUP",
"action": "BLOCK",
"httpSourceName": "ALB",
"httpRequest": {
"clientIp": "185.142.236.41",
"country": "SC",
"uri": "/.well-known/security.txt",
"httpMethod": "GET",
"scheme": "http",
"host": "34.238.104.93"
},
"labels": [
{ "name": "awswaf:managed:aws:core-rule-set:NoUserAgent_Header" }
]
}Example B: Standard Default Action ALLOW Decision
{
"timestamp": 1778154180000,
"formatVersion": 1,
"webaclId": "arn:aws:wafv2:us-east-1:517803882956:regional/webacl/prod-waf/3b8a9ef3-9057-4538-acdd-bda6c27c2131",
"terminatingRuleId": "Default_Action",
"terminatingRuleType": "REGULAR",
"action": "ALLOW",
"httpSourceName": "ALB",
"httpRequest": {
"clientIp": "192.0.2.10",
"country": "US",
"uri": "/",
"httpMethod": "GET",
"scheme": "https",
"host": "app.example.com"
},
"labels": []
}Step 4: Initialize the Processing Engine
Log into the Graylog console, navigate to Enterprise → Illuminate, locate the AWS WAF Processing Pack, and click Activate. The indexing architecture and parsing logic initialize instantly behind the scenes.
Graylog Information Model (GIM) Classification Schema
The content pack maps AWS WAF actions into standardized GIM fields, organizing traffic into network and detection categories to enable consistent threat hunting:
| Log Type | Vendor Action Description | GIM Category | GIM Subcategory | GIM Event Code |
|---|---|---|---|---|
| aws_waf | WAF BLOCK – Request stopped by a terminating rule match | detection | detection.network detection | 300001 |
| aws_waf | WAF CAPTCHA – Step-up interactive challenge served to client | detection | detection.network detection | 300001 |
| aws_waf | WAF CHALLENGE – Silent JavaScript validation challenge served | detection | detection.network detection | 300001 |
| aws_waf | WAF ALLOW – Request validated and passed to back-end origin | network | network.default | 129999 |
| aws_waf | WAF COUNT – Rule match logged exclusively as telemetry | network | network.default | 129999 |
Strategic Drivers for Engineering AWS WAF Visibility
Centralizing WAF infrastructure metrics within Graylog provides defensive teams with vital technical evidence across four key security domains:
1. Real-Time Attack Monitoring
- Exposes malicious web payloads—including SQL Injection (SQLi) and Cross-Site Scripting (XSS) patterns—intercepted by AWS Managed Rules before they reach your app servers.
- Tracks high-frequency
BLOCKtriggers linked to single client IP profiles to catch automated web scraping, directory brute-forcing, and vulnerability scanning. - Monitors
COUNTrules to evaluate the real-world impact of newly drafted custom rules before moving them to active blocking mode. - Identifies high rates of
CAPTCHAorCHALLENGEfailures to track botnets attempting to bypass application access controls.
2. Multi-Layered Threat Hunting
- Allows analysts to search across your entire application fleet for specific terminating rule IDs linked to active CVE exploits or known cyberespionage campaigns.
- Correlates source IP parameters across both
ALLOWandBLOCKevents to trace how attackers attempt to map out your application structures. - Flags unexpected geolocation anomalies sending high volumes of blocked traffic against production Web ACL endpoints.
3. Incident Response and Forensic Investigation
- Provides digital forensics teams with an immutable timeline of request histories to quickly reconstruct an attacker’s actions during an active incident.
- Pinpoints the exact rule or managed group that intercepted an exploit, and easily identifies any gaps where a rule missed a bypass attempt.
- Audits the
ALLOWtraffic surrounding aBLOCKaction to determine exactly which requests reached back-end origin repositories beforehand.
4. Compliance and Operational Auditing
- Maintains immutable, long-term logs of application-layer enforcement decisions to demonstrate compliance with strict access control mandates under PCI DSS, HIPAA, and SOC 2.
- Tracks Web ACL and rule group configuration adjustments, providing change management teams with verifiable compliance evidence.
About GREYCORTEX
GREYCORTEX uses advanced artificial intelligence, machine learning, and data mining methods to help organizations make their IT operations secure and reliable.
MENDEL, GREYCORTEX’s network traffic analysis solution, helps corporations, governments, and the critical infrastructure sector protect their futures by detecting cyber threats to sensitive data, networks, trade secrets, and reputations, which other network security products miss.
MENDEL is based on 10 years of extensive academic research and is designed using the same technology which was successful in four US-based NIST Challenges.
About Version 2 Limited
Version 2 Digital is one of the most dynamic IT companies in Asia. The company distributes a wide range of IT products across various areas including cyber security, cloud, data protection, end points, infrastructures, system monitoring, storage, networking, business productivity and communication products.
Through an extensive network of channels, point of sales, resellers, and partnership companies, Version 2 offers quality products and services which are highly acclaimed in the market. Its customers cover a wide spectrum which include Global 1000 enterprises, regional listed companies, different vertical industries, public utilities, Government, a vast number of successful SMEs, and consumers in various Asian cities.

