I design and deliver Kafka-based event streaming systems for commercial clients operating at scale. 10+ years across Fortune 500 and high-growth engineering organizations. My work centers on event streaming architecture engineered for throughput, cost efficiency, and production durability.
Core Capabilities
- Kafka Architecture: Design and scale event streaming for high-throughput, multi-cluster environments.
- Streaming Performance & Scaling: Rebalance-free consumer scaling, capacity planning, and cost control under peak load.
- Production Delivery: Transition prototypes to production systems with monitoring and deterministic rollout.
Selected Engagements
High-Throughput Scalable Kafka
- Environment: Commercial multi-cluster, multi-client deployments.
- Constraint: 120k msg/sec peak load and rebalance-free horizontal scaling.
- Scope: A custom scaling control plane implementing rebalance-avoidance scaling across independent consumer groups, and corresponding Node.js services.
- Outcome: Achieved a ~50% infrastructure cost reduction and eliminated scaling-induced latency spikes.
Production Resilience for On-Sale Burst Traffic
- Environment: High-concurrency commercial ticketing system.
- Constraint: Massive concurrency bursts during on-sale events and multi-year migration backfills.
- Scope: Re-architected streaming and storage layers for mission-critical ticketing services.
- Outcome: Sustained 42M msg/min at peak; reduced infrastructure cost by 40%.
Additional Engagements
- Large-Scale Enterprise Kafka Deployments: High-availability Kafka clusters for financial services, healthcare, and telecom clients, with enterprise identity integration (mTLS, LDAP, Kerberos) and disaster recovery.
- CDC Event Streaming Across Disjoint Environments: Greenfield Kafka-based CDC streaming solution delivered from POC to production, propagating data across disjoint on-premise and cloud environments.
- Custom Kafka Connect Integration for Syslog Data: Brought new Kafka infrastructure online and integrated existing syslog pipelines through custom Kafka Connect connectors.
Availability
Currently accepting consulting engagements. Reach out via Contact.
Engagement Model
Architecture Assessment
Short-term evaluation of Kafka and event streaming systems under scale constraints.
Principal Engineer Embed
Hands-on delivery leadership for event streaming systems.
POC Acceleration
Rapid validation systems designed for production evolution without rewrite.