Kafka and GenAI Infrastructure Engineer
- Kafka Engineering & Operations:
- Design, deploy, and manage scalable Apache Kafka / Confluent Kafka clusters.
- Handle Kafka topics, brokers, schema registry, connectors (Kafka Connect), and stream processing (Kafka Streams/KSQL).
- Implement monitoring, alerting, and log aggregation for Kafka ecosystem (using tools like Prometheus, Grafana, Splunk, etc.).
- Ensure high availability, fault tolerance, and disaster recovery of Kafka clusters.
- GenAI Infrastructure:
- Work with LLMs and vector databases to support GenAI use cases.
- Integrate Kafka with AI/ML pipelines for real-time inference and data streaming to/from GenAI models.
- Deploy and manage GenAI services (e.g., OpenAI, Hugging Face, Vertex AI, Amazon Bedrock) within secure, compliant infrastructure.
- Cloud & DevOps Enablement:
- Provision infrastructure using Terraform / CloudFormation / Pulumi.
- Manage deployments in AWS, Azure, or GCP using Kubernetes / ECS / Lambda.
- Build CI/CD pipelines (GitLab/GitHub Actions/Jenkins) for Kafka and AI/ML components.
- Security & Compliance:
- Ensure encryption, RBAC, and data protection policies across Kafka and GenAI workloads.
- Collaborate with InfoSec and Governance teams to ensure compliance with industry regulations.
- 5+ years of experience with Apache Kafka / Confluent Platform
- 3+ years of experience with cloud infrastructure (AWS, Azure, or GCP)
- Familiarity with GenAI / LLM integration (OpenAI, LangChain, vector stores)
- Strong understanding of stream processing and event-driven architecture
- Experience with Infrastructure as Code (IaC) and CI/CD pipelines
- Experience with containerization tools: Docker, Kubernetes
- Proficiency in scripting: Python, Bash, or Go
- Experience integrating Kafka with AI/ML platforms or MLOps tools
- Familiarity with DataBricks, Apache Flink, or Spark Structured Streaming
- Exposure to data governance and lineage tools (e.g., Apache Atlas, Collibra)
- Financial industry experience is a plus
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
Average salary estimate
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Experienced GCP Engineer needed to build and optimize scalable BigQuery data warehouses and ETL pipelines using Python, SQL, and GCP services.
AECOM is looking for a skilled Electrical Substation Engineer to join their Energy team, offering flexible work options and growth into project leadership roles.
Join Base in Austin as an Equipment Design Engineer to develop and refine cutting-edge automated tooling and manufacturing equipment for next-generation power solutions.
Samsung Austin Semiconductor invites new engineering graduates to join the CORP program, providing hands-on semiconductor manufacturing experience and career development onsite in Austin, TX.
Sev1Tech seeks a seasoned Network Communications Engineer to lead network design and operations for classified national security missions at our Boulder facility.
Contribute expertise in textile engineering to develop advanced protective combat clothing at Amentum in Natick, MA.
Lead AI-centric engineering teams at ServiceNow to deliver scalable production-ready GenAI software solutions embedded with strategic customers.
Lead design and development of primary and secondary structures for Blue Origin's New Glenn launch vehicle, driving innovation in human-capable spaceflight hardware.
Contribute your systems engineering expertise in a key cybersecurity role supporting DoD programs at Millennium Corporation in Hanscom, MA.
Lead Visa's Site Reliability Engineering efforts to enhance system reliability, automation, and scalability as a Senior Director in a hybrid work model.
An experienced Senior Network Engineer opportunity at Lawrence Livermore National Laboratory to design and manage advanced secure and high-performance computing networks.
Slip Robotics is looking for an experienced Staff Electrical Engineer to lead the electrical design and production readiness of autonomous mobile robots in their Atlanta team.
Lead the engineering design and validation of innovative locomotive air compressors with Wabtec Corporation, a forefront global transportation technology provider.
Contribute your expertise in rapid prototyping and additive manufacturing to advance next-generation intelligent robotic systems at a cutting-edge AI and Robotics company.
🔮
Hi, I'm Risa! Your AI Career Copilot
you, just ask me below!
