Infrastructure + AIOps Engineer

About Us

We're a venture-backed startup building an innovative AI-driven platform called Proxi for policy professionals. Our product helps users navigate complex regulatory, legislative and emerging compliance environments through a voice-driven interface powered by our cutting-edge semantic search pipeline operating over our immense legislative and regulatory data corpus. Our team's experience spans roles across the White House, State Department, K&S Law, Microsoft and Datadog.

The Role

You'll join our founding engineering team to enhance our AI agent capabilities while scaling backend infrastructure and supporting frontend development. Working with our existing systems, you'll build intelligent service coordination, optimize distributed systems performance, and enhance our real-time voice interaction platform. This role combines deep infrastructure work with modern AI system integration.

Location: New York City

Key Responsibilities

AI System Architecture

• Design and implement intelligent routing systems for multi-service AI workflows (MCP)

• Build cost-aware service coordination that optimizes between local and external processing

• Develop API integration layers for external AI services and model coordination

• Create monitoring and failover systems for distributed AI service architectures

• Implement caching strategies to optimize expensive model inference calls

• Build async coordination systems for complex AI processing workflows

Infrastructure & Performance

• Scale distributed processing systems beyond single-instance architectures

• Design auto-scaling solutions based on workload patterns and system capacity

• Implement intelligent load balancing and priority scheduling for compute-intensive tasks

• Build database optimization strategies including connection management and query performance

• Create horizontal scaling solutions for search and storage systems

• Implement caching layers and CDN strategies for global performance optimization

• Design disaster recovery and high-availability system architectures

API & Frontend Support

• Build advanced voice interaction systems with real-time processing capabilities

• Implement audio processing and streaming architectures

• Create user and organization management systems with granular permissions

• Develop template and content management capabilities

• Build comprehensive input validation and security controls

• Implement rate limiting, quota management, and abuse prevention systems

Requirements

• Strong Python proficiency for backend development and distributed system design

• Cloud platform expertise (GCP preferred) with focus on serverless and auto-scaling architectures

• Distributed systems experience including performance optimization and reliability engineering

• Database expertise with PostgreSQL, including optimization, scaling, and replication strategies

• Real-time system design experience with streaming architectures and low-latency requirements

• API development using modern frameworks with emphasis on scalability and performance

• Containerization and deployment experience with Docker and CI/CD workflows

• Search and storage technologies including vector databases and performance tuning

• Problem-solving skills for complex system architecture and troubleshooting

Nice to Have

• Experience with AI service orchestration and multi-model coordination (MCP)

• Background in voice processing and real-time audio streaming technologies

• Knowledge of workflow orchestration and job scheduling systems

• MLOps experience supporting AI/ML systems in production

• Experience with caching strategies using Redis or similar technologies

• Infrastructure as Code and automated deployment experience

• Background in regulatory or compliance data processing

What Makes This Role Unique

Proxi is an AI-native platform that breaks away from the 'copilot' model where LLMs are merely added as features to existing technology. We act as an extension of the user and their interests, working 24/7 to perform work that would otherwise take hours.

We're not looking for passengers; we want driven innovators with a passion for building intelligent systems and scaling robust infrastructure. If you're obsessed with optimizing AI coordination, building fault-tolerant distributed systems, and creating seamless user experiences through advanced backend architecture, and you thrive in a fast-paced, high-stakes startup environment, this is your moment. We're building a category-defining product - don't just apply; make your mark.