Lead Data Engineer

Work with Us. Change the World.

At AECOM, we're delivering a better world. Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thrive. We are the world's trusted infrastructure consulting firm, partnering with clients to solve the world’s most complex challenges and build legacies for future generations.

There has never been a better time to be at AECOM. With accelerating infrastructure investment worldwide, our services are in great demand. We invite you to bring your bold ideas and big dreams and become part of a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and construction managers and other professionals delivering projects that create a positive and tangible impact around the world.

We're one global team driven by our common purpose to deliver a better world. Join us.

We’re hiring a hands-on Lead Data Engineer to help modernize an enterprise data platform from legacy, on-prem systems to a cloud-native AWS lakehouse. This is a lead individual contributor role with high ownership and a strong hands-on focus (approximately 70%), balancing deep technical delivery with design guidance, code reviews, and mentorship.

While we leverage AWS S3 Tables (managed Apache Iceberg), success in this role requires a solid understanding of how modern table formats operate under the hood, beyond reliance on fully managed tooling.

This position will offer flexibility for hybrid work schedules to include both in-office presence and telecommute/virtual work, to be based from either Houston or Dallas, TX.

Key Responsibilities:

• Design, build, and operate end-to-end, production-grade data pipelines in AWS
• Re-engineer legacy ETL into a lakehouse architecture (Bronze/Silver/Gold) on S3
• Work hands-on with open table formats in AWS (S3 Tables / Apache Iceberg) and understand their metadata, snapshots, schema evolution, and performance characteristics
• Develop pipelines using Python, PySpark, and Spark on AWS Glue and/or EMR
• Orchestrate workloads using Airflow or AWS Step Functions
• Partner with data architects to translate business requirements into data products
• Perform code reviews, mentor engineers, and contribute hands-on in production
• Support agile development practices, including planning, demos, and reviews

Minimum Requirements:

• BA/BS in Computer Science, Engineering, or a related field plus at least 8 years of hands-on data engineering experience, or demonstrated equivalent experience and education
• Strong, current hands-on experience with AWS data services, including S3 and Spark-based processing
• Hands-on experience with an open table format (such as Apache Iceberg, Delta Lake, or Hudi), with a clear understanding of table metadata, schema evolution, partitioning, and performance tradeoffs
• Proficiency in Python and PySpark for production data pipelines
• Experience designing, building, and operating data pipelines end-to-end in AWS
• Experience orchestrating data pipelines using Airflow or AWS Step Functions
• Strong communication skills and ability to operate as a hands-on technical lead

Preferred Qualifications:

• Master's degree in a relevant field
• Experience working with AWS S3 Tables or native Apache Iceberg in AWS environments
• Experience modernizing on-prem or legacy data warehouse platforms
• Familiarity with lakehouse performance tuning, schema evolution, and partitioning
• Experience with data pipeline orchestration frameworks
• Exposure to AI/ML data readiness or downstream analytics use cases
• Experience working in large, complex enterprise environments

• Relocation assistance is not available for this position
• Sponsorship for US work authorization is not available for this position, now or in the future.

Why You’ll Love Working Here:

• Leadership Impact: Shape the direction of our enterprise data platform and mentor the next generation of data engineers
• Enterprise Reach: Work with diverse, large-scale datasets from critical business systems.
• Modern Tech Stack: AWS-first environment with continuous improvement and best-practice adoption.
• Career Growth: Opportunities to advance into architecture or senior leadership roles.

Join us in shaping the future of data engineering and contribute to the development of innovative data solutions that drive business success.

About AECOM 

AECOM is proud to offer comprehensive benefits to meet the diverse needs of our employees. Depending on your employment status, AECOM benefits may include medical, dental, vision, life, AD&D, disability benefits, paid time off, leaves of absences, voluntary benefits, perks, flexible work options, well-being resources, employee assistance program, business travel insurance, service recognition awards, retirement savings plan, and employee stock purchase plan. 

AECOM is the global infrastructure leader, committed to delivering a better world. As a trusted professional services firm powered by deep technical abilities, we solve our clients’ complex challenges in water, environment, energy, transportation and buildings. Our teams partner with public- and private-sector clients to create innovative, sustainable and resilient solutions throughout the project lifecycle – from advisory, planning, design and engineering to program and construction management. AECOM is a Fortune 500 firm that had revenue of $16.1 billion in fiscal year 2024. Learn more at aecom.com. 

What makes AECOM a great place to work 

You will be part of a global team that champions your growth and career ambitions. Work on groundbreaking projects - both in your local community and on a global scale - that are transforming our industry and shaping the future. With cutting-edge technology and a network of experts, you’ll have the resources to make a real impact. Our award-winning training and development programs are designed to expand your technical expertise and leadership skills, helping you build the career you’ve always envisioned. Here, you’ll find a welcoming workplace built on respect, collaboration and community—where you have the freedom to grow in a world of opportunity. 

As an Equal Opportunity Employer, we believe in your potential and are here to help you achieve it. All your information will be kept confidential according to EEO guidelines.