Big Data Engineer - job 1 of 2

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to accomplish their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

Responsibilities

• Use your software engineering skills, including Java, Spark, Python, Scala, to Analyze different, complex systems and collaboratively design new products and services
• Integrate new data sources and tools
• Implement scalable and reliable distributed data replication strategies
• Mentor and provide direction in architecture and design to onsite/offshore developers
• Collaborate with other teams to design and deploy data tools that support both operations and product use cases
• Perform analysis of large data sets using components from the Hadoop ecosystem
• Manage product features from the development, testing through to production deployment
• Evaluate big data technologies and prototype solutions to improve our data processing architecture
• As a Big Data Engineer, you will be reporting to the Director, Software Development

• BS degree in computer science, computer engineering or equivalent
• 5–6 years of experience delivering enterprise software solutions
• Proficient in Spark, Scala, Python, AWS Cloud technologies
• 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala
• Flair for data, schema, data model, how to bring efficiency in big data related life cycle
• Technical requirements and can translate them into technical implementations
• Experience with Agile Development methodologies
• Experience with data ingestion and transformation
• Solid understanding of secure application development methodologies
• Experience with Airflow and Python
• Understanding of automated QA needs related to Big data
• Object-oriented design and experience approaching a problem from different angles, analyzing the pros and cons of different solutions skills
• Experience communicating updates and resolutions to customers and other partners

Benefits.

• 20 vacation days to start (along with 12 paid holidays)
• Great compensation package and comprehensive benefits package, with a bonus of 20%
• Flexible work schedule and relaxed dress code

Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why.

Our compensation reflects the cost of labor across several U.S. geographic markets. The base pay range for this position is listed above. Within this range, individual pay is determined by work location and additional factors such as job-related skills, experience, and education. This position is also eligible for a variable pay opportunity and a comprehensive benefits package.

Experian is proud to be an Equal Opportunity Employer for all groups protected under applicable federal, state and local law, including protected veterans and individuals with disabilities. Innovation is an important part of Experian's DNA and practices, and our inclusive workforce allows everyone to succeed and bring their whole self to work. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

#LI-Remote