Software Engineer, Machine Learning II

About Poshmark

Poshmark is a leading fashion resale marketplace powered by a vibrant, highly engaged community of buyers and sellers and real-time social experiences. Designed to make online selling fun, more social and easier than ever, Poshmark empowers its sellers to turn their closet into a thriving business and share their style with the world. Since its founding in 2011, Poshmark has grown its community to over 130 million users and generated over $10 billion in GMV, helping sellers realize billions in earnings, delighting buyers with deals and one-of-a-kind items, and building a more sustainable future for fashion. For more information, please visit www.poshmark.com, and for company news, visit newsroom.poshmark.com.

About Poshmark

Poshmark is a leading fashion resale marketplace powered by a vibrant, highly engaged community of buyers and sellers and real-time social experiences. Designed to make online selling fun, more social and easier than ever, Poshmark empowers its sellers to turn their closet into a thriving business and share their style with the world. Since its founding in 2011, Poshmark has grown its community to over 130 million users and generated over $10 billion in GMV, helping sellers realize billions in earnings, delighting buyers with deals and one-of-a-kind items, and building a more sustainable future for fashion. For more information, please visit www.poshmark.com, and for company news, visit newsroom.poshmark.com.

Big Data team is a central player in the Poshmark organization. Our mission is to build a world-class big data platform to bring value out of data for us and for our customers. Our goal is to democratize data, support exploding business, build data and ML pipelines to fuel existing and new business critical initiatives.

The Data Engineering team at Poshmark is looking for an experienced software engineer to take care of Poshmak’s growth data, ensuring real-time access to quality data for all the stakeholders. The role requires strong understanding of software engineering best practices and excellent software development skills to build and maintain real-time and batch data pipelines with a focus on scalability and optimizations. In addition, the role also requires collaborating with Data Science, Analytics and other Engineering teams to build newer ETLs analyzing terabytes of data.

The role also requires being able to write clean and scalable code to pull datasets from disparate sources involving External APIs, S3 transfers, Kafka, Demux and so on. You will work with cutting edge technologies and frameworks like Scala, Ruby, Apache Spark, Airflow, Redshift, Databricks, Docker etc. You will also manage the growth data infrastructure comprising ETL pipelines, Hive tables, Redshift tables, BI tools. We are looking for a software engineer who can help us define the next phase of growth data systems in terms of scalability and stability.

Responsibilities

• Design, Develop & Maintain growth data pipelines and integrate paid media sources like Facebook and Google to drive insights for business.

• Build highly scalable, available, fault-tolerant data processing systems using AWS technologies, Kafka, Spark, and other big data technologies. These systems should handle batch and real-time data processing over 100s of terabytes of data ingested every day and a petabyte-sized data warehouse.

• Responsible for architecting/designing/developing critical data pipelines at Poshmark.

• Maintain and support existing platforms and evolve to newer technology stacks and architectures.

• Participate and contribute to constantly improving best practices in development.

Desired Skills

• 1+ years of overall software development experience.

• Strong software development experience with Big Data technologies and hands-on coding experience.

• Expertise in architecting and building large-scale data processing systems using Big Data technologies like Spark, Hadoop, EMR, Kafka/ Kinesis, Flink, Druid.

• Able to deliver complex projects end-to-end.

• Expertise in SQL with knowledge on any existing data warehouse technology like Redshift.

• Be self-driven, take complete ownership of initiatives, make pragmatic technical decisions and collaborate with cross-functional teams.

• Excellent communication skills and ability to work cross functionally.

• Expertise in Google Apps Script, Databricks or API Integrations is a plus.

Technologies we use

• Ruby, Scala, Python, Google Apps Script

• MongoDB, Redshift, Druid

• Airflow, Jenkins

• Spark, Hadoop