Data Engineer

Come help us build the data pipelines driving the business behind one of the world's largest internet networks. Design, develop and deploy the systems that empower teams across the organization to be data-driven. Iterate alongside other engineers and business leaders to continue to deliver on the promise of being a data-driven company.

The Role

As a Data Engineer you will be responsible for our ETL/ELT data processing at scale.

Our ideal candidate

• Experience with ETL/ELT processing, pipeline management and debugging
• Strong understanding of data processing at scale: map-reduce, streaming
• Fluency in Python 3
• Fluency with SQL and relational databases concepts
• Experience with MapReduce using Java or Python
• 2+ years of big data development experience
• Familiarity with Airflow (or similar) and dbt
• An understanding of the concepts behind git and basic command-line proficiency
• Familiarity with AWS RDS, S3, Redshift, Glue, Athena and other AWS data-related services
• Experience working with cross-functional teams with diverse skill sets

You will

• Perform ETL/ELT processing with Python at scale
• Be in charge of ensuring correctness and performance of both ad-hoc and reporting pipelines processing dozens to hundreds of gigabytes daily
• Build pipelines that can ingest and correlate terabytes of historical analytics and instrumentation data
• Work alongside a cross-functional team including engineering, product, design, infrastructure and business intelligence 
• Influence and improve the design of instrumentation and analytics related components behind distributed applications
• Work alongside Data Science and Data Analysts teams to ensure the data pipelines are correct, performant and efficient for a given experiment
• Participate in code reviews, provide guidance and support to developers across the organization in all matters related to data

BitTorrent is an equal opportunity employer and values diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status or disability status.