Responsibilities
- Develop and deploy batch data pipelines processing billions of data signals.
- Support real-time NLP applications.
- Design data flows and develop utilities that allow the team member to work more efficiently.
- Manage data pipelines from and to all of our data sources, such as Vertica and AWS S3.
- Develop CI/CD pipelines.
- Work closely with DS, DA, DevOps, ETL engineers, and product managers.
- Build production-grade LLM and RAG systems for data-driven classification and prediction
Basic qualifications
- 4 years as a data engineer or ML engineer – A must.
- B.Sc. in engineering, computer science, or other quantitative fields – A must.
- Practical experience with Python and SQL – A must.
- Understanding ML and DL concepts.
- Practical experience with container-based development (e.g., Docker); Kubernetes experience is a plus.
- Experience in the design and development of scalable big data solutions.
- Experience with AWS platform – S3, SQS, etc.
- Experience with PySpark – A Must
- Passion for data and DS workflows, independence and being a team player.
Benefits
- Polish public holidays.
- 20 working days per year is Non-Operational Allowance and settled to be used for personal recreation matters and are compensated in full. These days have to be used within the year, with no rollover to the next calendar year.
- Health Insurance.
- Gym Subscription (Multisport).
Tags & focus areas
Used for matching and alerts on DevFound Fulltime Machine Learning Data Science Nlp Ai