About this opportunity
Opportunity Overview
Proxify is hiring a Senior Data Engineer to work on a high-growth client product. The company connects top developers worldwide with job opportunities. This role is for someone with experience in building complex data processing applications using Python. The ideal candidate will architect and scale the data foundations for the client product. Proxify has worked with over 1200 clients and has a network of 5000 talented developers. The company values a growth-oriented mindset and a passion for working on new ideas. The Senior Data Engineer will be part of a global network of supportive developers. The role involves building and maintaining scalable ELT/ETL pipelines, implementing automated testing and monitoring, and optimizing warehouse storage and compute costs. The Senior Data Engineer will also partner with Data Scientists and Product Managers to translate business requirements into technical data models.
Responsibilities
- Build and maintain scalable, automated ELT/ETL pipelines that provide a 'single source of truth' for the organization
- Implement rigorous automated testing and monitoring to ensure data integrity and reliability
- Optimize warehouse storage and compute costs while reducing pipeline latency
- Partner with Data Scientists and Product Managers to translate business requirements into technical data models
- Promote a 'DataOps' culture within the team, conducting code reviews and sharing best practices
- Build real-time pipelines using Kafka or Flink
- Work with dbt for managing the T in ELT, including documentation and testing
- Use Apache Airflow, Prefect, or Dagster for managing complex dependency graphs
- Work with Snowflake, BigQuery, or AWS Redshift
- Apply Dimensional Modeling and Data Vault 2.0 principles
- Use Git, Docker, and implement CI/CD for data pipelines
- Work with Data Contracts and Data Quality frameworks like Great Expectations and Monte Carlo
- Apply knowledge of Vector Databases for AI/LLM applications
- Use Infrastructure as Code with Terraform
Benefits
- On-time monthly payments with flexible withdrawal options
- Predictable project hours with consistent 8-hour working days
- Up to 24 flex days off per year without losing pay
- Career-accelerating positions at cutting-edge companies
- Hand-picked opportunities with personally matched positions
- One seamless process for multiple opportunities
- Same pay every month with positions landed through Proxify
Requirements & Qualifications
- 5+ years of experience building complex data processing applications using Python
- Advanced SQL skills for complex transformations, window functions, and query optimization in cloud warehouses
- Experience with dbt for managing the T in ELT
- Proven experience with Apache Airflow, Prefect, or Dagster
- Hands-on experience with Snowflake, BigQuery, or AWS Redshift
- Strong understanding of Dimensional Modeling and Data Vault 2.0
- Experience with Git, Docker, and implementing CI/CD for data pipelines
- Experience building real-time pipelines using Kafka or Flink
- Familiarity with Data Contracts and Data Quality frameworks
- Knowledge of Vector Databases for AI/LLM applications
- Experience with Infrastructure as Code using Terraform
How to Apply
- Review the job description and requirements to ensure you are a good fit for the role.
- Prepare your application materials, including your resume and any relevant work samples.
- Click the Apply button below to submit your application.
Ready to apply?