Senior Data Engineer - AWS/Dagster/Python
·
Datum Brain
How to Apply?
Send your resume and a cover letter to careers@datumbrain.com.
Any emails received without the exact subject “[Q3 2025] Senior Data Engineer - Datum Brain - Careers” will be discarded by the system automatically.
Work Location
This is an onsite position at our office location.
Responsibilities
- Design, build, and maintain scalable data pipelines using AWS services (S3, Lambda, Glue, EMR, Redshift, Athena, Kinesis)
- Implement and manage data orchestration workflows using Dagster
- Develop robust ETL/ELT processes to handle large-scale data processing
- Architect data solutions that ensure data quality, reliability, and performance
- Lead data infrastructure initiatives and mentor junior team members
- Collaborate with data scientists and analysts to understand data requirements
- Implement data governance and security best practices
- Optimize data pipeline performance and cost efficiency
- Create and maintain technical documentation for data systems
- Participate in architectural decisions and technology evaluations
- Mentoring junior engineers
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
- 5+ years of professional experience in data engineering
- Strong expertise in AWS data services ecosystem
- Proficiency in Dagster for workflow orchestration and pipeline management
- Advanced Python programming skills with experience in data processing libraries (Pandas, PySpark, etc.)
- Experience with SQL and NoSQL databases
- Strong understanding of data modeling, data warehousing, and data lake concepts
- Experience with Infrastructure as Code (Terraform, CloudFormation)
- Solid understanding of distributed computing and big data technologies
- Experience with CI/CD pipelines and DevOps practices
- Strong problem-solving and analytical skills
- Excellent communication skills and ability to work with cross-functional teams
Bonus Skills
- Experience with real-time data streaming and processing
- Knowledge of machine learning pipelines and MLOps
- Experience with data visualization tools (Tableau, PowerBI, Looker)
- AWS certifications (Solutions Architect, Data Analytics, or Database)
- Experience with Apache Spark, Airflow, or dbt
- Knowledge of data mesh or data fabric architectures
Benefits
- Competitive salary
- A friendly and collaborative work environment
- Clear career growth opportunities
- Fuel allowance provided in the form of cash (After the completion of the Probation Period)
- Friday lunch on the house
- Annual company trips
- Indoor and outdoor recreational activities to foster team bonding