Job DescriptionAgileEngine is an Inc.
5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries.
We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
As a Senior Data Engineer, you’ll play a key role in shaping high-impact data solutions that power smarter decision-making and support a global mission to connect people with meaningful work.
You’ll collaborate with diverse teams to build secure, scalable pipelines and drive innovation in cloud-based data infrastructure.
This is a chance to grow technically, influence product evolution, and thrive in an open, collaborative culture that values learning and excellence.
WHAT YOU WILL DO
- Develop and maintain secure and efficient data pipelines using DBT, PySpark, and Python in an company-supported cloud environment, integrating all HR data sources to enable analytics and insights for HR COEs and HR leadership;
- Build the infrastructure and tooling required for optimal extraction, transformation, and loading (ETL) of data from various sources using Python, DBT, Terraform, and AWS technologies such as Glue, EMR , and S3;
- Identify, design, and implement internal process improvements, including automating manual workflows, debugging and optimizing data delivery, and re-architecting infrastructure for enhanced scalability;
- Apply the Data Quality Framework in the HRDM repository by developing unit tests, and creating both manual and automated test cases;
- Monitor data pipelines to ensure a minimum of 99.5% data availability;
- Create and maintain data models that are intuitive and easily consumable by business partners;
- Write and update project documentation (most data ingestion scripts are written in Python).
MUST HAVES
- 4+ years of professional experience as a Data Engineer;
- Proficiency in Python for object-oriented programming and data scripting;
- Hands-on experience with Snowflake;
- Strong experience with SQL;
- Experience using DBT for data transformations;
- Experience with Airflow;
- Familiarity with REST APIs for integration and data ingestion;
- Experience working with Google BigQuery;
- Proven track record of handling large-scale and sensitive data securely;
- Experience with real-time data processing (e.g., from Google Sheets or APIs);
- Strong documentation skills;
- Advanced English communication skills.
PERKS AND BENEFITS
- Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
- A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
- Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
Requirements4+ years of professional experience as a Data Engineer; Proficiency in Python for object-oriented programming and data scripting; Hands-on experience with Snowflake; Strong experience with SQL; Experience using DBT for data transformations; Experience with Airflow; Familiarity with REST APIs for integration and data ingestion; Experience working with Google BigQuery; Proven track record of handling large-scale and sensitive data securely; Experience with real-time data processing (e.g., from Google Sheets or APIs); Strong documentation skills; Advanced English communication skills.