Senior Data Engineer

AgileEngine (Usaquen DC, Colombia) Seguir Publicado hace 27 días

Remote Friendly DevOps & Sysadmin Americas Full-time GitLab Big Data Technologies Writing Interpreting Data Engineering

Solicitar ahora

AgileEngine is a top-ranking provider of software solutions to Fortune 500, Global 500, and Future 50 companies. Listed on Inc. 5000 among the fastest-growing US companies, we are always open to talented software, UX, and data experts in the Americas, Europe, and Asia.

If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment daily, there’s no better place — guaranteed! :)

What you will do

Designing and implementing efficient data pipelines (ETLs) to integrate data from various sources into Indeed’s data platforms;
Designing and implementing data model changes that align with data standards;
Work with existing APIs written in Flask (python);
Monitoring production data pipelines daily to ensure completion, maintain data quality, and address performance issues;
Reading and interpreting system logs to evaluate system health or perform root cause analysis;
Identifying pipeline issues and working with colleagues, vendors, and external teams to resolve;
Clearly communicating pipeline statuses with management and stakeholders.

Must haves

Ideally a bachelor’s degree in computer science, computer engineering, or an engineering discipline;
5+ years of industry experience in software development and/or data engineering with strong expertise in fast-paced and deliver-focused environments;
Extensive production experience in SQL;
Extensive experience building an ETL from scratch;
3+ years of experience with:
Python/Flask;
3+ years of hands-on experience with big data technologies (such as Redshift, Hive, Trino/Presto, or similar technologies);
Experience with modeling data;
Experience in Athena;
Experience with MySQL;
Experience in Gitlab CI;
Experience in AWS cloud platform (SQS, S3 services);
Extensive experience in writing technical documentation;
Upper-intermediate English level.

Nice to haves

Experience in Spark;
Experience in Tableau or Google Data Studio;
ETL work will be in Dagster but may not be a primary focus of the individual.

The benefits of joining us

Professional growth

Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.

Competitive compensation

We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.

A selection of exciting projects

Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.

Flextime

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.