Experience: 5+ years
- Develop, orchestrate, and maintain complex Apache Airflow DAGs for ETL and data-processing pipelines. - Build and optimize Python-based ETL scripts , integrating with Flask APIs when needed. - Design and manage Elasticsearch indexing and performance tuning workflows. - Handle Unix/Linux scripting and operations for automation and monitoring. - Work with Oracle and PostgreSQL databases for large-scale data processing. - Implement and maintain GitLab CI/CD pipelines for build, test, and deploy stages. - Collaborate with the project team to ensure scalability, reliability, and quality of data solutions.
- ≥ 3 years of Apache Airflow DAG orchestration . - ≥ 5 years of Python (ETL focus) , with Flask API experience as a plus. - ≥ 3 years of Elasticsearch (data indexing & optimization) . - ≥ 3 years of Unix/Linux scripting & operations . - ≥ 3 years with Oracle or PostgreSQL (ideally both) . - ≥ 3 years of GitLab pipelines (build/test/deploy). - Advanced English and a technical degree .
- Experience with Great Expectations or similar data-quality tools. - Airflow on Kubernetes . - Proven performance tuning experience.
Search Data Engineer / Apache Airflow Specialist jobs near Remote, GA → Browse all live jobs
This posting was published by Intetics on their own careers system and is shown here with a direct link to apply there. Employers: for corrections or removal, contact jobs@veritahire.com.