Experienced Python Engineer

Beograd, Serbia (Hybrid)

We are seeking a highly skilled Python Developer to join our Workflow Automation team. The ideal candidate will focus on enhancing and expanding our Airflow capabilities, enabling seamless orchestration of various workflows across the organization. This role requires a strong foundation in Python, along with the ability to develop and maintain custom Airflow operators and automation scripts that streamline the development process for our data engineers and other teams. 

  

Key Responsibilities: 

  

Airflow Development: 

  • Develop custom Airflow operators (in Python) to integrate with various platforms, such as Databricks and DBT Cloud 
  • Expand the types of tasks that can be orchestrated within Airflow, beyond the existing set of three or four task types. 
  • Ensure that Airflow becomes the central workflow orchestrator for the entire company, providing a unified interface for executives and team members to monitor all pipelines. 

Workflow Automation: 

  • Create automation scripts and tools to help data engineers easily define DAGs (Directed Acyclic Graphs) and manage dependencies, schedules, and other configurations within Airflow. 
  • Develop solutions to detect common errors and optimization opportunities in existing code, with a focus on improving efficiency and reducing duplicated code. 

Developer Experience and Tooling: 

  • Enhance the developer experience by simplifying the process of writing and managing Airflow DAGs, potentially through no-code or low-code solutions that generate DAGs based on user input. 
  • Contribute to the creation of documentation and best practices to reduce the learning curve for engineers using Airflow. 

Collaboration and Training: 

  • Work closely with data engineers and other developers to understand their needs and provide support in using Airflow effectively. 
  • Train and mentor other team members on Airflow best practices and advanced Python techniques as needed. 

Qualifications

Technical Skills: 

  • Strong proficiency in Python, with experience in developing backend applications or automation tools. 
  • Familiarity with Airflow or similar workflow orchestration tools (e.g., Luigi, Prefect) is preferred but not required; willingness to learn Airflow is essential. 
  • Experience with API integration and writing wrapper functions to interface with external services. 
  • Understanding of ETL processes, data pipelines, and the challenges involved in workflow automation. 

  

Additional Skills: 

  • Experience with cloud platforms (e.g., AWS, GCP) and their services. 
  • Strong problem-solving skills and the ability to work independently on complex tasks. 
  • Excellent communication skills, with the ability to document and explain technical concepts to a non-technical audience. 

  

Preferred Experience: 

  • Experience working in a DevOps or Data Engineering environment is a plus. 
  • Familiarity with other tools and technologies related to data engineering and workflow orchestration. 

Experienced Python Engineer

Job description

Experienced Python Engineer

Personal information