Data Engineer

• Expert in Python programming and Expert in batch data processing using Apache Airflow.
• Expert skills in working with distributed processing platforms (Apache Spark & Databricks).
• Excellent skills in SQL programming.
• Excellent skills in working with Azure Data Lake Gen 2.
• Proficient experience of building cloud-based solutions in Azure.
• Skilled in software engineering practices like design patterns, unit testing, source control, CI/CD, etc.
• Experience with stream processing & NoSQL Databases (preferably CosmosDB) is a bonus
• Experienced in Cloud Engineering and Cloud Services (GCP, Azure, AWS)
• Experience with Docker & Kubernetes is a bonus.
• Fluent in English in speech and writing is required.