Sr Data Engineer

Sr Data Engineer

Arbetsbeskrivning

Requirement gathering and analysis of business and technical requirements, preparation of requirement specification document.
Creating and adjusting Information Model according to new source system or requirements.
Preparation of detailed design documents and technical specifications.
Design and develop data pipeline using AWS Cloud Services and Snowflake Cloud Database.
Deployment and maintain of Apache Airflow on AWS/EKS.
Access and Security of AWS resources.
Managing security and roles in Snowflake for users and data.
Designing of enhanced data mappings using various simple and complex transformations.
Source system analysis.
Designing ETL jobs for optimal performance, reusability and restart ability.
Design and Development of ETL process based on requirement.
Build, testing and deployment of ETL process.
Performance tuning of ETL queries and managing dependencies.
Creating and Managing data/ETL flows in Apache Airflow and NIFI.
Writing ETL test cases based on business scenarios.
Creation of Delivery documents.
Creation of System Test cases, Regression Testing activities, creation of UAT test case scenarios, root cause analysis and fixing of defects
Conducting UAT with business stakeholders and get it approved.

Öppen för alla
Vi fokuserar på din kompetens, inte dina övriga förutsättningar. Vi är öppna för att anpassa rollen eller arbetsplatsen efter dina behov.

Sammanfattning

Postadress

KUNGSBRON 1 G2
STOCKHOLM, 10724

Liknande jobb


Computer Vision and Perception Engineer

Computer Vision and Perception Engineer

26 november 2024

Simulation Engineer

19 september 2024

Data Analyst

25 november 2024