Data Engineer

Key Responsibilities:
Development of data transformation and integration components of technology solutions
Design, direct and implement ETL/ELT processes, including data capture, data quality, testing and validation methods
Design and create the data warehouse (storage systems) and all related extraction, transformation and load of data functions
Test and troubleshoot the data systems and designs before go-live
Own and assist in data flow documentation, data dictionary, data flow, data mapping and other MDM and Data Governance documentation
Interpret what the business side wants to see accomplished, discuss details in an easy-to-understand way, and then translate it all into understandable technical components
Analysis and optimization of data structures - with the aim to ensure their quality, integrity and performance
Optimize solutions for performance and scalability



Required Skills:
In addition to Oracle, SQL, Postgres, BigQuery and Spanner databases experience, you have a deep understanding of data structures and experience building ETL streams for data integration
Experience in batch and stream data processing for on-premise and public cloud platforms like AWS, GCP.
Experience in Apache Beam, Kafka, Google Dataflow, EMR, Cloud Spanner, CI/CD, Micro services, Java, Python and Big Data ecosystem
Sound understanding of ETL data domains, like data modelling, data analytics, and information security and classification
Hands-on experience in the Agile/Scrum development process.
Knowledge of Big Data platforms (e.g. HADOOP/Cassandra/Mongo DB/SPARK) and classification of Big Data sets
Demonstrated experience with GCP Cloud DataFlow. Good knowledge of Cloud SQL and Cloud Datastore
Readiness to work in a global team with contributors from different backgrounds, skills and locations.
Bachelor’s degree in Software/Computer Engineering, Computer Science or related field, or comparable relevant experience.



Please submit your CV and cover letter in English to santosh.kumar1@quest-global.com
Öppen för alla
Vi fokuserar på din kompetens, inte dina övriga förutsättningar. Vi är öppna för att anpassa rollen eller arbetsplatsen efter dina behov.