Senior Data Engineer

EPAM is committed to providing our global team of 36,700+ EPAMers with inspiring careers from day one. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success and we value collaboration, try to always understand our customers’ business, and strive for the highest standards of excellence. In today’s new market conditions, we continue to support operations for hundreds of clients around the world remotely, with the vast majority of our teams working from home. No matter where you are located, you’ll join a dedicated, diverse community that will help you discover your fullest potential.


DESCRIPTION
We are looking for a Senior Data Engineer to help build and manage our Client’s big data streaming technologies. You will be deeply involved with optimizing our existing streaming services, evaluating new technologies, managing cloud infrastructure and more. Our ingestion pipelines peak at over 90GB per minute. If you are interested in working with data at massive scale, let’s have conversation!


RESPONSIBILITIES
Building and supporting highly available streaming services, written in Java/Scala using Apache Flink
Operating and developing applications on distributed NoSQL key-value stores such as HBase, DynamoDB or FoundationDB
Managing cloud infrastructure launched in AWS via Terraform
Participating in an on-call rotation for our client’s streaming tech stack
Evaluating new technologies and components of the big data ecosystem that are not yet part of our environment



REQUIREMENTS
Experience building high throughput Java/Scala streaming services using technologies such as Flink or Spark
Strong understanding of distributed message brokers such as Kafka and Kinesis
Experience with performance tuning of distributed computing technologies at massive scale
Experience working with AWS services such as Kinesis, EC2, EMR, RDS via infrastructure as code technologies
Experience working with high throughput, distributed NoSQL databases
Capable of independently performing root cause analysis on high throughput systems



WE OFFER
Competitive compensation depending on experience and skills
Opportunity to work on leading edge platforms, working in a fast-paced, agile, software engineering culture
Knowledge-sharing with colleagues from EPAM's global tech communities
Unlimited access to LinkedIn learning solutions
Regular performance feedback and salary reviews
Opportunities for professional growth