Senior Data Engineer (Databricks and AWS)
EPAM is a leading global provider of digital platform engineering and development services.
We are committed to having a positive impact on our customers, our employees, and our communities.
We embrace a dynamic and inclusive culture.
We are looking for a remote Senior Data Engineer to join our project.
The candidate should have expert-level skills in AWS and Databricks, as well as extensive knowledge of Big Data technologies such as Spark, Python, Airflow, and Scala/Java.
The candidate should have excellent communication skills and be able to work independently as well as in a team of professionals.
Responsibilities
- Work closely with Business Analysts and data analysts to understand requirements
- Automate data ingestion processes and pre-processing
- Enhance data sets by creating automated match rules
- Develop ETL transformations for data from various data sources
- Report activities through agreed project tools and timely report about risks/issues/dependencies
Requirements
- Minimum of 3 years of experience in Data Software Engineering
- Extensive knowledge of AWS and Databricks
- Expert-level skills in Python, Airflow and Spark
- Experience working with unstructured files and creating automated match rules
- Strong problem-solving skills and the ability to work independently or in a team
- Good written and verbal communication skills in English (B2+)
Nice to have
We offer
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn
EPAM is an equal employment opportunity employer and welcomes applications from diverse candidates.
#J-18808-Ljbffr