Backend Engineer
Lead Data Software Engineer with Databricks with Apache Kafka, Apache Spark, Kubernetes
Remotelead
Apply on the employer's siteRole description
We are looking for a
Lead Data Software Engineer
to drive the migration of an existing data analytics platform, originally built on Azure resources such as Data Factory, Databricks, Event Hub, and Cassandra, to a cloud-agnostic platform deployable on-premises.
This is a fully remote position that offers you the flexibility to work from any location in Armenia, whether it's your home or well-equipped offices in Yerevan or Gyumri.
Responsibilities
- Implement streaming and batch Spark pipelines running on Kubernetes
- Lead the implementation of objects within the data generator framework
- Oversee deployment and testing across local and development environments
- Drive improvement of the current, actively changing solution
- Conduct bug investigation and resolution
- Perform unit testing to ensure solution quality
- Participate in refinement, planning, and demo sessions
- Guide and mentor team members throughout the implementation phase
Requirements
- 5+ years of experience with Apache Spark, Confluent/Apache Kafka, and Kubernetes
- Proficiency in Python
- Familiarity with the data engineering domain and cloud-agnostic platform migrations
- Capability to dive deeper into new technologies in a short time during active implementation phases
- Ability to work independently with syncs with a team lead
- Strong communication skills and proactiveness
- Showcase of being a hands-on team player and technical leader
- Proficiency in English at a B2+ level
Nice to have
- Knowledge of Java
- Familiarity with Kafka Connect, KSQL, and Kafka Streams
- Skills in Ansible and Argo CD
- Understanding of TDD
We offer
- We connect like-minded people
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 55+ countries
- Corporate and social events
- We invest in your growth
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to EPAM's internal learning database
- Free English classes with certified teachers
- We cover it all
- Participation in the Employee Stock Purchase Plan
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Four trust days per year for personal needs
- Discounts for fitness clubs
- Benefits package (hotels, restaurants, stores and services)
EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.
This is a saved copy of a posting published elsewhere. Postings get taken down without notice — check the employer's site before applying. mentors.coach is not the hiring party.