4+ years of professional experience in Data EngineeringДосвід · Обов’язково
Good knowledge of PySpark, Python, and SQLНавичка · Обов’язково
Experience developing and maintaining ETL/ELT data pipelinesІнше · Обов’язково
Understanding of Delta Lake and Lakehouse architecture conceptsІнше · Обов’язково
Experience working with Databricks clusters and SQL WarehousesНавичка · Обов’язково
Basic or practical knowledge of Unity Catalog and data governance conceptsНавичка · Обов’язково
Understanding of CI/CD practices for data solutionsНавичка · Обов’язково
Upper-intermediate or higher level of EnglishМова · Обов’язково
Good communication and collaboration skillsІнше · Обов’язково
SoftServe is an equal opportunity employer.
Інше · Обов’язково
Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.Інше · Обов’язково
Hands-on experience with Databricks and AzureНавичка · Буде плюсом
Experience with Azure services such as ADF, Synapse, ADLS, Azure DevOps, Microsoft Fabric (nice to have)Навичка · Буде плюсом
Familiarity with Databricks AI/BI capabilities such as MLflow, Dashboards, Metric Views, or Genie (is a plus)Інше · Буде плюсом
In this role, you will develop and maintain reliable data solutions using Databricks and Azure. You will work with batch and streaming data pipelines, support data processing and optimization activities, and collaborate with the team to deliver production-ready data solutions.
Responsibilities
Develop and maintain batch and streaming ETL pipelines on the Databricks Lakehouse platform
Build and optimize data processing solutions using PySpark, Python, and SQL
Work with Databricks clusters, SQL Warehouses, and Delta Lake
Support bronze–silver–gold Lakehouse architectures
Apply data governance practices using Unity Catalog
Develop and deploy data solutions using CI/CD processes
Work with Databricks SQL and BI tools such as Power BI
Collaborate with team members and stakeholders to understand requirements and implement data solutions
Participate in troubleshooting, performance optimization, and continuous improvement activities
Requirements
4+ years of professional experience in Data Engineering
Hands-on experience with Databricks and Azure
Good knowledge of PySpark, Python, and SQL
Experience developing and maintaining ETL/ELT data pipelines
Understanding of Delta Lake and Lakehouse architecture concepts
Experience working with Databricks clusters and SQL Warehouses
Basic or practical knowledge of Unity Catalog and data governance concepts
Understanding of CI/CD practices for data solutions
Upper-intermediate or higher level of English
Good communication and collaboration skills
Experience with Azure services such as ADF, Synapse, ADLS, Azure DevOps, Microsoft Fabric (nice to have)
Familiarity with Databricks AI/BI capabilities such as MLflow, Dashboards, Metric Views, or Genie (is a plus)
SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.