Job description
Our Company Creospan is a subsidiary of Creospan Inc., our parent company, headquartered in Chicago, IL. To find out more about us, visit our website: www.creospan.comJob Title: Azure Databricks Engineer Experience: 6–8 Years Location: Pune, India (Hybrid) Employment Type: Full Time Key Responsibilities • Design, develop, and maintain scalable data pipelines using Azure Databricks • Build and optimize batch and streaming ETL/ELT workflows using Apache Spark • Develop data processing solutions using PySpark, Spark SQL, and Delta Lake • Integrate data from multiple Azure sources such as Azure Data Lake Storage (ADLS Gen2), Azure SQL, and APIs • Optimize Spark jobs for performance, cost efficiency, and reliability on Azure • Implement data quality, validation, and reconciliation frameworks • Collaborate with data architects, analysts, and business stakeholders • Ensure adherence to data security, governance, and compliance standards • Support production deployments and troubleshoot pipeline failures Required Skills & Qualifications • 6–8 years of experience in Data Engineering • Strong hands-on experience with Azure Databricks (mandatory) • Deep expertise in Apache Spark, PySpark, and Spark SQL • Experience working with Azure Data Lake (ADLS Gen2) • Hands-on experience with Azure Data Factory (ADF) for orchestration • Strong SQL skills and experience with relational databases • Experience with CI/CD pipelines (Azure DevOps preferred) • Working knowledge of cloud security and access controls on Azure Show less [{"type":"people_also_viewed","href":"https://in.linkedin.com/jobs/view/data-engineer-at-getege-edtech-pvt-ltd-4371195587","jobId":"4371195587","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://in.linkedin.com/jobs/view/data-science-engineer-at-accelya-4360597324","jobId":"4360597324","label":"Data Science Engineer"},{"type":"people_also_viewed","href":"https://in.linkedin.com/jobs/view/data-engineer-at-crisil-4322166121","jobId":"4322166121","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://in.linkedin.com/jobs/view/data-engineer-b...
