IT JobsPythonSQL
Role brief
Job Description: Develop and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Spark SQL, and Python. Build data ingestion frameworks for structured and unstructured data sources. Design data transformation processes using Medallion Architecture (Bronze, Silver, Gold). Develop Delta Lake solutions with focus on data quality, reliability, and governance. Develop and maintain Databricks Notebooks, Jobs, and Workflows. Optimize Spark jobs and Databricks workloads for performance and c…