Position: Sr. Azure Data Engineer
Experience: 8 To 10 Years
Location: Remote
Job Summary:
We are seeking a highly skilled and experienced Azure Data Engineer with over 8 years of expertise in designing, developing, and maintaining scalable data solutions on Microsoft Azure. The ideal candidate should have strong proficiency in SQL, Python (or similar language), and extensive hands-on experience with PySpark, ADF, Azure Databricks, and Data Lake.
Key Responsibilities:
- Design, develop, and maintain robust and scalable data pipelines using Azure Data Factory, Azure Databricks, and PySpark.
- Perform advanced data manipulation and scripting using Python or equivalent programming languages.
- Implement and maintain large-scale data solutions leveraging Azure Data Lake and Azure Synapse Analytics.
- Apply data warehousing concepts and methodologies to design and develop data warehouse systems.
- Collaborate with cross-functional teams to understand business requirements and translate them into data models and architecture.
- Ensure data quality, integrity, and governance by following best practices in data engineering.
- Optimize data workflows and manage performance tuning of big data applications.
- Create and manage ETL processes using tools such as Apache Spark.
Required Skills and Qualifications:
- 8 years of experience in data engineering, specifically within Azure ecosystem.
- Proficiency in SQL and scripting/programming in Python or similar languages.
- Strong experience with Azure Data Factory (ADF), PySpark, Azure Databricks, Data Lake, and Azure Synapse.