Job Description
Job Role:
Azure Data Engineer
Experience:
8-12 Years
Work Location:
Kochi
Skills required:
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- 8+ years of experience in a Data Engineer role, with at least 3 years as an Azure data engineer.
- Expertise in Python, SQL, and deep understanding of PySpark.
- Proficient in Databricks or similar big data solutions.
- Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.
- Proven experience in designing and deploying high-performance data processing systems on.
- Extensive experience with Azure cloud data platforms, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks.
- Ability to design and implement data schemas, data models, and database designs in accordance with business requirements.
Qualification Required:
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Job Responsibilities:
- Design, construct, install, test, and maintain highly scalable and robust data management systems.
- Understand and apply data warehousing concepts to design and implement robust data warehouse tables in line with business requirements.
- Build complex ETL/ELT processes for large-scale data migration and transformation across platforms and Enterprise systems such as Oracle ERP, ERP Fusion, and Salesforce.
- Ability & expertise to extract data from several sources like APIs, JSons, Databases etc
- Leverage PySpark and Databricks within the Azure ecosystem to manipulate large datasets, improve the performance, and enhance the scalability of our data operations.
- Develop and implement Azure-based data architectures consistent across multiple projects while adhering to best practices and standards.
- Lead initiatives for data integrity and normalization within Azure data storage and processing environments.
- Evaluate and optimize Azure-based database systems for performance efficiency, reusability, reliability, and scalability.
- Troubleshoot complex data-related issues within Azure and provide expert guidance and support to the team.
- Ensure all data processes adhere to governance, data security, and privacy regulations.
