Design, develop, and implement robust and scalable data solutions utilizing Azure technologies, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks, and/or Azure Synapse Analytics.
Proficiency in programming languages such as Spark (with either Python or Scala) and SQL.
Experience with various databases including SQL Server, Teradata, Snowflake, and Synapse.
Solid understanding of data engineering principles, data modeling, data warehousing, and ETL/ELT processes, encompassing data testing, validation, and reconciliation procedures.
Hands-on experience with data integration and transformation frameworks, tools, and methodologies.
Familiarity with version control systems like Git, GitHub, etc.
Collaborate with cross-functional and business teams to grasp business requirements and translate them into technical designs and solutions.
Develop and maintain data pipelines, integrations, and transformations to facilitate efficient data processing, storage, and retrieval.
Optimize data infrastructure and solutions for performance, scalability, and cost-efficiency, ensuring high availability and reliability.
Conduct data profiling, validation, and cleansing activities to maintain data integrity and accuracy.
Provide mentorship and technical guidance to junior data engineers, interns, and freshers, promoting knowledge sharing and skill development within the team.