Job Description
Key Skillsets:
- Azure Cloud: Azure Databricks, ADLS Gen2, Azure Data Factory, Azure Synapse
- ETL Tools: Visual Studio 2015 (SSIS), Informatica PowerCenter (10.1.1/9.1), DataStage
- Certification: Azure Data Engineer
Experience:
- Azure Cloud Expertise:
- Extensive experience with Azure Data Factory, Azure Databricks, Azure Data Lake Storage, and Azure Synapse Analytics.
- Proven ability to develop Data Factory pipelines that are parameterized, reusable, and incorporate control flow activities such as Get Metadata, Lookup, Copy, For Each, Databricks, Stored Procedure, If Web, etc.
- Data Engineering & ETL:
- Over 5 years of hands-on experience in ETL and data engineering within DWH, Data Lake, and BI reporting systems.
- Over 2 years of experience in building Lakehouse architectures using Azure Databricks and open-source Delta Lake.
- Skilled in creating pipelines for data ingestion, transformation, and custom requirements using Azure Data Factory and Azure Databricks.
- SQL and Performance Tuning:
- Experience optimizing SQL queries for Databricks, Azure SQL Database, and Azure Synapse Analytics.
- Development Expertise:
- Proficient in designing and developing generic Pipelines & Dataflow mappings in Azure Data Factory.
- Experienced in creating Python and SQL notebooks for data transformation and loading within Databricks.
Job Types: Full-time, Permanent
Pay: From $98,975.08 per year
Additional pay:
- Bonus pay
- Overtime pay
- Retention bonus
- Signing bonus
Benefits:
- Dental care
- Extended health care
- On-site gym
- On-site parking
- Paid time off
Schedule:
- 8 hour shift
- Holidays
- Monday to Friday
- Morning shift
Application deadline: 2024-12-20
Expected start date: 2025-01-01
Visit Original Source:
http://ca.indeed.com/viewjob