Azure Data Engineer

Inclusion Cloud
Dallas TX
10 days ago
Inclusion Cloud
Inclusion Cloud
inclusioncloud.com

Job Description

The consultants will work as Azure Data Engineer as stated below.

  • End to end development lifecycle, including the following environments Development, QA, Preproduction and Cutover activities
  • End to end data flow development including: SAP and Non-SAP Extraction, Ingestion, Data Landing, Data Vault, Data Mart and reporting layer backend.
  • End to end data flow development including: Extraction, Ingestion, Bronze, Silver, Gold, Data Mart and reporting layer backend for Lakehouse development.
  • Technical design and architecture
  • Code review, performance tuning and code optimization
  • Assist/Develop Data Models
  • Development, unit test and document results
  • Technical solutions and quality check
  • Data validation and verification
  • Support SIT, Regression and performance testing
  • Assist UAT testing
  • Provide technical documentation that can be used for KT session to the Support team

Required Qualifications:

  • Bachelor degree required
  • Strong experience working with Azure Platform & Azure BI Stack (Azure data factory / SQL / Azure Synapse /Azure SSAS /Azure DevOps /Azure Pipelines /Azure Data Lake). At least 3 years experience working with Azure Platform & Azure BI Stack
  • Deep understanding relational database systems, modern Datawarehouse platforms like Azure SQL Synapse.
  • Experience building and automating data system components that enable - Data acquisition, cleansing, and persistence data engineering.
  • Proficient in writing complex SQL queries.
  • Solid understanding of key Business Intelligence and Analytics trends.
  • Experience with Visualization tools like Power BI is a Plus.
  • Understanding of how to define and support a data governance framework.
  • Experience with implementing companywide Business Intelligence and Analytics programs.
  • Understanding of agile software development methodologies.

Personal characteristics:

  • Communications skills
  • High level of English to mainten conversation with leaders and team members.
  • Leadership and proactive actitud
  • Innovative and creative personality.
  • Smart thinker
  • Previous experiences working in corporate companies with different work groups and authorization levels

Essential Functions

  • Design and develop data warehouses and data pipelines within Azure
  • Design and develop Azure ML model execution pipelines
  • Evangelize engineering design and development standards
  • Act as a key contributor to the design and development lifecycle of analytic applications.
  • Participate in Agile ceremonies including daily stand-ups, sprint planning, retrospectives, and product demonstrations
  • Produce efficient and elegant code that meets business requirements
  • Author unit tests that adhere to code coverage guidelines
  • Proactively communicate progress, issues, and risks to stakeholders
  • Accurately estimate assignments
  • Create and maintain technical documentation
  • Mentor less experienced engineers
  • Contribute to the growth and maturity of the Software Engineering Group
  • Performs other related duties as directed

Required Skills & Competencies

  • 7 years of hands-on experience designing and implementing large-scale distributed data architecture for BI and OLTP systems
  • 7 years of hands-on experience designing and implementing large-scale data pipelines
  • 4 years of hands-on experience in Azure data services
  • 4 years of hands-on experience with data integration using ETL / ELT tools
  • Experience doing data migrations from SAP into Azure Datalakes using Theobald.
  • 4 years of hands-on experience with Python including object-oriented programming and unit testing
  • Advanced experience with one or more Python parallel processing libraries
  • Advanced experience with one or more Python data analysis libraries
  • Advanced data modeling experience
  • Broad experience in Microsoft SQL technologies
  • Broad multi-tenant data architecture and implementation experience across different data stores, messaging systems and data processing engines
  • Experience with data integration through APIs, Web Services, SOAP, and/or REST services
  • Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
  • Knowledge of SOA and Micros Services Application Architecture
  • Ability to work in a fast-paced, collaborative team environment
  • Excellent written and verbal communication skills and ability to express ideas clearly and concisely.
  • Previous experience in Supply Chain related projects.

Desired Attributes

  • Strong team player with ability to collaborate with all levels of the organization
  • Possess a drive towards forward progress and delivering results while taking responsibility
  • Multi-tasker with ability to set and manage priorities
  • Proactively and transparently communicate challenges and successes to product leadership
  • Exhibit attention to detail
  • Flexibility and willingness to help in other areas as priorities shift
  • Ability to effectively operate with minimal supervision, but knowing how to keep leadership in the loop

Education or Prior Work Experience

  • Bachelor's degree in CS or related field, master's degree preferred
  • 7+ years of experience with designing and developing complex data architecture solutions
  • 4+ years of design and development experience with Microsoft Azure data architecture and related solutions
  • 4 years of hands-on experience with Python

Visit Original Source:

http://www.indeed.com/viewjob
why ?Jumpstart your career with our tech sales bootcamp!
Free Guides, Videos and Podcasts
  • The Biggest Red Flags in Sales Interviews: A Complete Guide
    The Biggest Red Flags in Sales Interviews: A Complete Guide
  • Career Change Guide: Breaking Into a Career in Tech Sales
    Career Change Guide: Breaking Into a Career in Tech Sales
  • How to Find a Second Career in Tech Sales
    How to Find a Second Career in Tech Sales
  • SDR Interviews | How to Land the Interview and Stand Out in the Process
    SDR Interviews | How to Land the Interview and Stand Out in the Process
  • See More…

Other Jobs

Clio

Team Lead, Customer Success Management

Clio

Clio is more than just a tech company–we are a global leader that is transforming the legal experience for all by bettering the lives of legal professionals while increasing access to justice . Summa

 
Vancouver BC / Remote
Benevity

Meet Benevity Benevity is the way the world does good, providing companies (and their employees) with technology to take social action on the issues they care about. Through giving, volunteering, gra

 
Toronto ON
Clio

Clio is more than just a tech company–we are a global leader that is transforming the legal experience for all by bettering the lives of legal professionals while increasing access to justice . Summa

 
Toronto ON / Remote