Data Engineer

CLOUDSUFI INC
Carlsbad, CA / Remote
30+ days ago

Job Description

5 to 7 years working experience in data integration and pipeline development with data warehousing .
Experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems
Strong real-life experience in python development especially in pySpark in AWS Cloud environment.
Design, develop test, deploy, maintain and improve data integration pipeline.
Experience in Python and common python libraries.
Strong experience with Perl and Unix Scripts.
Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools.
Experience with continuous deployment(CI/CD)
Databricks, Airflow and Apache Spark Experience is a plus.
Experience with databases (Oracle, SQL Server, PostgreSQL, Redshift, MySQL, or similar)
Strong experience with performance tuning, analytical understanding with business and program.
Exposure to ETL tools including Informatica and any other .
BS/MS degree in CS, CE or EE.

Job Type: Full-time

Salary: Up to $150,000.00 per year

Benefits:

  • Dental insurance
  • Health insurance
  • Paid time off
  • Vision insurance

Schedule:

  • 8 hour shift

Experience:

  • SQL: 1 year (Preferred)
  • Informatica: 1 year (Preferred)
  • Data warehouse: 1 year (Preferred)

Work Remotely:

  • Temporarily due to COVID-19

Source

https://www.indeed.com/jobs

Not sure if you qualify?

Uvaro is here to help you land great jobs like this one.

Upgrade your skills

Other Jobs

Rise People

Rise is Canada’s complete people management solution that gives employers everything they need to build loyal and productive teams—all in one place. We collaborate and co-create to build solutions that completely change how companies of all shapes and sizes manage their payroll, scheduling, time tracking, group benefits, recruitment, onboarding, and more.

 
Vancouver, BC
Uvaro

1+ years of successful sales development experienced experience in B2B software or B2C services is a plus. Ability to work occasional evenings or weekends.

 
Waterloo, ON / Remote
State of Alabama Personnel Department

ABC SALES MANAGER I

State of Alabama Personnel Department

Two years of experience in retail sales. Western Association of Schools and Colleges –Senior College and University Commission (WASC-SCUC).

5 hours ago
Montgomery, AL