Job Description

Must Have Technical/Functional Skills:

12+ years of solid hands-on experience in Python, AWS Data Services, DBT, Apache Airflow (on Astronomer platform), SQL and PySpark
Very Good hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement.
Experience in creating data pipelines and orchestrating using DBT & Apache Airflow
Significant experience with data migrations and development of Operational Data Stores, Enterprise Data Warehouses, Data Lake and Data Marts.
Experiencing in fixing performance issues / parallelism, Data model exposure is a must.
Good to have: Experience with cloud ETL and ELT in one of the tools like Glue/EMR or any other ELT tool
Experience in using Snowflake, DB2, Postgres and other database technologies is plus.
Excellent communication skills to liaise with Business & IT stakeholders.
Expertise in planning execution of a project and efforts estimation.
Exposure to working in Agile ways of working

Roles & Responsibilities:

Lead the design of reliable, secure, and highly available data lakes, data marts and data meshes
leads the design, development, and maintenance of data integration solutions using Python, AWS Data Services, DBT ensuring data pipeline & data quality
Collaborate with business stakeholders and architects to define the enterprise data strategy, data models, and migration Roadmap
Translate complex technical constraints into business insights and manage expectations across cross-functional teams
Develop, modify, configure & debug existing data pipeline as per the business requirement.
Troubleshoot and resolve technical issues. Debug, tune and optimize code for optimal performance
Manage the new requirements, Review the existing jobs, Perform gap analysis & Fixing performance issues, etc.
Guide, coach, and upskill junior and mid-level data engineers on best practices, coding standards, and modern data patterns
Document all data flow & mappings, sessions and workflows
Ticket handling and problem ticket analysis skills in Agile /POD approach'

Job Tags

Permanent employment, Full time

Similar Jobs

New York State Department of Agriculture and Markets

Associate Environmental Analyst, Agriculture & Water Conservation (Statewide) Job at New York State Department of Agriculture and Markets

A state department of agriculture is seeking an Associate Environmental Analyst to manage statewide soil and water conservation programs. This role includes gathering stakeholder input, preparing proposals, and monitoring program performance. Candidates should have experience...

PrestigeArch Luxembourg

Instrument Technician Job at PrestigeArch Luxembourg

...We are seeking a skilled and experienced Instrument Technician to join our team in Los Angeles.As an Instrument Technician you will be responsible for installing, maintaining and repairing various instruments and equipment used in the manufacturing process.Your duties...

FAR Inspections

Mobile Occupancy Assessment Scout Job at FAR Inspections

Ad Ref: FAR-00991 Earning Potential: While pay is per-inspection, efficient contractors typically earn the equivalent of $25$35 per hour. Do not fill out any form or use any other apply button on this page. Use the blue link below to submit your application. ...

CivicMinds, Inc

Marketing Manager Job at CivicMinds, Inc

...Key Responsibilities CRM & Lifecycle Marketing: Manage and optimize CRM systems (Salesforce required), including lead scoring... ...performance marketing. Industry Background: Experience in legal services preferred; candidates from professional services or...

GovernmentJobs.com — City of Indianapolis

911 Telecommunicator Job at GovernmentJobs.com — City of Indianapolis

...The purpose and mission of the Metropolitan Emergency Services Agency is to provide operation and management of the Division of Emergency Communications - 911 center... ...Services. The position could be dual trained at entry level or later for dispatching EMS, Fire and Police...

Lead AWS Data Engineer Job at SFE, Maryland

d3NaWGtYa1IycU5sQVVITVYxUktYa0YrNFE9PQ==