Cloud Data Engineer

Department: Information Technology

Location: Remote

Role Type: 6-Month Contract

About Our Client

This organization is a global technology solutions provider with decades of history delivering innovation and results. They serve customers across the defense, intelligence, civil, and health markets. Their teams design and implement advanced engineering, data, and IT solutions, supporting both government and commercial entities. They are recognized for helping organizations modernize operations with leading-edge AI/ML-driven data management and analytics, while staying committed to their mission of making the world safer, healthier, and more efficient.

Job Description

We are seeking a seeking a customer experience focused Cloud Data Engineer to work with a team of subject matter experts and developers to design and implement full lifecycle data pipeline services for Azure cloud based data lake, SQL, and NoSQL data stores. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. You will support continued maintenance of legacy SQL Server ETL operations and transition to modern cloud native solutions. Our ideal candidate is mission focused and delivery oriented, and applies critical thinking to create innovative functions and solve technical issues.

Duties and Responsibilities

• Maintain and operate legacy ETL processes utilizing Microsoft SSIS, PowerShell, SQL procedures, SSAS, .NET code, and other technologies.

• Implement full lifecycle Azure cloud native data pipeline development and operation.

• Work closely with client personnel and team members to understand data requirements and develop appropriate data solutions.

• Support the design and implementation of data models and data pipelines for relational, dimensional, data lakehouse (medallion architecture), data warehouse, data mart, SQL and NoSQL data stores.

• Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures to develop high performing data pipelines.

• Redevelop existing SSIS extract, transform, load scripts to Azure Data Factory and Synapse Pipelines.

• Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.

• Implement data migration, data integrity, data quality, metadata management, and data security functions to optimize data pipelines.

• Monitor and troubleshoot data related issues to maintain high availability and performance.

• Implement governance, build, deployment and monitoring to automate platform operation.

• Actively support Agile DevOps process, including Program Increment planning.

• Actively engage in continuous learning to increase relevant skills.

• Maintain strict versioning and configuration control to ensure integrity of data.

Required Experience/Skills

• BS degree in Computer Science or related field and 8+ years or Masters with 6+ years of experience

• 4+ years of experience developing and maintaining ETL processes using Microsoft SSIS, SQL, SQL Agent, and scripting languages including PowerShell.

• 4+ years of experience with more than one of the follow scripting languages: SQL, T-SQL, Python, PySpark

• Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes), scripting languages including PowerShell

• Experience designing and building ETL/data engineering solutions utilizing various cloud services such as Azure Data Lake Services, Azure Synapse Solutions

Education

BS degree in Computer Science or related field and 8+ years or Masters with 6+ years of experience

Pay & Benefits Summary

Pay rate up to 59/h W2

Catapult Solutions Group

New Jobs

Cloud Engineer