Azure Data Engineer Job at Scadea, Chicago, IL

SGJ1N20rKzJORStQbTl2a3NOaUxXeUdaWXc9PQ==
  • Scadea
  • Chicago, IL

Job Description

Client is looking for a strong Azure Data Engineer to join their project.
 
Job Title: Azure Data Engineer
Location: Chicago, IL - must do one day week onsite
Length: 6 months
 
This will require an onsite interview or require the candidate to pick up their laptop in person
 
Requirements/Top Skills Needed:
ADF
Databricks
Python
SQL
Retail experience would be helpful, but not required
 
Job Title: Azure Data Engineer
Job Summary: We are seeking a highly skilled Azure Data Engineer to design, build, and optimize our next-generation cloud data platform. You will build scalable data pipelines, manage enterprise data warehouses, and transform massive datasets using Azure Cloud, ADF, Databricks, Spark, and PySpark.

Key Responsibilities
· Pipeline Orchestration: Design and implement scalable ETL/ELT pipelines using Azure Data Factory (ADF).
· Big Data Processing: Build high-performance, distributed data transformation workloads via Azure Databricks and Apache Spark/PySpark.
· Data Warehousing: Architect, model, and maintain cloud-native Data Warehouses and Data Lakes (ADLS Gen2).
· Architecture Implementation: Apply modern architectural patterns like the Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake formats.
· Performance Tuning: Optimize Spark jobs, cluster configurations, and SQL queries to minimize latency and cloud compute costs.
· Governance & Security: Implement security frameworks, data lineage, and user access policies using Unity Catalog.
· CI/CD Automation: Deploy, monitor, and automate workflows using Azure DevOps and automated alert configurations.

Required Technical Skills:
· Cloud Platform: Microsoft Azure Ecosystem (ADLS Gen2, Azure SQL, Synapse Analytics, Key Vault, Storages, Azure Functions, Logic Apps).
· Data Orchestration: Advanced proficiency in Azure Data Factory (ADF).
· Compute & Analytics: Deep hands-on experience with Azure Databricks.
· Big Data Frameworks: Strong mastery of Apache Spark and PySpark (including Spark SQL).
· Languages: Expert level in Python and SQL.
· Data Warehousing: Solid understanding of Data Modeling (Star/Snowflake schema) and warehousing concepts

Job Tags

Contract work, 1 day per week

Similar Jobs

Tesla

Staff Construction Project Manager Job at Tesla

 ...What To Expect As a Staff Construction Manager, you will play a critical role in managing and executing construction projects from start to finish. You will work closely with your Project team, Design team, subcontractors, and other stakeholders to ensure successful... 

Watco

Railcar Unloader - Ferndale, WA Job at Watco

 ...and Discover the Difference Keep the world's supply chain moving. That's what the Watco team does every day at our short line railroads, switching sites, terminals, ports, and logistics hubs. Whether you're at one of these locations or in a support-services role,... 

Triple Play Farm

Join us... As a Therapist/Educator Job at Triple Play Farm

 ...Masters/Doctorate in Counseling, Psychology, Marriage and Family Therapy, MD in Psychiatry, etc.~Fully licensed to practice in North...  ...therapeutic modalities.~Passionate about the efficacy of animal assisted therapies.~Motivated to develop new programming.~... 

AFIMAC Canada

Investigator Job at AFIMAC Canada

 ...AFIMAC is seeking an experienced & licensed Private Investigator for part-time (with potential for full time) work in Ontario. Job Duties & Responsibilities: Conduct open-source intelligence inquiries on individuals and corporations for enhanced due diligence, litigation... 

Bandero Tequila

Social Media Manager Job at Bandero Tequila

 ...Social Media Manager Bandero Premium Tequila West Los Angeles, CA | Full-Time | On-Site Salary: $80k+ | Health, Dental & Vision Benefits...  ...For ~3+ years of professional social media management experience. ~ Experience managing social media for a consumer,...