Please scroll down, To apply

Azure Data Engineer w/ Python/C#

hiring now
New job

Expert In Recruitment Solutions

2024-11-08 20:48:08

Job location Tampa, Florida, United States

Job type: fulltime

Job industry: I.T. & Communications

Job description



Title: Azure Data Engineer w/ Python/C#

Location: 100% Remote

Duration: long term

Interview Mode: Video

Need 12-13+ years candidate

" PySpark or Scala

" Spark SQL

" Delta lakes

Python/C#

PRIMARY DUTIES AND ACCOUNTABILITIES

Item Accountability %

1 Create and maintain optimal data pipeline architecture 20

2 Assemble large, complex data sets that meet functional / non-functional business requirements. 20

3 Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. 20

4 Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Big Data technologies. 20

5 Deliver automation & lean processes to ensure high quality throughput & performance of the entire data & analytics platform.? 10

6 Work with data and analytics experts to strive for greater functionality in our analytics platforms. 10

POSITION SPECIFICATIONS

Minimum: Preferred:

" Experience in building/operating/maintaining fault tolerant and scalable data processing integrations using Azure

" Strong problem-solving skills with emphasis on optimization data pipelines

" Excellent written and verbal communication skills for coordinating across teams

" A drive to learn and master new technologies and techniques

" Experienced in DevOps and Agile

" Experience using Docker or Kubernetes is a plus

" Demonstrated capabilities with cloud infrastructures and multi-cloud environments such as Azure, AWS, IBM cloud environments and using CI/CD pipelines.

" Experience with Delta Lakes

" Experienced using Databricks & Apache Spark

" Experienced using Azure Data Factory or Synapse Analytics

Inform a friend!

<!– job description page –>
Top