Title: Azure Data Engineer

Location: REMOTE or Hybrid

Duration: 6+ months

Compensation: 65-75/hr

Work Requirements: US Citizen, GC Holders or Authorized to Work in the US

Job Description:

Design and implement highly performant data ingestion & transformation pipelines from multiple sources using Azure Databricks and PySpark

SPARK Performance\tuning\optimization

Identify and optimize long running Databricks SPARK jobs.

Monitor resource utilization and costs associated with Databricks usage, identifying opportunities for optimization and cost reduction.

Analyze cluster performance metrics and implement tuning strategies to ensure optimal query execution times and resource utilization.

Develop scalable and re-usable frameworks for ingestion and transformation of large data sets.

Hand-On Experience in creating ADF Pipelines and Orchestrate various notebooks in Azure Data Factory

Work closely with data engineers to ensure that our Databricks platform is optimized for performance, scalability, and reliability.

Ensure the quality of deliverables by developing automated controls and performing unit, integration, and user acceptance testing.

Perform other duties as assigned.

Skills Needed:

Significant experience building Data Warehouses (Azure Synapse Analytics or similar), Data Lakes (Azure Data Lake or similar), ETL/ELT pipelines (Databricks or similar), and nice to have skills on data streaming (Azure Event Hub, Kafka, Cosmos, MongoDB, or similar)

Expert knowledge of SQL

Experience in data engineering programming languages. (Azure Databricks , PySpark, Python,)

Expertise on Azure Cloud platform

Our benefits package includes:

• Comprehensive medical benefits
• Competitive pay, 401(k)
• Retirement plan
• and much more!

About INSPYR Solutions:

As a leading information technology partner, we connect top IT talent with our clients to provide innovative business solutions through our IT Staffing, Professional Services, and Infrastructure Solutions divisions. We understand and value the unique needs of highly-skilled information technology professionals in the industry and always strive to stay above the curve. Our company was founded on the following core values: Be the Best, Understand the Urgency, Never Ever Give Up, Have the Courage to Excel, and Make a Contribution. We take pride in our business model and strive to create a positive workplace environment through an exemplary culture.

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.

#LI-MW4