Big Data Engineer, Mitchell Martin, Mc Lean, VA


Mitchell Martin -
N/A
Mc Lean, VA, US
N/A

Big Data Engineer

Job description

*****W2 ONLY, NO C2C*****


Job Title: Big Data Engineer

Client Location: McLean, VA

Type: Contract

Set-up: Hybrid (3 days a week in the office)


JOB DESCRIPTION


As a Software Engineer, your responsibilities will include developing and maintaining a data processing application capable of handling small to large volumes of enterprise data in terabytes. Key requirements for this role are:


  • Minimum of 4 years of experience in developing data-centric applications using Scala or Python running on EMR or AWS Glue.
  • Proficiency in data pipeline orchestration, utilizing self-created pipelines or AWS Step Functions, and managing pipelines using Python-based AWS Lambda.
  • Extensive experience (3+ years) in utilizing AWS cloud services.
  • Proficiency (4+ years) in CICD pipeline implementation.


This role will be primarily focused on the enterprise data space, with the application operating on AWS infrastructure including AWS Glue, AWS S3, AWS Lambda, and Fivegate/ECS.

Proficiency in programming languages such as Scala, Python, and Spark, along with SQL scripting, is essential. Strong automation skills are preferred, with experience in developing automation projects like Machine Learning applications being advantageous.


The team you'll be joining consists of product and tech experts, working on revamping an existing application to a much higher degree. Interaction with end-users will occur post-production, with responsibilities including triaging and troubleshooting.


This position sits within the Data & Machine Learning domain, emphasizing an automation mindset where coding skills translate across various tasks, particularly Python-based and batch applications.


BE PART OF OUR GROWING TEAM!


Full-time 2024-07-06
N/A
N/A
USD

Privacy Policy  Contact US
Copyright © 2023 Employ America All rights reserved.