Job description
We are recruiting for a Data Engineer to support a growing mission providing data related cloud resources. Our Data Engineer is responsible for the full data lifecycle from exploratory data analysis to the upkeep of production data flows. Data Engineers will work closely with data scientists and support the activities of the organization across multiple environments in order to exploit data of various types and security levels. Data engineers work directly with end customers to identify and refine requirements, develop data flows, and data models. Required Qualifications:
Programming Languages: Java, Scala or Python, Bash
Processing Tools: Elasticsearch, YARN, Spark, Nifi and/or Docker
Datastore Types: Graph, NoSQL and/or Relational
AWS Services: CloudFormation, EC2, S3 and/or RDS
Active TS/SCI clearance with polygraph required #qinetiqclearedjob Desired (not required) Qualifications:
Design Concepts: REST APIs
Programming Languages: Javascript/NodeJS
Processing Tools: Presto/Trino, MapReduce, Hive