Sr Data Engineer, Ageatia Global Solutions, Reston, VA
Ageatia Global Solutions -
Reston, VA,
US
Sr Data Engineer
Date Posted: 2024-05-08
Job description
PURPOSE:
The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on developing solutions and helping transform the company's platforms deliver data-driven, meaningful insights and value to company.
ESSENTIAL FUNCTIONS:
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable
ccommodations may be made to enable individuals with disabilities to perform the essential functions.
Education Level: Bachelor's Degree
Education Details: Computer Science, Information Technology or Engineering or related field
Experience: 5 years Experience with database design and developing modeling tools. Experience developing and updating ETL/ELT scripts using Ab Initio. Expert knowledge to handle large volume of data through Ab Initio graphs/plans. Hands-on experience with application development, relational database layout, development, data modeling.
In lieu of a Bachelor's degree, an additional 4 years of relevant work experience is required in addition to the required work experience.
Preferred Qualifications
The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on developing solutions and helping transform the company's platforms deliver data-driven, meaningful insights and value to company.
ESSENTIAL FUNCTIONS:
- 20% Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using multiple technologies.
- 15% Interprets data, analyzes results using statistical techniques, and provides ongoing reports. Executes quantitative analyses that translate data into actionable insights. Provides analytical and data-driven decision-making support for key projects. Designs, manages, and conducts quality control procedures for data sets using data from multiple systems.
- 15% Develops data models by studying existing data warehouse architecture; evaluating alternative logical data models including planning and execution tables; applying metadata and modeling standards, guidelines, conventions, and procedures; planning data classes and sub-classes, indexes, directories, repositories, messages, sharing, replication, back-up, retention, and recovery.
- 15% Creates data collection frameworks for structured and unstructured data.
- 15% Improves data delivery engineering job knowledge by attending educational workshops; reviewing professional publications; establishing personal networks; benchmarking state-of-the-art practices; participating in professional societies.
- 10% Applies data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources.
- 10% Applies and implements best practices for data auditing, scalability, reliability and application performance.
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable
ccommodations may be made to enable individuals with disabilities to perform the essential functions.
Education Level: Bachelor's Degree
Education Details: Computer Science, Information Technology or Engineering or related field
Experience: 5 years Experience with database design and developing modeling tools. Experience developing and updating ETL/ELT scripts using Ab Initio. Expert knowledge to handle large volume of data through Ab Initio graphs/plans. Hands-on experience with application development, relational database layout, development, data modeling.
In lieu of a Bachelor's degree, an additional 4 years of relevant work experience is required in addition to the required work experience.
Preferred Qualifications
- Knowledge, Skills and Abilities (KSAs)
- Knowledge and understanding of at least one programming language (i.e., SQL, NoSQL, Python)., Expert
- Knowledge and understanding of Ab Initio., Expert
- Knowledge and understanding of database design and implementation concepts. , Expert
- Knowledge and understanding of data exchange formats., Expert
- Knowledge and understanding of data movement concepts., Expert
- Strong technical and analytical and problem solving skills to troubleshoot to solve a variety of problems., Expert
- Requires strong organizational and communication skills, written and verbal, with the ability to handle multiple priorities., Advanced
- Knowledge of Cloudera tech stack and Hadoop: Good to have.
- Knowledge and experience working in Healthcare domain: Good to have
- Knowledge and experience with Unix/Linux OS and Control-M: Good to have
- dditional Skills: Unix/Linux scripting, Cloudera tech stack, Control-M, JIRA, experience working in Agile/Kanban
- Local candidates to DMV preferred.
- Unix/Linux scripting, Cloudera tech stack, Control-M, JIRA, experience working in Agile/Kanban