Senior Data Engineer, ConsultNet, Rockville, MD
ConsultNet -
Rockville, MD,
US
Senior Data Engineer
Date Posted: 2024-06-10
Job description
Senior Data Engineer
Remote- must work standard EST hours
Long-term contract
Overview
Our client is looking for a Senior Data Engineer to join their team
As the data engineer on the team, you are responsible for building the reporting infrastructure by working with the engineering team, business users, product management, and the cross-functional partners
You will be reporting to the Director of Engineering.
Responsibilities
Work with the business users and product manager to thoroughly understand business requirements for reporting and translate the emanating results into good technical data designs.
Establish documentation of reports, develop, and support technical specification for all reports and processes.
Create a new reporting infrastructure to create a scalable reporting framework.
Design and support the reporting datastores and schemas for new and existing data sources for the reporting framework.
Design and develop systems for the import and maintenance of the business's reporting datastore in the cloud, ETL processes, and business intelligence.
Document the report datastore schemas and ETL processes in our internal wiki to create a reporting knowledge repository.
Share/teach the reporting good practices to other engineers and business users.
Qualifications
7+ years of related data engineering experience with varied forms of data infrastructure and building scalable data pipelines.
A successful history of manipulating, processing, and extracting data from both SQL and NoSQL datastores (MongoDB preferred)
Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for other engineers across the team.
5+ years of experience working in a technical environment with the latest technologies like AWS data services (AWS Lambdas, Athena) and Python data processing libraries.
Advanced working SQL knowledge and experience working with relational databases and non-relational datastores (MongoDB preferred)
Strong programming skills (preferably in Python and Java)
Knowledge of Business Intelligence Tools (PowerBI preferred)
Excellent communication skills and experience supporting and working with cross-functional teams in a dynamic environment.
Remote- must work standard EST hours
Long-term contract
Overview
Our client is looking for a Senior Data Engineer to join their team
As the data engineer on the team, you are responsible for building the reporting infrastructure by working with the engineering team, business users, product management, and the cross-functional partners
You will be reporting to the Director of Engineering.
Responsibilities
Work with the business users and product manager to thoroughly understand business requirements for reporting and translate the emanating results into good technical data designs.
Establish documentation of reports, develop, and support technical specification for all reports and processes.
Create a new reporting infrastructure to create a scalable reporting framework.
Design and support the reporting datastores and schemas for new and existing data sources for the reporting framework.
Design and develop systems for the import and maintenance of the business's reporting datastore in the cloud, ETL processes, and business intelligence.
Document the report datastore schemas and ETL processes in our internal wiki to create a reporting knowledge repository.
Share/teach the reporting good practices to other engineers and business users.
Qualifications
7+ years of related data engineering experience with varied forms of data infrastructure and building scalable data pipelines.
A successful history of manipulating, processing, and extracting data from both SQL and NoSQL datastores (MongoDB preferred)
Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for other engineers across the team.
5+ years of experience working in a technical environment with the latest technologies like AWS data services (AWS Lambdas, Athena) and Python data processing libraries.
Advanced working SQL knowledge and experience working with relational databases and non-relational datastores (MongoDB preferred)
Strong programming skills (preferably in Python and Java)
Knowledge of Business Intelligence Tools (PowerBI preferred)
Excellent communication skills and experience supporting and working with cross-functional teams in a dynamic environment.