Data Engineer, Disruptive Solutions, LLC, Washington, DC
Disruptive Solutions, LLC -
Washington, DC,
US
Data Engineer
Date Posted: 2024-05-08
Job description
Required Skills: Active TS/SCI clearance
- Understanding of cloud architectures and enabling tools and technologies, such as, AWS Cloud (GovCloud/C2S)
- Familiar with Amazon Web Managed Services (AWS) Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar - Proficient experience utilizing JavaScript, Elasticsearch, JSON, SQL, XML
- Working knowledge with datastores MongoDB/DynamoDB, PostgreSQL, S3, Redshift, JDBC/ODBC, and Redis
- Familiar with Linux/Unix server environments
- Experience with Agile development methodology
- Working knowledge with Collaboration tools, such as, Jira and Confluence
Role Description/Responsibilities:
- Develop and design data pipelines to support an end-to-end solution
- Develop and maintain artifacts i.e. schemas, data dictionaries, and transforms related to ETL processes
- Integrate data pipelines with AWS cloud services to extract meaningful insights
- Manage production data within multiple datasets ensuring fault tolerance and redundancy
- Design and develop robust and functional dataflows to support raw data and expected data
- Provide Tier 3 technical support for deployed applications and dataflows
- Experience with cloud message APIs and usage of push notifications
- Collaborate with the rest of data engineering team to design and launch new features. Includes coordination and documentation of dataflows, capabilities, etc.
- Keen interest in learning and using the latest software tools, methods, and technologies to solve real world problem sets vital to national security
- Support to off-hours deployment such as evening or weekends.
Disruptive Solutions is committed to the principles of equal employment. We are committed to complying with all federal, state, and local laws providing equal employment opportunities, and all other employment laws and regulations. It is our intent to maintain a work environment that is free of harassment, discrimination, or retaliation because of age, race, color, national origin, ancestry, religion, sex, sexual orientation (including transgender status, gender identity or expression), pregnancy (including childbirth, lactation, and related medical conditions), reproductive health decisions, marital status, personal appearance, matriculation, political affiliation, credit information, employment status, physical or mental disability, genetic information (including testing and characteristics), veteran status, uniformed servicemember status, status as a victim or family member of a victim of domestic violence, a sexual offense, or stalking, homeless status, or any other status protected by federal, state, or local laws.
Salary Description
$140-000 - $150,000
- Understanding of cloud architectures and enabling tools and technologies, such as, AWS Cloud (GovCloud/C2S)
- Familiar with Amazon Web Managed Services (AWS) Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar - Proficient experience utilizing JavaScript, Elasticsearch, JSON, SQL, XML
- Working knowledge with datastores MongoDB/DynamoDB, PostgreSQL, S3, Redshift, JDBC/ODBC, and Redis
- Familiar with Linux/Unix server environments
- Experience with Agile development methodology
- Working knowledge with Collaboration tools, such as, Jira and Confluence
Role Description/Responsibilities:
- Develop and design data pipelines to support an end-to-end solution
- Develop and maintain artifacts i.e. schemas, data dictionaries, and transforms related to ETL processes
- Integrate data pipelines with AWS cloud services to extract meaningful insights
- Manage production data within multiple datasets ensuring fault tolerance and redundancy
- Design and develop robust and functional dataflows to support raw data and expected data
- Provide Tier 3 technical support for deployed applications and dataflows
- Experience with cloud message APIs and usage of push notifications
- Collaborate with the rest of data engineering team to design and launch new features. Includes coordination and documentation of dataflows, capabilities, etc.
- Keen interest in learning and using the latest software tools, methods, and technologies to solve real world problem sets vital to national security
- Support to off-hours deployment such as evening or weekends.
Disruptive Solutions is committed to the principles of equal employment. We are committed to complying with all federal, state, and local laws providing equal employment opportunities, and all other employment laws and regulations. It is our intent to maintain a work environment that is free of harassment, discrimination, or retaliation because of age, race, color, national origin, ancestry, religion, sex, sexual orientation (including transgender status, gender identity or expression), pregnancy (including childbirth, lactation, and related medical conditions), reproductive health decisions, marital status, personal appearance, matriculation, political affiliation, credit information, employment status, physical or mental disability, genetic information (including testing and characteristics), veteran status, uniformed servicemember status, status as a victim or family member of a victim of domestic violence, a sexual offense, or stalking, homeless status, or any other status protected by federal, state, or local laws.
Salary Description
$140-000 - $150,000