Senior Data Engineer

• Chicago, IL or Columbia, MD
• Hybrid (Tues, Wed, Thur)
• Direct Hire, Full-time (No C2C or C2H)
• 120K to 130K + 15% - 30% Bonus
• No Sponsorship
• No Relocation
• No Remote Option

Job Description:

• Work closely with various Business, IT, Analyst and Data Science groups to collect business requirements.
• Design, develop, deploy and support high performance data pipelines both inbound and outbound.
• Optimize data pipelines for performance, scalability, and reliability.
• Implement CI/CD pipelines to ensure continuous deployment and delivery of our data products.
• Ensure quality of critical data element, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
• Document the design and support strategy of the data pipelines.
• Capture, store and socialize data lineage and operational metadata.
• Troubleshoot and resolve data engineering issues as they arise.
• Develop REST APIs to expose data to other teams within the company.
• Mentor and guide junior data engineers.

Qualifications:

• Six (6) plus years of experience in building data lakes and cloud data platforms
• Experience working with GCP technologies like BigQuery, Composer, GCS, DataStream, Dataflows
• Expert knowledge on SQL and Python programming
• Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed.
• Experience in tuning queries for performance and scalability
• Experience in Real Time Data Ingestion using GCP PubSub, Kafka, Spark or similar.
• Excellent organizational, prioritization and analytical abilities
• Have proven experience working in incremental execution through successful launches.
• Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment.

Additional Information:

Benefits including-

• Health, dental, vision, life and disability insurance
• 401k Retirement Program + 6% employer match
• Participation in Flexible Time Off (FTO) Policy
• 12 Paid Holidays

Keywords: GCP, Google Cloud Platform, BigQuery, Composer, SQL, Python, Data Engineering, Data Pipelines