Data Engineer Job at People Tech Group Inc, Washington DC

a2pXYnd4eStYTXdUS3B5dVBlTnhOckVtR0E9PQ==
  • People Tech Group Inc
  • Washington DC

Job Description

Role: Data Engineer

Duration: Long-term project.

Location: Redmond WA

Key Skills

  • Apache Spark (PySpark or Scala) : Writing scalable distributed rule engines.
  • Apache Hive : Querying partitioned datasets, schema handling.
  • Amazon EMR : Cluster management, tuning jobs for large datasets (20+ TB).
  • AWS S3 : Data partitioning, object lifecycle, access patterns.
  • Glue Data Catalog : Managing Hive table metadata.
  • Data Quality Frameworks : (Great Expectations, Deequ, or custom rules).
  • CI/CD : Code deployment pipelines (Git, Jenkins, Airflow, etc

Job Tags

Similar Jobs

Lap of Love Veterinary Hospice

Call Center Representative Job at Lap of Love Veterinary Hospice

 ...Join Lap of Love as a Call Center Representative and Love What You Do! Lap of Love is looking for an experienced Call Center Representative...  ...join our growing team. As a Veterinary Care Coordinator working from home, youll become part of a diverse and dynamic team that... 

Kellton

ETL Specialist Job at Kellton

 ...Digital Delivery team. The ideal candidate will have 35 years of experience in building robust ETL pipelines, integrating diverse data sources, and ensuring high data quality using the Talend ecosystem. You will play a key role in delivering scalable and secure data... 

South Dakota State Government

Governance Risk Compliance (GRC) Analyst Job at South Dakota State Government

 ...For more information on the Information & Telecommunications, please visit .We are seeking a Governance, Risk, and Compliance (GRC) Analyst to join the BIT Enterprise Platforms & Infrastructure team. The successful candidate will play a key role in developing and... 

Aunt Millie's

Sales Branch Supervisor Job at Aunt Millie's

 ...Sales Branch Supervisor Location: Dearborn, MI Compensation: Starting salary $60,000 per year Schedule : Full time...  ...forward-thinking mindset towards sustainability and innovation in food production. Why Work Here: We are proud of the products... 

The Shipyard

2025 Summer Internship Job at The Shipyard

 ...hands-on learning approach is essential to the success of our interns, therefore, we require candidates to be able to work on-site in...  ...week. The internship will take place over the duration of the summer. Students will be compensated $20 per hour for their participation...