Data Engineer Job at People Tech Group Inc, Washington DC

a2pXYnd4eStYTXdUS3B5dVBlTnhOckVtR0E9PQ==
  • People Tech Group Inc
  • Washington DC

Job Description

Role: Data Engineer

Duration: Long-term project.

Location: Redmond WA

Key Skills

  • Apache Spark (PySpark or Scala) : Writing scalable distributed rule engines.
  • Apache Hive : Querying partitioned datasets, schema handling.
  • Amazon EMR : Cluster management, tuning jobs for large datasets (20+ TB).
  • AWS S3 : Data partitioning, object lifecycle, access patterns.
  • Glue Data Catalog : Managing Hive table metadata.
  • Data Quality Frameworks : (Great Expectations, Deequ, or custom rules).
  • CI/CD : Code deployment pipelines (Git, Jenkins, Airflow, etc

Job Tags

Similar Jobs

Ikigai Cases

Warehouse Operations Associate Job at Ikigai Cases

ABOUT IKIGAI CASES Ikigai Cases is a family owned e-commerce business selling metal pill cases. The business was started in December 2021 and has been run by two brothers since then from Washington, DC. Our mission is to make exceptional pill cases and provide exceptional...

Regency International

Work at home Data Entry Representative Job at Regency International

We are seeking a detail-oriented and organized data entry clerk to join our team. The ideal candidate will have...  ...-person. - No commute needed if you choose to work from home. - No minimum hrs. You can do this part-time or full-time - Enjoy cost-free samples from our... 

Dana B. Kenyon Company (DBK)

Assistant Project Manager Job at Dana B. Kenyon Company (DBK)

 ...Dana B. Kenyon Company (DBK), an established construction company, serves a broad range of markets, including Railroad, Ports, Aviation, Industrial, Financial, Senior Living, and Healthcare. Headquartered in Jacksonville, Florida, since 1983, DBK is recognized regionally... 

California Concepts

Sales Management Trainee Job at California Concepts

 ...Join our vibrant team as a Sales Management Trainee - We welcome you to apply and embark on an exciting career path with us! Qualifications...  ...experience is a plus Eagerness to undergo comprehensive training Role and Responsibilities: As a Sales Management... 

Delta Dallas

Corporate Receptionist Job at Delta Dallas

 ...leading real estate firm in Dallas in the search for a Corporate Receptionist / Front Office Administrator . This role is an excellent...  ...special projects as needed Qualifications: Previous experience in a receptionist, administrative, or customer service role...