Data Engineer Job at People Tech Group Inc, Washington DC

a2pXYnd4eStYTXdUS3B5dVBlTnhOckVtR0E9PQ==
  • People Tech Group Inc
  • Washington DC

Job Description

Role: Data Engineer

Duration: Long-term project.

Location: Redmond WA

Key Skills

  • Apache Spark (PySpark or Scala) : Writing scalable distributed rule engines.
  • Apache Hive : Querying partitioned datasets, schema handling.
  • Amazon EMR : Cluster management, tuning jobs for large datasets (20+ TB).
  • AWS S3 : Data partitioning, object lifecycle, access patterns.
  • Glue Data Catalog : Managing Hive table metadata.
  • Data Quality Frameworks : (Great Expectations, Deequ, or custom rules).
  • CI/CD : Code deployment pipelines (Git, Jenkins, Airflow, etc

Job Tags

Similar Jobs

CRO Strategies

Clinical Research Coordinator Job at CRO Strategies

 ...Role Description This is a contract role for a Clinical Research Coordinator, located on-site in Bryn Mawr, Pennsylvania. The Clinical Research Coordinator will be responsible for managing the day-to-day clinical trial activities, obtaining informed consent from study... 

Aequor Information Technologies Pvt. Ltd.

Manufacturing Engineer Job at Aequor Information Technologies Pvt. Ltd.

 ...Job Title: Manufacturing Engineer II Location: Irvine, CA Contract Length: 18 months Job Summary: - Associate Engineer II assists or leads the design and development of manufacturing processes for products, taking into consideration problems inherent in... 

StevenDouglas

Senior Business Intelligence Analyst - Data Analytics (SQL) Job at StevenDouglas

 ...processes. The FP&A Analyst will collaborate closely with the FP&A Director, the Chief Accounting Officer, the CFO, data analytics and Business Unit Leaders as well as cross-functional teams to drive performance, identify opportunities for improvement, and contribute to a... 

The Planet Group

Building Maintenance Technician Job at The Planet Group

Building Maintenance Technician - 632994 Location: Wilton, CT Job Summary: We are seeking a skilled Building Maintenance Technician to perform preventative maintenance and repairs on facility systems and equipment at our client's site. This hands-on role involves...

gategroup

Risk Insurance Manager Job at gategroup

 ...responsible for supporting all insurance-related activities including risk assessment, insurance administration, insurance policy...  ...guide various workstreams Extensive experience with Microsoft Office Package applications (Word, PowerPoint, Excel, Outlook, SharePoint...