Job Description


Job Overview

  • Job ID:

    J50862

  • Job Title:

    ETL SDET - PySpark Coding Experience

  • Location:

    Jersey City, NJ

  • Duration:

    18 Months + Extension

  • Hourly Rate:

    Depending on Experience (DOE)

  • Work Authorization:

    US Citizen, Green Card, OPT-EAD, CPT, H-1B,
    H4-EAD, L2-EAD, GC-EAD

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2, 1099, C2C

Job Details

Must-Have Skills:

    • ETL Testing, PythonPySpark - Coding Experience is Mandatory
    • AWS S3, Redshift
    • Complex SQL Quires - Wring Complex Query is Mandatory

Good to Have:

    • Kafka, Shell scripting, Healthcare domain

Position Summary:

The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows.

This role involves designing and implementing automated tests to validate data transformation and migration,

as well as collaborating with data engineers and developers to identify and resolve data quality issues.

The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity.

Minimum Qualification:

    • At least 12 years of IT experience with minimum 8 years of experience in below skills:
    • Tech Skills
      • Proficiency in ETL Testing and developing automation framework & testcases in atleast one scripting language.
      • Strong SQL skills, with experience in handling big data using ETL tools (e.g., Informatica).
      • Testing experience in cloud environment (AWS s3)
      • Experience with Test Automation and DevOps practices in ETL and Cloud
      • Work experience in a Big Data ecosystem processing data in data lakehouse.
      • Familiarity with DBT (Data Build Tool) or similar data transformation tools is a plus.

  • Experience providing testing oversight in Agile team.
  • Should have excellent business communication to interact with Business teams and cross-functional teams.

Apply Now
Equal Opportunity Employer

MACHINE LEARNING TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. MACHINE LEARNING TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will MACHINE LEARNING TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract