Job Description

Role: BigData/Hadoop

Location: Chandler, AZ - 3 days a week in office

Duration: 24-month contract

Job Type : Contract

Job description:

We are seeking a proactive and accountable BigData/Hadoop with a minimum of 5 years of hands-on experience in building and maintaining scalable data pipelines using big data and cloud technologies. The ideal candidate will have strong expertise in data modeling, transformation, and automation, with the ability to work independently and troubleshoot effectively in a dynamic environment.

Key Responsibilities:

• Design, develop, and maintain data pipelines using Hadoop, Hive, PySpark, and Python.
• Integrate and manage data within AWS S3, ensuring security and performance.
• Perform data modeling and database design to support analytical and operational use cases.
• Schedule, monitor, and manage data workflows using Autosys.
• Utilize Power BI and Dremio for data visualization and query acceleration.
• Develop and maintain Unix/Shell scripts as part of the CI/CD pipeline.
• Apply logic and transformations to large-scale datasets to meet business requirements.
• Troubleshoot complex data issues across the pipeline and provide scalable solutions.
• Collaborate with cross-functional teams to ensure data accuracy, quality, and performance.

Required Skills:

• 4+ years of hands-on experience in:
  • Big data stack: Hadoop, Hive, PySpark, Python
  • AWS S3 storage management, security, and integrations
  • Job scheduling using Autosys
  • Data modeling and relational database design (e.g., MySQL or similar)
  • Shell scripting and CI/CD integration
  • Visualization tools like Power BI and Dremio
• Strong problem-solving skills with the ability to analyze and resolve data issues effectively.
• Self-starter with strong ownership, accountability, and communication skills.

Preferred Qualifications:

• Exposure to Google Cloud Platform (GCP) for data engineering tasks.
• Experience in financial services or other data-intensive domains.

Job Tags

Hourly pay, Permanent employment, Full time, Contract work, Part time, Internship, Seasonal work, Work at office, 3 days per week,

Similar Jobs