Senior Hadoop Developer Job at PB consulting, Charlotte, NC

  • PB consulting
  • Charlotte, NC

Job Description

Experience Required: 10+ Years

Required Technical/Functional Skills
  • 10+ years of experience working with the Hadoop ecosystem and large-scale distributed data platforms.
  • Strong hands-on experience with:
    • HDFS
    • Apache Hive
    • Apache Spark
    • Apache Ozone
  • Strong experience with Hive Metastore management, including table and partition maintenance.
  • Experience with Hadoop data lifecycle management, storage management, and data retention.
  • Strong knowledge of data ingestion, ETL processes, data validation, and troubleshooting.
  • Proficiency in SQL, Shell scripting, and Python automation.
  • Experience with Cloudera Data Platform (CDP) or similar Hadoop distributions.
  • Strong data analysis, troubleshooting, and root cause analysis skills.
Roles & Responsibilities
  • Monitor, troubleshoot, and resolve HDFS and Apache Ozone issues.
  • Investigate Hadoop cluster performance, storage utilization, capacity, and availability concerns.
  • Manage storage allocation, quota requests, capacity planning, and storage forecasting.
  • Perform Hive Metastore administration, including table and partition maintenance.
  • Support Hadoop platform maintenance, upgrades, integrations, onboarding, and decommissioning activities.
  • Support data ingestion, ETL workflows, and data validation processes.
  • Develop and maintain Shell and Python automation scripts for operational activities.
  • Collaborate with application, data engineering, and platform teams during incident, problem, and change management activities.
  • Perform root cause analysis and implement corrective and preventive actions.
  • Create and maintain runbooks, operational documentation, knowledge articles, and support procedures.
  • Ensure effective Hadoop data lifecycle, storage, and quota governance.
Preferred / Desired Skills
  • Experience supporting large-scale, multi-petabyte Hadoop environments.
  • Strong understanding of distributed storage architecture, replication, and fault tolerance.
  • Experience with capacity management, storage forecasting, quota governance, and utilization optimization.
  • Experience with Hadoop platform onboarding, integration, migration, and decommissioning.
  • Familiarity with AWS, Azure, or GCP cloud platforms.
  • Experience with monitoring and observability tools such as Cloudera Manager, Grafana, Splunk, and Prometheus.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Experience performing Root Cause Analysis (RCA) for complex production issues.
  • Strong communication and collaboration skills. 

Job Tags

Temporary work

Similar Jobs

Advanced Concrete USA Inc

Concrete Truck Driver Job at Advanced Concrete USA Inc

 ...Advanced Concrete Inc., located in Wisconsin, is hiring Ready Mix Drivers. The position offers full-time employment with competitive pay ranging from $75,000 to $...  ...driving record, and prior experience driving ready-mix trucks. Join a company that values customer service and... 

Wing Assistant

Medical Scribe Job at Wing Assistant

 ...Medical Scribe - Full Time Wing is on the exciting mission of redefining the future of...  ...necessary documentation is collected for billing. This role is critical in our commitment...  ...Upskilling Opportunities 100% Work-From-Home Exceptionally Supportive Team ... 

HealthTrust Workforce Solutions HCA

Travel Nurse RN - Outpatient Surgery - $2,102 per week Job at HealthTrust Workforce Solutions HCA

 ...HealthTrust Workforce Solutions HCA is seeking a travel nurse RN Outpatient Surgery for a travel nursing job in Dublin, Georgia. Job Description & Requirements ~ Specialty: Outpatient Surgery ~ Discipline: RN ~ Duration: 13 weeks ~36 hours per week ~ Shift... 

Unifi

Airport Ramp Agent Supervisor - ONT Job at Unifi

 ...Airport Ramp Agent Supervisor - ONT Job Title: Airport Ramp Agent Supervisor - ONT Date: Tuesday, September 1, 2026 Entity:...  ...: California City: Ontario Base Pay Rate: $20.90 Full/Part Time: Full Time Exempt or Non-Exempt Position: Non-Exempt Shift... 

Peloton Cycle

Sr. Mechanical Engineer Job at Peloton Cycle

Architect and deliver the next generation of fitness hardware. As a Senior Mechanical Engineer at Peloton, you will thrive in a hands-on "design-build-test" culture, leading cross-functional project teams or overseeing complex electro-mechanical modules. Partnering closely...