Sr. Hadoop Administrator

---

Job description

KAYGEN is an emerging leader in providing top talent for technology based staffing services. We specialize in providing high-volume contingent staffing, direct hire staffing and project based solutions to companies worldwide ranging from startups to Fortune 500 and Managed Service Providers (MSP) across a wide variety of industries.

Job Title: Sr. Hadoop Administrator

Location: Austin, TX (Hybrid - 3 days onsite)

Duration: 6+ Months

Job Description:

Hadoop administration

Automation (Ansible, shell scripting, or Python scripting)

DevOps skills (Should be able to code at least in one language preferably Python)

Responsibilities

The role involves performing Big Data Administration and Engineering activities on multiple open-source platforms such as Hadoop, Kafka, HBase, and Spark. The successful candidate will possess strong troubleshooting and debugging skills.

Other responsibilities include effective root cause analysis of major production incidents and the development of learning documentation. The person will identify and implement high-availability solutions for services with a single point of failure.

The role involves planning and performing capacity expansions and upgrades promptly to avoid any scaling issues and bugs. This includes automating repetitive tasks to reduce manual effort and prevent human errors.

The successful candidate will tune alerting and set up observability to proactively identify issues and performance problems. They will also work closely with Level-3 teams in reviewing new use cases and cluster hardening techniques to build robust and reliable platforms.

The role involves creating standard operating procedure documents and guidelines on effectively managing and utilizing the platforms. The person will leverage DevOps tools, disciplines (Incident, problem, and change management), and standards in day-to-day operations.

The individual will ensure that the Hadoop platform can effectively meet performance and service level agreement requirements. They will also perform security remediation, automation, and self-healing as per the requirement.

The individual will concentrate on developing automation and reports to minimize manual effort. This can be achieved through various automation tools such as Shell scripting, Ansible, or Python scripting, or by using any other programming language.

At KAYGEN, we are always looking for dynamic, talented and experienced individuals. We invite you to join our team of talented IT professionals, consulting at client locations across the globe. Our culture is team-orientated; we strive to stand by our core values of respect, honesty and integrity. Our team of experienced staffing experts will work with you to find you the best opportunity. For more information please visit us at

Benefits:

Free Healthcare Insurance

Vision and Dental Insurance

401(k) Retirement Plan

Free Life Insurance

Sick Time Off

Achieve your Kaizen by clicking here. A unique and exclusive talent community supported by Kaygen, that includes programs like:Certifications

Mentorship Program

Referrals

Family and Wellness benefits

Continuous Growth and Career Development

<!– job description page –>