PALANTIR Senior Data Engineer- Remote
Cognizant 130000.00 US Dollar . USD Per annum
2024-09-22 12:47:03
Stillwater, Minnesota, United States
Job type: fulltime
Job industry: I.T. & Communications
Job description
This remte position is open to any qualified applicant in the United States.
Practice - AIA - Artificial Intelligence and Analytics About AI & Analytics: Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their consumers need. Within AI & Analytics, we work to design the future-a future in which trial-and-error business decisions have been replaced by informed choices and data-supported strategies!
By applying AI and data science, we help leading companies to prototype, refine, validate, and scale their AI and analytics products and delivery models! Cognizant's AIA practice takes insights that are buried in data and provides businesses with a clear way to transform how they source, interpret, and consume their information. Our clients need flexible data structures and a streamlined data architecture that quickly turns data resources into informative, meaningful intelligence.
Job Duties and Responsibilities:
- Use Pyspark to build data pipes in AWS environments
- Write design documents and independently build the Data Pipes based on the defined source to target mappings
- Convert complex stored procedures, SQL triggers, etc. logic using PySpark in the Cloud platform
- Be open to learning new technologies and implementing solutions quickly in the cloud platform
- Communicate with program key stakeholders to keep the project aligned with their goals
- Effectively interact with QA and UAT team for code testing and migrate to different regions
- Spearheads data engineering initiatives targeting moderately to complex data and analytics challenges, delivering impactful outcomes through comprehensive analysis and problem-solving
- Pioneers the identification, conceptualization, and execution of internal process enhancements, encompassing scalable infrastructure redesign, optimized data distribution, and the automation of manual workflows
- Addresses extensive application programming and analysis quandaries within defined procedural guidelines, offering resolutions that span wide-ranging scopes
- Actively engages in agile/scrum methodologies, actively participating in ceremonies such as stand-ups, planning sessions, and retrospectives.
- Orchestrates the development and execution of automated and user acceptance tests, integral to the iterative development lifecycle.
- Fosters the maturation of broader data systems and architecture, assessing individual data pipelines and suggesting/implementing enhancements to align with project and enterprise maturity objective
- Envisions and constructs infrastructure that facilitates access and analysis of vast datasets while ensuring data quality and metadata accuracy through systematic cataloging
- Total 10+ years of experience with 3 plus years of experience in data engineering/ETL ecosystems with Palantir Foundry, Python, PySpark and Java.
- Required skills: Palantir
- Nice to have skills: Pyspark and Python
- Expert in writing shell scripts to execute various job scheduler
- Hands-on experience in Palantir & PySpark to build data pipes in AWS environments
- Good knowledge of Palantir components
- Good exposure to RDMS
- Basic understanding of Data Mappings and Workflows
- Any knowledge of the Palantir Foundry Platform will be a big plus
- Implemented a few projects in Energy and Utility space is a plus
This position is also eligible for Cognizant's discretionary annual incentive program and stock awards, based on performance and is subject to the terms of Cognizant's applicable plans.
Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:
- Medical/Dental/Vision/Life Insurance
- Paid holidays plus Paid Time Off
- 401(k) plan and contributions
- Long-term/Short-term Disability
- Paid Parental Leave
- Employee Stock Purchase Plan