Data Engineer with Security Clearance

---

Job description

Data Engineer - (Mid level / Senior / Expert)
Data Posted: August 2024
Job Title: Data Engineer - (Mid level / Senior / Expert)
Req Number: 2000-201
Location(s): Herndon, VA, Chantilly, VA, Melbourne, FL Position Type: Full-Time, W-2 Employment
Salary Range: Competitive depending on relevant professional skills and experience. Total compensation includes a competitive salary, cash and strategic incentives, professional development and comprehensive benefits.
Experience: 8+ years of relevant professional experience for Mid level 12+ years of relevant professional experience for Senior 15+ years of relevant professional experience for Expert
Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Security: Current / active TS/SCI clearance with CI polygraph or willingness to take one. Background investigation required, including a minimum of a criminal and credit check as well as at least three professional references. Role Overview:
Pelagic AI is seeking a highly experienced and motivated Senior Data Engineering Specialist to join our growing team. The ideal candidate will have extensive experience in designing, building, and optimizing scalable data pipelines, as well as managing and deploying data infrastructure in cloud environments. You will work closely with our data science, analytics, and DevOps teams to ensure seamless data flow and integration across our systems, and you will mentor junior team members to elevate the overall technical capability of the team. Principal Responsibilities:
Lead the design, development, and maintenance of complex, scalable data pipelines
Optimize and troubleshoot data pipelines for performance, reliability, and scalability
Collaborate with engineers and analysts to understand data requirements and deliver high-quality data solutions
Implement and manage ETL processes using advanced tools like Apache Airflow, Spark, or similar
Ensure data quality and consistency through rigorous testing, validation, and governance practices
Deploy, monitor, and maintain data infrastructure in cloud environments (AWS, GCP, Azure)
Implement DevOps practices to streamline data workflows, including CI/CD pipelines, Docker, and Kubernetes
Mentor and provide guidance to junior data engineers, fostering a culture of continuous improvement and collaboration
Stay up-to-date with industry trends and emerging technologies to drive innovation within the data engineering team Minimum Requirements:
7+ years of experience in data engineering or related roles
Advanced proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL)
Extensive experience with big data technologies (e.g., Hadoop, Spark)
Deep understanding of cloud platforms (AWS, GCP, Azure) and their data services
Strong understanding and practical experience with DevOps practices and tools (CI/CD, Docker, Kubernetes)
Proven ability to optimize and troubleshoot complex data systems and pipelines
Excellent problem-solving skills and attention to detail
Strong communication and leadership abilities, with experience mentoring junior engineers
Experience with source configuration management tools such as Git
CI & CD development experience with technologies like Bash, Jenkins, or GitLab
Experience with automated deployment technologies such as Cloud Formation, Ansible, Terraform
Cloud Technologies deployment experience
Open-source application deployments and maintenance
Custom source application deployments and maintenance
LINUX system administration experience (RedHat and/or CentOS).
Working knowledge of Linux and Windows operating systems, web services and SQL databases
Experience working in an Agile environment
Must be willing to work on-site An Excellent Candidate for this position will meet most of the following experience requirements:
Experience with NoSQL databases (e.g., MongoDB)
Proficiency in programming languages such as Python, Java, or Kotlin
Experience with data visualization tools (e.g., Tableau, Power BI)
Strong understanding of data governance and security practices
Experience working in Agile/Scrum environments
Ability to work collaboratively in a team environment
Strong problem-solving skills and attention to detail
Eagerness to learn and adapt to new technologies and methodologies General personal traits we know will connect well with the team:
Superior communication skills
A positive, willing attitude
An ability to think on your feet and solve problems quickly
Adaptability to learn new methodologies and technologies
Comfortable working in an agile team environment
Technology and methodology agnostic, but accepts using tools needed for the requirement
Enjoys coaching and teaching About Pelagic AI
Pelagic AI is AI Solutions delivered: from tech road maps to custom software. Pelagic AI was founded by industry visionaries, each boasting decades of experience in the AI landscape. Our roots trace back to the early days of data mining, and our journey has encompassed pioneering work in modeling and simulation, algorithmic development, data science, machine learning, and generative AI. With a collective wealth of knowledge and a commitment to innovation, our team has shaped the evolution of AI across various domains. Pelagic AI embodies this rich heritage, offering cutting-edge solutions driven by the deep expertise of its founders, ensuring that we remain at the forefront of AI advancements. Join our team using data to optimize environments and future-proof businesses. Our team has worked in the AI/ML sector for nearly 20 years. We represent true expertise in the field with operations and engagements for several Fortune 500 companies. Join us as we bring our client's teams to the next level! Summary of Benefits
We expect each member of our team to fully engage creatively and work collaboratively and perform each day to the best of their ability. To support this, we have created a benefit package focused on professional growth, achieving a healthy work-life balance, and participation in the long-term success of the company. Our benefits include: generous paid time-off; an Employee Incentive Program (EIP); Internal Investment Projects (IIP), and other professional development activities; performance incentives that include spot bonuses and recruiting bonuses. Our plan is comprised of a 401k: 3% up front non-discretionary safe harbor contribution, 3% matched contribution (1:1 up to 3%), then discretionary profit sharing based on company annual performance; Medical/Dental/Vision coverage; Long & Short-term Disability; AD&D insurance; and Term Life Insurance. Each team member is also provided a benefits addendum that are added benefits tailored to your role to help you be more successful on day one. Apply Now! Send your resume to:

<!– job description page –>