Lead/Principal Data Consultant

---

Job description

Title: Lead/Principal Data Consultant

Location: Irving, TX 75039 (Hybrid Onsite)

Duration: Direct Hire Full Time

Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S.

Seeking a highly skilled and experienced Lead/Principal Data Consultant to join our research group team. The ideal candidate will be local to be able to work a hybrid schedule as well as have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable data architectures to support our data-driven initiatives. You will collaborate closely with cross-functional teams to ensure data integrity, availability, and accessibility across the organization.

Key Responsibilities:

Lead the design, development, and maintenance of scalable data pipelines, ETL/ELT processes, and data models.

Focus on Kafka, HDFS, HBase, Parquet, Spark, and Flink to ensure efficient data ingestion, storage, and processing.

Build and manage data ingestion frameworks using big data technologies, ensuring high efficiency and reliability.

Develop and optimize data storage solutions, including data warehousing, data lakes, and NoSQL databases on cloud platforms such as AWS, Azure, or Google Cloud.

Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions that meet those needs.

Ensure data quality, governance, and security through the implementation of best practices and robust monitoring systems.

Work with various data formats, including Parquet, Avro, and others, to ensure efficient data processing and storage.

Mentor and provide technical leadership to junior data engineers, fostering a culture of continuous learning and improvement.

Qualifications:

Proven experience as a Lead or Principal Data Consultant or in a similar role, with a strong focus on data warehousing, ETL/ELT processes, and data modeling.

Proficiency in programming languages such as Python, Java, or Scala.

Hands-on experience with big data technologies such as Kafka, Spark, HDFS, HBase, Flink, DBT, SQLMesh, etc.

Experience with cloud platforms such as AWS, Azure, or Google Cloud.

Strong SQL skills and experience working with both relational and NoSQL databases.

Familiarity with data visualization tools such as Tableau, Power BI, or Looker.

Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.

Preferred Qualifications:

Experience with building and managing data pipelines in a multi-cloud environment.

Familiarity with data governance and data quality frameworks.

Experience in mentoring or leading a team of data engineers.

About INSPYR Solutions

Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at (url removed).

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities

<!– job description page –>