Summary
What you’ll impact
The Senior Data Platform Engineer will design, build, and maintain data pipelines and relational data platforms to support advanced visual analytics. The role also involves automating platform infrastructure, developing ETL and streaming solutions, and providing technical leadership and mentorship.
Responsibilities
What you'll do
- Develop data-processing workflows and analytics for desktop- and web-based visual analytic tools.
- Build and maintain secure data-ingestion pipelines using open-source, COTS, and GOTS technologies.
- Design and optimize enterprise relational databases and establish standards for operations and security.
- Integrate new data systems with existing data warehouses and improve performance and functionality.
- Support large-scale relational data analysis using visualization and high-performance computing.
- Contribute to system optimization, secure posture improvements, and cross-team technical standards.
- Support Kubernetes-based data platform environments.
- Develop and maintain Infrastructure as Code using Terraform.
- Support GitLab CI/CD pipelines for automated build, integration, and deployment.
- Manage software artifacts and dependencies using JFrog Artifactory.
- Support data platform services hosted within AWS cloud environments.
- Develop and support ETL workflows using Python, Cribl, and Apache NiFi.
- Support PostgreSQL database environments.
- Develop and maintain Apache Kafka-based data streaming and integration capabilities.
- Integrate Splunk and custom GOTS applications into enterprise data-processing workflows.
- Perform complex data parsing and streamlined ingestion.
- Support provenance and end-to-end data lineage tracking.
- Perform schema-aligned ingestion and normalization of diverse structured and unstructured data.
- Support user interface and application components using Vue.js, Flask, Elixir, Phoenix LiveView, and DaisyUI.
- Integrate application components with backend data-processing and platform services.
- Mentor junior team members.
- Contribute to data platform standards, engineering practices, and operational improvements.
- Support improvements to data workflows, platform performance, and security.
Requirements
What you’ll bring
- Security Clearance: Active TS or higher [Required]
- Bachelor’s degree. [Required]
- Minimum 8 years of relevant experience. [Required]
- 8+ years of experience in data engineering, database design, or related fields. [Required]
- Experience working with structured and semi-structured data and visualization technologies. [Required]
- Familiarity with high-performance computing and mixed-technology environments. [Required]
- Experience improving data workflows, performance, and security. [Required]