Data Engineer at The Marlin Alliance, Inc. in San Diego, CA

Job description

• The Marlin Alliance is seeking a forward-thinking Data Engineer in San Diego, CA to provide client support to our Navy client. This is an on-site role and applicants must have active DoD Secret Clearance.
• This role is on-site in San Diego, CA and requires active TS/SCI clearance.

Responsibilities

• Build and optimize robust data pipelines: ingestion, transformation, storage, and governance.
• Convert between tactical data formats, e.g., XML, JSON, GEOJSON, Cursor-on-Target (CoT), JREAP-C, Link-16.
• Implement automation using CHRON/CRON jobs and data orchestration frameworks (Apache Airflow, Kafka, AWS Step Functions).
• Architect and maintain scalable data stores (e.g., Apache Iceberg, Elasticsearch) with schema evolution and deduplication.
• Enable real-time data indexing and fast query performance.
• Implement MIL-STD-6016 (Link-16) and MIL-STD-3011 (JREAP) message handling.
• Support integration or development of Cross-Domain Solutions (CDS) for secure, policy-based data transfers.
• Present complex data flows and technical insights effectively to leadership and stakeholders using clear data models and visual aids.

Requirements

• 5 - 10 years' experience working as a business analyst, data analyst, data scientist, data engineer, database administrator, geospatial analyst, geospatial engineer, machine learning engineer, or software engineer
• Hands on Keyboard- Developer Skillsets
• Fluency in Python, can code without Modern libraries.
• Experience in format conversions with some of the following: XML, JREAP-C, COT (cursor-on-target), JSON, GEO JSON, UMF/UHR, text link-16, Tapil-J, and other Tactical Data Links.
• Experience in natural language parsing (NLP) and using regular expressions, RegEx
• Experience implementing CHRON/CRON jobs
• Experience in data pipeline orchestration, ETL, orchestration tools (e.g., Kafka, Apache Airflow, AWS Step Functions)
• Focused experience implementing and monitoring data stores i.e. (Apache Iceberg, elastic search, data lake management)
• Experience with schema evolution, dataflow and governance
• Experience with real-time search and analytics engines for indexing and querying semi-structured data
• Focused experience optimizing data store queries for speed and de-duplication
• Direct experience implementing MIL-STD-6016 and MIL-STD-3011
• Can translate data between source and destination schemas
• Data modeling and PowerPoint presentations for leadership and stakeholder presentations
• Experience working with or developing Cross Domain Solutions (CDS) systems.
• Bachelor’s degree in Data Science, Computer Science, Engineering, or related STEM field.
• Familiarity with DoD data architecture principles (e.g. DoDAF, CADM).
• Experience with DataOps or similar mission-critical pipeline automation (e.g., deduplication, schema normalization).
• Any experience leveraging universal data distribution architectures within DOD operations.

Skills

Required

• Python
• XML
• JREAP-C
• COT (cursor-on-target)
• JSON
• GEO JSON
• UMF/UHR
• text link-16
• Tapil-J
• Tactical Data Links
• NLP
• RegEx

Preferred

• DoDAF
• CADM
• DataOps