Senior/Principal Data Engineer

At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.

Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.

Requisition #: 1046

Job Title : Senior/Principal Data Engineer

Location: Original Headquarters Building, 1000 Colonial Farm Rd., McLean, Virginia22101

Clearance Level: Active DoD - Top Secret SCI FSP

Required Certification(s): Active U.S. security clearance at Top Secret/SCI with Full Scope Poly

SUMMARY

This initiative builds and maintains a robust data-management backbone to support advanced cyber-analysis workflows. Working on-site with developers, data scientists, subject-matter experts, and analysts, the program architects scalable repositories and ETL pipelines that ingest, process, and serve large volumes of classified cyber data for real-time and batch analytics.

As a Senior Data Engineer, you will design, develop, and optimize data-pipeline architectures that underpin the program’s analytics platform. Partnering with cross-functional teams, you will analyze data challenges, propose cutting-edge tools, and implement solutions that ensure high performance, reliability, and maintainability of all data services.

JOB DUTIES AND RESPONSIBILITIES

·       Architect and build ETL workflows to ingest, transform, and load large datasets from disparate cyber sources.

·       Implement and maintain scalable data-pipeline frameworks (e.g., Airflow, NiFi).

·       Develop data-visualization dashboards to surface key metrics and insights.

·       Design and optimize data-repository schemas for structured and unstructured data.

·       Troubleshoot ETL failures and performance bottlenecks; implement corrective actions.

·       Collaborate with peer engineers to establish best practices for data ingestion, storage, and retrieval.

·       Support data-querying processes and maintain documentation for all data assets.

·       Evaluate and integrate new data technologies (NoSQL, columnar stores, graph databases) as needed.

QUALIFICATIONS

Required Certifications

·       Active U.S. security clearance at Top Secret/SCI with Full Scope Poly

Education, Background, and Years of Experience

·       Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field.

·       5–10 years of professional experience in data engineering or similar technical roles.

ADDITIONAL SKILLS & QUALIFICATIONS

Required Skills

·       Proven expertise in designing and executing ETL processes on large datasets.

·       Strong coding skills in Python, Java, or Scala for data-pipeline development.

·       Experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra).

·       Familiarity with data-orchestration tools (Airflow, Prefect, or equivalent).

·       Proficiency in creating data visualizations (e.g., Tableau, Power BI, or custom dashboards).

·       Solid understanding of data-modeling principles and repository design.

·       Excellent problem-solving skills and attention to detail in troubleshooting data issues.

Preferred Skills

·       Experience with cloud-based data platforms in government environments (AWS GovCloud).

·       Knowledge of containerized deployments (Docker) and orchestration platforms (Kubernetes).

·       Hands-on work with streaming data systems (Kafka, Kinesis).

·       Familiarity with infrastructure as code (Terraform, CloudFormation).

WORKING CONDITIONS

Environmental Conditions

·       Full-time, on-site at a secure government facility.

·       Regular business hours, with periodic after-hours support for pipeline deployments or incident response.

·       Must comply with all facility security requirements and data-handling protocols.

Strength Demands

·       Sedentary – 10 lbs. Maximum lifting, occasional lift/carry of small articles.  Some occasional walking or standing may be required.   Jobs are sedentary if walking and standing are required only occasionally, and all other sedentary criteria are met.

Physical Requirements

·       Stand or Sit; Walk; Repetitive Motion; Use Hands / Fingers to Handle or Feel; Stoop, Kneel, Crouch, or Crawl; See; Push or Pull; Climb (stairs, ladders) or Balance (ascend / descend, work atop, traverse).

Employees of Agile Defense are our number one priority, and the importance we place on our culture here is fundamental. Our culture is alive and evolving, but it always stays true to its roots. Here, you are valued as a family member, and we believe that we can accomplish great things together. Agile Defense has been highly successful in the past few years due to our employees and the culture we create together. 

What makes us Agile? We call it the 6Hs, the values that define our culture and guide everything we do. Together, these values infuse vibrancy, integrity, and a tireless work ethic into advancing the most important national security and critical civilian missions. It's how we show up every day. It's who we are.

We also believe in supporting our employees by offering a competitive and comprehensive benefits package. To explore the benefits we offer, please visit our website under the Careers section.

Happy - Be Infectious.

Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.

Helpful - Be Supportive.

Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.

Honest - Be Trustworthy.

Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support.

Humble - Be Grounded.

Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.

Hungry - Be Eager.

Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.

Hustle - Be Driven.

Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities