Apache Iceberg Data Engineer

The Opportunity:

Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We need a data professional like you to help our clients find answers in their data to impact important missions-from fraud detection to cancer research to national intelligence.

As a data engineer at Booz Allen, you'll use your skills and experience to help build advanced technology solutions and implement data engineering activities on some of the most mission-driven projects in the industry. You'll develop and deploy the pipelines and platforms that organize and make disparate data meaningful.

Here, you'll work with a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll sharpen your skills in analytical exploration and data examination while you support the assessment, design, developing, and maintenance of scalable platforms for your clients. Due to the nature of work performed within this facility, U.S. citizenship is required.

Work with us to use data for good.

Join us. The world can't wait.

You Have:

• 2+ years of experience developing and maintainingdata pipelinesand workflows for large-scale datasets, ensuring efficiency and reliability
• Experience working withApache Icebergor table formats such as Delta Lake or Hudi, including data lake transactions, schema evolution, data version control, and partition optimization
• Experience working withdistributed file systems,such asS3, HDFS, or GCS, and implementing scalable, high-performance data lake infrastructure
• Experience withquery enginessuch asPresto, Trino,Spark, orHive, integrating them with Iceberg-backed tables for efficient querying of large datasets
• Experience inPythonand programming languages such as Java or Scala, including implementing scalable ETL/ELT processes to populate and maintain Iceberg tables
• Experience working withdata lifecycle management, including time-travel queries and optimizing data for both historical and real-time use cases
• Knowledge ofdata lake and warehouse architectureprinciples and platforms, including best practices for storage optimization and modern lakehouse paradigms
• Ability to debug and troubleshoot for data lake environments, addressing issues related to data consistency, governance, and performance bottlenecks, and design and document reusable, modular solutions for managing and interacting with Iceberg-backed datasets in complex ecosystems
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
• Bachelor's degree in Data Engineering or Computer Science

Nice If You Have:

• Experience integrating Apache Iceberg withorchestration toolslikeApache Airflowto automate workflows involving complex data lake operations
• Experience withcontainerized environmentssuch asDocker,and orchestration platforms such asKubernetes, ensuring scalability for Iceberg-backed systems
• Experience working withAWS Glue Catalog,Hive Metastore, or other metadata or catalog systems to efficiently manage Iceberg schema and table metadata
• Experience adapting Iceberg implementations for the cloud
• Experience implementingdata governance principles, including role-based access and compliance policies, into Iceberg workflows
• Knowledge ofcloud-native object storage systemssuch asAWS S3,Azure Data Lake,or Google Cloud Storage and
• Knowledge ofdistributed computing systems, such as Spark or Flink, for both batch and real-time data processing involving Iceberg datasets
• Knowledge ofpartitioning strategies and optimization techniquesfor performance tuning of Iceberg analytics
• Knowledge ofreal-time data streamingand integrating tools such asKafkawith Iceberg for near-real-time ingestion and analytics
• Knowledge ofAgile engineering practices

Vetting:

Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client.

Compensation

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

Identity Statement

As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Work Model
Our people-first culture prioritizes the benefits of flexibility and collaboration, whether that happens in person or remotely.

• If this position is listed as remote or hybrid, you'll periodically work from a Booz Allen or client site facility.
• If this position is listed as onsite, you'll work with colleagues and clients in person, as needed for the specific role.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.