Data Engineer Job at Octo

Octo Chantilly, VA 20151

You…

As a Data Engineer, you will be joining the team that is deploying and delivering a cloud-based, multi-domain Common Data Fabric (CDF), which provides data sharing services to the entire DoD Intelligence Community (IC). The CDF connects all IC data providers and consumers. It uses fully automated policy-based access controls to create a machine-to-machine data brokerage service, which is enabling the transition away from legacy point-to-point solutions across the IC enterprise.

Us…

We were founded as a fresh alternative in the Government Consulting Community and are dedicated to the belief that results are a product of analytical thinking, agile design principles and that solutions are built in collaboration with, not for, our customers. This mantra drives us to succeed and act as true partners in advancing our client’s missions.

Program Mission…

The CDF program is an evolution for the way DoD programs, services, and combat support agencies access data by providing data consumers (e.g., systems, app developers, etc.) with a “one-stop shop” for obtaining ISR data. The CDF significantly increases the DI2E’s ability to meet the ISR needs of joint and combined task force commanders by providing enterprise data at scale. The CDF serves as the scalable, modular, open architecture that enables interoperability for the collection, processing, exploitation, dissemination, and archiving of all forms and formats of intelligence data. Through the CDF, programs can easily share data and access new sources using their existing architecture. The CDF is a network and end-user agnostic capability that enables enterprise intelligence data sharing from sensor tasking to product dissemination.

Responsibilities...

Primary responsibility is to work with data providers within the IC and DoD Enterprise to identify and ingest data sets into the CDF data broker. In this role you will:

  • Develop, optimize, and maintain data ingest flows using Apache Nifi and Python.
  • Develop within the components in the cloud platform, such as Apache Kafka, NiFi, and HBase.
  • Communicate with data owners to set up and ensure CDF streaming and batching components are working (including configuration parameters).
  • Document SOP related to streaming configuration, batch configuration or API management depending on role requirement.
  • Document details of each data ingest activity to ensure they can be understood by the rest of the team

What we’d like to see…

  • A minimum of 3 years of experience with programming and software development including analysis, design, development, implementation, testing, maintenance, quality assurance, troubleshooting and/or upgrading of software systems
  • DoD 8570 IAT Level II Certification (e.g. Security+)
  • Demonstrable CentOS command line knowledge
  • Working knowledge of web services environments, languages, and formats such as RESTful APIs, SOAP, FTP/SFTP, HTML, JavaScript, XML, and JSON
  • Understanding of foundational ETL concepts
  • Experience implementing data ignorations with in the IC DoD Enterprise.

Desired Skills:

  • Experience or expertise using, managing, and/or testing API Gateway tools and Rest APIs (desired)
  • 2+ Experience in Python Development
  • Experience or expertise configuring an LDAP client to connect to IPA (desired)
  • Advanced organizational skills with the ability to handle multiple assignments
  • Strong written and oral communication skills

Years of Experience: Junior Level (0-4 years),Mid Level (5-8 years), Senior Level (9+)

Education: Bachelor's degree in systems engineering, computer engineering, or a related technical field (preferred)

Location: Chantilly, VA

Clearance: Active TS/SCI w/ ability to obtain CI Poly




Please Note :
blog.nvalabs.org is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, blog.nvalabs.org provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, Site.com is the ideal place to find your next job.