Centurion is looking for an on site Sr Data Engineer with a Top Secret in Huntsville, AL.
Ever-expanding technology like IoT, machine learning, and artificial intelligence means that theres more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when its gathered from disparate sources. We need an experienced data engineer like you to help our clients find answers in their data to impact important missions from fraud detection to cancer research, to national intelligence.
As a Data Engineer, youll help build advanced technology solutions and implement data engineering activities on some of the most mission-driven projects in the industry. Youll deploy and develop pipelines and platforms that organize and make disparate data meaningful.
Here, youll work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. Youll use your experience in analytical exploration and data examination while you manage the assessment, design, building, and maintenance of scalable platforms for your clients.
Qualifications
- 5+ years of experience designing data warehouse or data lake, RESTful API models, event processing, or business intelligence for software systems
- 5+ years of experience building scalable ETL or ELT data pipelines, automating large-scale batch and streaming data workflows, and parsing structured, unstructured, or event-streaming data
- 5+ years of experience with coding in software programming languages, including SQL, Python, Scala, Spark, or Java
- Experience performing tuning on data lake architecture to optimize cloud storage and pipeline performance
- Experience with data management solutions that address aspects of data catalog, data usage, governance policies, and lifecycle management
- Top Secret clearance
- Bachelors degree and 8+ years of experience designing, developing, operationalizing, and maintaining data systems, or 12+ years of experience designing, developing, operationalizing, and maintaining data systems in lieu of a degree
Nice to Have Skills
- 3+ years of experience architecting and designing large-scale enterprise data and analytics systems
- 3+ years of experience using and developing data systems with AWS and Microsoft Azure cloud data products such as AWS EMR, AWS Glue, Azure Dataverse, Azure Data Factory, and Power Apps
- Experience with distributed data or computing tools, including Apache Spark, Apache NiFi, AirFlow, Databricks, Snowflake, Redshift, or BigQuery
- Experience with federal information system policies, including NIST 800.53 and FISMA, data security, access controls, and data protection techniques
- Experience creating and improving continuous automation across multiple technical stacks, and automating CD/CD pipelines with tools such as Jenkins or GitHub
- Experience with NoSQL database such as Elasticsearch, Solr, MongoDB, or Cosmo DB
- Experience with AI or ML pipelines and processes
- TS/SCI clearance with a polygraph
- Masters degree