Senior Data Engineer

Back to Jobs

Job Description

STRATEGIC STAFFING SOLUTIONS (S3) HAS AN OPENING!

Strategic Staffing Solutions is currently looking for a Data Engineer IV, for one of its clients!!

Job Title: Senior Data Engineer
Location: Charlotte, NC
Setting: Hybrid/remote
Duration: 12 months
Test: Candidates must complete the Glider assessment to be considered for this role.
Time Zone: EST/CST
Candidates should be willing to work on our W2 ONLY. No C2C,No 1099, Candidate must be authorized to work for any employer without any sponsorship needs/No visa transfers.
Top Skills:
Apache Flink
AWS Lake Formation
Kubernetes
Python
Terraform
AWS Glue

Job Summary:

We are specifically looking for individuals with at least 5+ years of experience in Data Engineering and/or Software Engineering roles who can provide knowledge and support to our existing engineers.

Must have experience with similar platform engineering/management solutions:
Building/optimizing Data Lake House with Open Table formats
Kubernetes deployments/cluster administration
Transitioning on-premise big data platforms to scalable cloud-based platforms like AWS
Distributed Systems, Microservice architecture, and containers
Cloud Streaming use cases in Big Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis)
Must have experience with the below tech stack:
GitHub Hib and GitHub Actions
AWS
o       IAM
o       API Gateway
o       Lambda
o       Step Functions
o       Lake formation
o       EKS & Kubernetes
o       Glue: Catalog, ETL, Crawler
o       Athena
o       Lambda
o       S3 (Strong foundational concepts like object data store vs block data store, encryption/decryption, storage tiers etc)
Apache Hudi
Apache Flink
PostgreSQL and SQL
RDS (Relational Database Services).
Python
Java
Terraform Enterprise
o       Must be able to explain what TF is used for
o       Understand and explain basic principles (e.g. modules, providers, functions)
o       Must be able to write and debug TF
Helpful tech stack experience would include:
Helm
Kafka and Kafka Schema Registry
AWS Services: CloudTrail, SNS, SQS, CloudWatch, Step Functions, Aurora, EMR, Redshift, Iceberg
Secrets Management Platform:  Vault, AWS Secrets manager
Core Responsibilities and Soft Skills

Provides technical direction, engage team in discussion on how to best guide/build features on key technical aspects and responsible for product tech delivery
Works closely with the Product Owner and team to align on delivery goals and timing
Collaborates with architects on key technical decisions for data and overall solution
Lead design and implementation of data quality check methods
Ensure data security and permissions solutions, including data encryption, user access controls and logging
Be able to think unconventionally to find the best way to solve for a defined use case with fuzzy requirements.
Willing to do their own research to solve problems and can clearly present findings and engage in conversation on what makes one solution better than another
Thrive in a fail-fast environment, involving mini PoCs, and participate in an inspect and adapt process.
Questioning and Improvement mindset
Must be ready to ask questions about why something is currently done the way it is and suggest alternative solutions
Customer facing skills
Interfacing with stakeholders and other product teams via pairing, troubleshooting support, and debugging issues they encounter with our products

“Beware of scams. S3 never asks for money during its onboarding process.”

Job Information

Rate / Salary

$0.00 - $0.00

Sector

Energy