Full-time

Data Streaming Engineer

Posted on 30 September 24 by Matt Owens

  • Scottsdale, AZ
  • $160000 - $180000 per Hour
Logo

Powered by Tracker

Job Description

Title: Data Streaming Engineer
Location: Scottsdale, AZ

We are seeking a Data Streaming Engineer specializing in Distributed Systems to design and build software for distributed systems management. This role involves developing internal automation scripts, system software for component interaction and management, and infrastructure for data streaming and publish/subscribe architectures. You will play a pivotal part in defining our client’s technological future.


Your role:

  • Manage and enhance scripts for RSIM, the company’s optimization engine.
  • Lead the selection, deployment, and ongoing support of a new data streaming platform.
  • Contribute to and maintain stream-based data pipelines.
  • Provide training and support to developers.

 


What you’ve got:

  • Minimum of 3 years of hands-on experience in developing or managing distributed systems.
  • A bachelor’s degree in computer science, engineering, or a related field is preferred.
  • Proven expertise with at least one of the following: Apache Kafka, Google Pub/Sub, Amazon Kinesis, or Azure Event Bus, with Kafka preferred.
  • Proficiency in Unix-based systems, particularly Ubuntu Linux.
  • Strong understanding of data marshalling and inter-process communication protocols.
  • Familiarity with cloud infrastructure management (preferably GCP) and agile development tools (git and Atlassian suite).
  • Scripting expertise in languages such as Bash, Python, or Perl, with a preference for Python.
  • Knowledge of information security practices.
  • Experience with integration and performance testing.

 


Preferred Skills:

  • Windows system administration experience.
  • Proficiency in programming languages like C, C#, or Python.
  • Database management and data science experience.
  • Advanced knowledge in information security.

 


To find more great tech-centric jobs, please visit www.phoenixstaff.com.


 

Job Information

Rate / Salary

$160000 - $180000 per Hour

Sector

IT

Category

Not Specified

Skills / Experience

Not Specified

Benefits

Not Specified

Our Reference

JOB-6917

Job Location