Scribd
Upload
61 views

Data Engineer Job Description

The Data Engineer reports to the Chief Operations Officer and is responsible for building and improving distributed data systems, working with large datasets to improve data quality, supporting benchmarking systems and analyzing bottlenecks, scaling networks to handle thousands of concurrent events, troubleshooting operational issues, and collaborating with Product management. Requirements include a Bachelor's degree in Computer Science or a related field, experience building and managing distributed data infrastructure, knowledge of big data technologies like Hadoop or Spark, and experience with technologies such as Git, Storm, MySQL, Cassandra, MongoDB, Couchbase, Kafka, HBase, ElasticSearch, Docker, Kubernetes, Redis, RabbitMQ or Jenkins.

Uploaded by

sefdeni
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
61 views

Data Engineer Job Description

The Data Engineer reports to the Chief Operations Officer and is responsible for building and improving distributed data systems, working with large datasets to improve data quality, supporting benchmarking systems and analyzing bottlenecks, scaling networks to handle thousands of concurrent events, troubleshooting operational issues, and collaborating with Product management. Requirements include a Bachelor's degree in Computer Science or a related field, experience building and managing distributed data infrastructure, knowledge of big data technologies like Hadoop or Spark, and experience with technologies such as Git, Storm, MySQL, Cassandra, MongoDB, Couchbase, Kafka, HBase, ElasticSearch, Docker, Kubernetes, Redis, RabbitMQ or Jenkins.

Uploaded by

sefdeni
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 1

Data Engineer

Reports to: Chief Operations Officer

Responsibilities:

- Build distributed systems – work on improving and adding new functionality to Peg B distributed
systems backbone;
- Work with very large datasets and implement algorithms that improve the quality and
usefulness of our data assets;
- Support benchmarking systems, analyze system & query bottlenecks and propose solutions to
eliminate them;
- Scale the network – work on tuning and optimizing the delivery of various data sets in a network
with thousands concurrent events and unique data scalability challenges;
- Keep it running – help troubleshoot data systems and application operational issues.
- Work with Product management on understanding features.

Requirements:

- Bachelor’s Degree in Computer Science or another related field;


- Professional experience in building and managing data distributed systems infrastructure;
- Knowledge in Big Data processing technologies – either Hadoop or Spark;
- Experience with: Git (Bitbucket, GitHub);
- Knowledge in either: Storm, MySQL, Cassandra, MongoDB, Couchbase, Kafka, HBase or
ElasticSearch.
- Knowledge in either: Docker, Kubernetes, Redis, RabbitMQ or Jenkins.

You might also like