Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add JD: platform data engineer #13

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
43 changes: 43 additions & 0 deletions engineering/platform-data-engineer.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
---
authors: deep110
groups: platform
teams: [engineering-platform]
level: [L2, L3]
active: true
draft: false
---

# Platform Data Engineer

We are looking for a experienced Data Engineer to join our platform team. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The Data Engineer will support our software developers and database architects, and will ensure data delivery architecture is consistent throughout ongoing projects.


## Responsibilities

- Create and maintain optimal data pipeline architecture
- Assemble large, complex data sets that meet business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.


## Requirements

- 2+ years of Experience
- Experience with big data tools: Spark, Kafka, etc.
- Experience building and optimizing 'big data' data pipelines, architectures and data sets.
- Advanced working SQL knowledge and experience working with relational databases like PostgresSQL
- Working knowledge of message queuing and stream processing systems like Storm, Spark-Streaming, etc.
- Experience with scripting languages like Python


## Our Team

Our team of engineers and researchers work on building our voice bot, VIVA, and
an advanced speech conversational platform for large scale enterprises. VIVA
goes beyond run-of-the-mill voice bots by exploiting features and behaviors that
come from a deep understanding of shades of human-machine speech dialogs.

We believe in open innovation and you can check out our work on github [here](https://github.com/skit-ai), and
our tech website [here](https://tech.skit.ai/). You can also follow our [tech handle on twitter](https://twitter.com/SkitTech/) to know
what we are up to these days.