From 2fdd121a1921527859fe0e50ee5a0b22e573bf1a Mon Sep 17 00:00:00 2001 From: Deepankar Agrawal Date: Tue, 11 Jan 2022 20:54:13 +0530 Subject: [PATCH] add JD: platform data engineer --- engineering/platform-data-engineer.md | 43 +++++++++++++++++++++++++++ 1 file changed, 43 insertions(+) create mode 100644 engineering/platform-data-engineer.md diff --git a/engineering/platform-data-engineer.md b/engineering/platform-data-engineer.md new file mode 100644 index 0000000..de92a70 --- /dev/null +++ b/engineering/platform-data-engineer.md @@ -0,0 +1,43 @@ +--- +authors: deep110 +groups: platform +teams: [engineering-platform] +level: [L2, L3] +active: true +draft: false +--- + +# Platform Data Engineer + +We are looking for a experienced Data Engineer to join our platform team. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The Data Engineer will support our software developers and database architects, and will ensure data delivery architecture is consistent throughout ongoing projects. + + +## Responsibilities + +- Create and maintain optimal data pipeline architecture +- Assemble large, complex data sets that meet business requirements. +- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability +- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. +- Keep our data separated and secure across national boundaries through multiple data centers and AWS regions. + + +## Requirements + +- 2+ years of Experience +- Experience with big data tools: Spark, Kafka, etc. +- Experience building and optimizing 'big data' data pipelines, architectures and data sets. +- Advanced working SQL knowledge and experience working with relational databases like PostgresSQL +- Working knowledge of message queuing and stream processing systems like Storm, Spark-Streaming, etc. +- Experience with scripting languages like Python + + +## Our Team + +Our team of engineers and researchers work on building our voice bot, VIVA, and +an advanced speech conversational platform for large scale enterprises. VIVA +goes beyond run-of-the-mill voice bots by exploiting features and behaviors that +come from a deep understanding of shades of human-machine speech dialogs. + +We believe in open innovation and you can check out our work on github [here](https://github.com/skit-ai), and +our tech website [here](https://tech.skit.ai/). You can also follow our [tech handle on twitter](https://twitter.com/SkitTech/) to know +what we are up to these days.