Skip to main content

Assistant Manager - Data Engineering

Job ID:
R-22514
Category:
Data & Analytics
Location:
Bengaluru, Karnataka
Date posted:
11/03/2021

Job Title: Assistant Manager - Data Engineering

Location: UniOps Bangalore

Roles and Responsibilities

  • Proficient in Developing modern ETL Pipelines in Azure Data Factory with knowledge of data flows and connecting data connectors.

  • Implementation of SCD Using Mapping Data Flows. Proficient in Databricks with knowledge of Delta Lake and its Implementation using Azure Data Lake.

  • Integrating Azure Services through Azure Authorization and Account Management.

  • Proficient in Azure Dev-ops with knowledge of Azure Boards, Pipeline and Artifacts.

  • Integration of Power BI and Other reporting tools with Azure Storage Services. Developing Dynamic SQL function and Stored Procedure in SQL Data warehouse. Strong in data Governance, including Master Data Management (MDM) and Data Quality tools and processes Ensure IT security and data privacy controls are in place across the data platform Develop / Extend API's to and from the data platform by means of Java/Spring Convert Databricks PY-Spark notebooks with data science code to production code in Scala Contribute to the definition of the architecture of the data lake using Microsoft Azure Cloud technologies Experience with working in Agile / Scrum

Qualification:

  • Professional with minimum of 4 years of hands-on experience in Business Intelligence and Azure Stack.

  • Understands Data Enterprise Management Systems with knowledge of Data Governance and Metadata data management.

  • Experience in Implementation with Data Lake/Datawarehouse with Data modelling and Schema Design.

  • Knowledge with Data Visualization tools like Power Bi will be a great plus.

  • Knowledge of Python/Scala will be an advantage.

Skills Required:

  • Strong team player capable to work harmoniously with a team locally and remotely

  • Exceptional communication skills, capable to express complex topics in a concise and abstract manner

  • Experience working extensively in data environment

  • Exceptional Problem solving and analytical skills.

  • Experience in engineering large-scale systems in a product environment

  • Ability to write, analyse, and debug SQL queries

  • Knowledge of database modelling, ETL and design in a Data warehousing context

  • Knowledge of NoSQL stores is a plus

  • Ideal candidates will have a deep understanding of technical and functional designs for Databases, Data Warehousing, Reporting, and Data Mining areas

  • Passion for about continuous learning, experimenting, applying and contributing towards cutting edge open-source Big Data technologies and software paradigm.

Technical skills required: The data engineer needs to be proficient in:

  • Airflow / Azkaban / Azure data factory

  • Bug fixing

  • CI / CD concepts including Agile/Scrum

  • Command line / Bash

  • Docker

  • Git

  • Java Spring Boot

  • Java Streams

  • Kubernetes

  • Maven

  • SQL

  • PySpark

  • PyTest

  • SBT

  • Scala

  • ScalaTest

  • Spark Datasets

Join our talent network

Do you want to stay informed of new roles and programmes, receive interesting updates and relevant content? Then become part of our Unilever talent community so you know what’s going on when.

Join now

Sign up for job alerts

Make sure you see job opportunities when they become available. Just leave a few details below to stay up to date with jobs that suit you and your skills.

Interested InSelect a job category from the list of options. Select a location from the list of options. Finally, click “Add” to create your job alert.

Connect with us

We’re always looking to connect with those who share an interest in a sustainable future.

Contact us

Get in touch with Unilever PLC and specialist teams in our headquarters, or find contacts around the world.

Contact us