Job Description

Position - Python - Data Engineer

Location - Bangalore(Hybrid)

Position Purpose

As a Data Engineer, you will focus on building and implementing advanced analytics solutions that drive valuable insights to our client partners and maximize business value. You will develop processes to manage data at rest and in motion for all analysis processes needed by the Analytics Team. You will help operationalize the analytics platforms aimed at improving our ability and understanding of the customer experience and business drivers.

Responsibilities

Responsible for Ingesting data from files, streams and databases. Process the data with Python and Pyspark and its storage into a time series database.
Develop programs in Python as part of data extraction, data cleaning, transformation and processing.
Develop and maintain scalable data pipelines.
Rest API's development.

Mandatory Skills

Experience as a Data Engineer.

Advanced working SQL knowledge to create complex queries.
Experience in working with Time - series Database, relational databases as well as working familiarity with a variety of databases (structured Unstructured).
Hands On experience on visualization tools like Grafana Power BI.
Experience in designing and implementing scalable architecture.
Good experience in doing object - oriented programming in python.
Very strong in Object Oriented Analysis and Design (OOAD).
Strong knowledge on REST APIs.
Experience working on Azure Cloud services IaaS, PaaS.
Hands on Experience in working on Microsoft Azure Services like ADLS/Blob Storage solutions, Event Hubs, Service Bus, scale sets, Load Balancers, Azure Functions, Databricks.
Hands on Experience in working on Kafka.
Knowledge on continuous integration/continuous deployment.
Experience of data migration and deployment from On - Prem to Cloud environment and vice - versa. - Individual Contributor.

Nice - To - Have Skills

Certification on any cloud platform.
Hands on experience on Docker Containers and micro services architecture using Kubernetes.
Hand on experience in Golang programming.