Data Engineer - Azure Databricks/DataLake (7-10 yrs) (Softtech Career Infosystem Pvt. Ltd.)

Job Description :

- Heavy Azure. Azure Azure Azure/SQL

- 7+ years IT experience including 2 - 4 years showing success as a technical lead in a Big Data or Data Warehousing Environment.

- Significant depth of expertise and track record of accomplishments in multiple IT technology areas.

- Experience utilizing any of the following: Azure (Data Factory, Data Lake, Machine Learning, SQL Warehouse, Data Bricks), SAP Business Warehouse, Power BI, Business Objects (WEBI, Data Services, Excel Analysis)

- Real-Time Data Analytics

- Creating Data Hubs in Azure

- Streaming Data - most preferably from Ecommerce Platform

- Getting Info Azure Data Lake - Generation 1 or 2

- Analytics in a custom data hub creating dashboards in Azure

- Data Services from Data Lake

- Bonus if you have API integration with Salesforce

Responsibilities :

- Experience Architecting/Engineering multiple event-based analytic data pipelines for Web Commerce Applications

- Experience with streaming analytic tools like Azure Event Hubs, Mulesoft, and Logic Apps

- Experience building real-time data pipelines from data lake to warehouses and dashboards

- Experience with tools like Azure Data Factory, Azure Data Bricks

- Experience Architecting Data Hubs for MDM, Machine Learning, and Analytics Applications

- Experience with Datahub platforms like MarkLogic or Azure Data Lake (Gen 1 or Gen 2)

- Experience providing feature pipelines for Machine Learning solutions such as recommendation engines and behavioral modeling

- Experience with SQL databases and NoSQL Databases (Azure Cosmos DB)

- Experience integrating MDM services into data hub platforms Experience building microservices for integration of data hubs to applications such as CRM

- Experience building services for Salesforce

Education : Bachelors

Skills :

- Azure

- Databricks

- SQL Database experience.

- Mulesoft

- Data Analytics

Apply Now