This job is closed
Small

Data Engineer: Big Data

IBM

Job 2 - 5 years Fill 66 Pune (Maharashtra)
Be involved in data engineering activities like Creating pipelines / workflows for Source to Target etc. Responsibilities: You will be involved in the Azure Data platform implementation. Willing to work in shift timings 2PM to 11PM Responsible for assessing feasibility of migrating customer solutions and/or integrating with 3rd party systems both Microsoft and non-Microsoft platforms Designing and developing Data Pipelines for Data Ingestion or Transformation using Python (PySpark)/Spark SQL Work with version control GitHub and CI/CD pipelines using Azure DevOps If you thrive in a dynamic, collaborative workplace, IBM provides an environment where you will be challenged and inspired every single day. And if you relish the freedom to bring creative, thoughtful solutions to the table, there s no limit to what you can accomplish here. Required Technical and Professional Expertise Total Years of Experience 5 years in IT industry 2 years current and deep experience with Azure Data platform implementation. Proven experience managing projects through the entire project lifecycle. Relevant years of experience 2 years in Azure Data Factory, Azure Data Lake, Azure DevOps, Azure DataBricks, AzureSQL Proficient in Azure Data Integration, Azure Data Architecture Proven experience using the Microsoft Azure Data Stack (ADFv2, Azure SQL DB, Azure SQL Datawarehouse, Azure Data Lake, Azure Databricks, Analysis Services, Cosmos DB) Experience in Azure data migration patterns Experience in Python, C# is mandatory Agile methodology experience essential 3 years experience assessing feasibility of migrating customer solutions and/or integrating with 3rd party systems both Microsoft and non-Microsoft platforms Hands on experience Designing and developing Data Pipelines for Data Ingestion or Transformation using Python (PySpark)/Spark SQL Preferred Technical and Professional Expertise AZ 900 - Azure Fundamentals DP 200, DP 201, DP 203, AZ 204 - Data Engineering AZ 400 - Devops Certification You love collaborative environments that use agile methodologies to encourage creative design thinking and find innovative ways to develop with cutting edge technologies Ambitious individual who can work under their own direction towards agreed targets/goals and with creative approach to work Intuitive individual with an ability to manage change and proven time management Proven interpersonal skills while contributing to team effort by accomplishing related results as needed Up-to-date technical knowledge by attending educational workshops, reviewing publications Experience working with version control GitHub and CI/CD pipelines using Azure DevOps
IBM is a global technology and innovation company headquartered in Armonk, NY. It is the largest technology and consulting employer in the world, with more than 375,000 employees serving clients in 170 countries. IBM offers a wide range of technology and consulting services; a broad portfolio of middleware for collaboration, predictive analytics, software development and systems management; and the world's most advanced servers and supercomputers. Utilizing its business consulting, technology and R&D expertise, IBM helps clients become "smarter" as the planet becomes more digitally interconnected. IBM invests more than $6 billion a year in R&D, and just completed its 22nd year of patent leadership. IBM Research has received recognition beyond any commercial technology research organization and is home to 5 Nobel Laureates, 9 US National Medals of Technology, 5 US National Medals of Science, 6 Turing Awards, and 10 Inductees in US Inventors Hall of Fame. The company was behind the inventions of the PC; SABRE travel reservation system; UPC codes, Watson, the Jeopardy!-playing computing system, and much more.

(Please upload a doc, docx or pdf file)

Please upload a pdf, doc, docx or txt document less than 2 MB in size.

By uploading your CV, you agree to ReferHire’s User Agreement and Privacy Policy

Similar Jobs View All Ic dropdown copy 4
Companies
Walk in - SAP Fiori

Mannlowe Information Services Pvt. Ltd.

Job 1 - 6 yrs Fill 66 Pune (Maharashtra)
Companies
Finance Functional Senior Consultant - Night Shift

AST LLC

Job 1 - 5 yrs Fill 66 Pune (Maharashtra)
Companies
Analyst, Configuration

Evolent Health

Job 2 - 7 yrs Fill 66 Pune (Maharashtra)