Let's get you started
Data Engineer Big data
BluePi1 - 4 years Gurgaon (Haryana)
Solve complex business problems involving Tera Bytes of data Write performant code to extract, transform and load data Integrate and process data in batch and in realtime Work with domain experts in delivering a high-quality solution in an agile environment Discuss, debate and develop complex architectures Follow internal processes while working on the tasks/projects like Creating LLDs Honouring the estimated timelines Clear and quick articulation of dependencies and roadblocks Highlighting any exception or technical debt Work in collaboration of peers internal and external(customer) Must-Have Skills- On day one we ll expect you to Write performant, clean code in pySpark for batch and/or realtime pipelines Have an in-depth understanding of pySpark APIs to follow the best practices and write performant code Integrate with different source systems to extract data like on-prem/cloud databases, website clickstream, SAP. Understand the scope, design and business objective of the project Own and execute the task, helping the team members as the project progresses Run and build ETL on AWS environment. Hence need an in-depth knowledge of AWS. Understand the Lower Level Designs and convert it into correct estimates. Create design documents for the tasks along with clarity of test cases Speak to the team for questions or integrations. Thus decent communication skills are required Perform exhaustive debugging and provide a solution-oriented approach to a problem Good to Have skills - Added bonuses if you have Knowledge of AWS Knowledge of SQL Knowledge of any other language apart from python - Java or Scala
We are a team of Dreamers, Innovators, Technology Experts and above all Explorers with a focus on creating value for our clients, while having fun on the way.Founded by four technologists 3 years back, BluePi is now 65 people strong. We are born in the cloud and focus on greenfield application development and consulting. We are consulting partner with AWS and IBM Bluemix.Our technical forte includes Data science, analytics, web development, native/hybrid mobile app development.