Spark Developer

Ikya Human Capital Solutions Pvt Ltd
  • Bangalore, Hyderabad
  • 10-15 lakh
  • 3-8 years
  • Views
  • 06 Jun 2017

  • IT/ Information Technology

  • IT/ Technology - Software/ Services
Job Description

The Data and Analytics organization is the DNA of the company. The DNA encodes the essence of existence and character that drives continuous innovation with data, continuous insights with analytics and continuous evolution with cutting-edge data products and services. Our vision is to be the trailblazer in Connection Science driven information services that create meaningful value for our customers. Our mission is to enable cutting-edge data products & services delivered through superior data, unique insights and top-of-the-class technology solutions. We believe in developing a Collaborative, Creative, yet Competitive, Customer Centric culture. We are shaping the present and the future at Neustar and are seeking TENXERS who share the same DNA.
Job Description:
The Senior Engineer of DNA Spark is a data and technical leader responsible to design and develop the next generation of data processing on Hadoop/ Spark platform. The technical leader in this role will work closely with various teams including data acquisition, data products & data sciences to build the web services platform exposing these services to the end customers. The role is based out of India in either Bangalore or Hyderabad. This role will report to the Director of Data and Analytics.
Responsibilities:
Leading the team, designing and developing the data processing & ML code on Spark.
Prototype and program data transformations and entity resolutions on petabyte-scale data on Hadoop/ Spark clusters.
Understand the data patterns and design and implement the code and debug ML models for entity resolution in Spark. Work on Spark code performance improvement.
Run along the cutting edge with an all-star lineup of experts in computer science, software engineering, marketing science, operation research and marketing strategy.
Skills and Experience:
Bachelors degree in computer science or engineering discipline (master degree preferred)
2+ years of experience in the data, analytics and sciences domain with significant hands on experience
Adept at data architecture, data platforms and ecosystem tools, technologies and applications. Experience with the latest data and digital ecosystem related to marketing, advertising, security, internet of things and related domains is a plus
Adept in the use of big data, business intelligence and analytics with significant past deliveries and achievements using SQL, Map-Reduce, Spark and other distributed computing frameworks including cloud (AWS, Azure etc.)
Adept at data pre-processing, complex data transformations using ETL/ELT technologies and SQL as well as NOSQL technologies, relational as well as graph databases and data API frameworks to query data off these databases
Good hands-on programing skills in Java, Python and Scala.
Fast executor with a track record of delivering complex projects on time; responds under pressures of time and uncertainty
Hands on experience with continuous integration and continuous deployment tools including Chef, Jenkins etc.
Strong written, editing, proofreading and oral communication
Strong inter-personal communication and collaboration skills


Job Posted By