The role data engineer includes:-
Develop programs to extract data from websites and APIs
Manipulate data and save it in a logical, organized manner
Analyze data to drive better business decisions
- Lead HR operations for the company.
- Individual will engage and consult founders and business leaders to enable and impact business success through people function.
- Build a learning culture to help up skill the resources to take up newer and larger roles. Analyzes data and documentation to evaluate and influence employees and management regarding employee relations.
- Contributes to development of company objectives and principles to achieve goals in creative and effective ways.
Fluency in Python
1+ years experience with any web scraping tools such as Scrapy, BeautifulSoup, Selenium, cURL, Kapow, Mozenda,
Experience with Relational and NO-SQL databases ie. SQL, Hadoop, Mongo
Should have used an asynchronous processing system (Celery, etc)
Experience with XML, JSON and Proto-buffers
Be comfortable in finding your way around a Linux serverâ€¨
Prior exposure to web scraping is a plus.