Hadoop Developer
Bangalore, Chennai, Cochin, Hyderabad, Trivandrum
Posted 3 years ago
Role
Hadoop Developer
Job Location
Trivandrum / Cochin / Bangalore / Chennai / Hyderabad
Experience
4-8 years
Brief Job Description
- Willingness to learn additional technologies as this project requires mixed skillset
Experience working in Agile model (fast paced development with short development and release cycles; devops concept wise (not tech tools) - Hadoop development
- Secondary Technologies to have/or to learn for this project (at least learn one from below)
- Python basics
- Spark (pyspark) basics.
- Pyspark streaming ingestions consuming kafka – basics.
- Mainframe source analysis / research
Job Requirements
- 4 – 8 years as Hadoop Developer
- Developer level – min 4 years exp in IT with 1 year minimum experience in Hadoop
Mandatory Technologies to have/or to learn for this project - Hadoop – HDFS; mapreduce; tez
- Hive (intermediate level) – Eg. should write UPSERT incremental load logic without hiccups; good practical familiarity of windowing functions. SCD type 2 load techniques (optional)
- Sqoop
- SQLs (intermediate to complex)
- Scheduling techniques (CA Automic basics)
- Unix scripting basics