Data Engineer

Job Description

Minimum Qualifications:

● Bachelor’s Degree or working towards a bachelor’s degree in Computer Science or a related field

● 5+ Years of working experience as Software Engineer

● Willing to work with distributed teams in different time zones and offshore teams

● Ability to adapt quickly to new projects and technologies

● Experience with programming in languages like Java, Python, and scripting tools like Bash, KSH

● Strong SQL skills and good understanding of RDBMS systems

● Experience with Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)

o HDFS

o Hive

o Yarn

o File formats like Avro/Parquet

o Kafka

o Spark

o Spark Streaming

● Good aptitude, strong problem-solving abilities, and analytical skills, ability to take ownership as appropriate

● Should good understanding for coding, debugging, performance tuning, and deploying apps to a Production environment

● Understanding of Agile Development methodologies

● Experience with version control technologies like GIT

● Excellent verbal skills

● Ability to work with clients to understand requirements and business needs

● Ability to independently find solutions and fixes to problems

● Drive and passion to learn new things

Nice to Have:

● Experience working on cloud platform e.g., GCP, AWS, Azure

● Experience working on containerization technologies e.g., docker, Kubernetes