The Data Engineer’s primary role is working within a very dynamic team, this role must help elevate the team’s quality. The Data Engineer will work closely with Data Analysts, Data Scientists, and business and technical teams to deliver secure, reliable, fault-tolerant, scalable, quality, and efficient outcomes.
KEY RESPONSIBILITIES
Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)
Build high-quality data pipelines using Spark/Scala
Implement best software engineering practices, including Git version control, code reviews, and unit testing
Collaborate with data scientists and architects to deliver top-notch data solutions
Debug and troubleshoot issues in data pipelines and other data systems
EDUCATION
Bachelor's degree in Engineering, Bachelor’s in Computer applications or Master’s in Computer Applications
SKILLS AND KNOWLEDGE
3+ years of experience in software engineering
Strong proficiency in Spark and Scala
Strong communication and interpersonal skills
Familiarity with Git and unit testing frameworks
Excellent problem-solving skills
GOOD TO HAVE
Previous experience in a Data Engineering role
Knowledge of Informatica or similar ETL tools
Experience with cloud platforms like AWS, Azure, or GCP