Position Overview: Data Engineer (2+ yrs) Our company is seeking to hire a skilled software developer to help with the development of our AI/ML platform. Your duties will primarily revolve around building Platform by writing code in Scala, as well as modifying platform to fix errors, work on distributed computing, adapt it to new cloud services, improve its performance, or upgrade interfaces. To be successful in this role, you will need extensive knowledge of programming languages and the software development life-cycle.

Responsibilities:  Analyze, design develop, troubleshoot and debug Platform  Writes code and guides other team members for best practices and performs testing and debugging of applications.

 Specify, design and implement minor changes to existing software architecture. Build highly complex enhancements and resolve complex bugs. Build and execute unit tests and unit plans.

 Duties and tasks are varied and complex, needing independent judgment. Fully competent in own area of expertise

Experience: The candidate should have about 2+ years of experience with design and development in Java/Scala. Experience in algorithm, Distributed System, Data-structure, databases and architectures of distributed System is mandatory

Required Skills: 1. In-depth knowledge of Hadoop, Spark architecture and its component such as HDFS, YARN and executor, cores and memory param

2. Knowledge of Scala/Java.

3. Extensive experience in developing spark job. Should possess good Oops knowledge and be aware of enterprise application design patterns.

4. Good knowledge of Unix/Linux.

5. Experience working on large-scale software projects

6. Keep an eye out for technological trends, and open-source projects that can be used.

7. Knows common programming languages Frameworks

Good to have: 1. Azure Cloud Knowledge of Data Storage and Compute side 2. Brief idea of Data Science