




Position Summary :Data Engineer is responsible for development and support of Data pipelines required for Data Science and Analytical use case Key responsibilities include: - Understanding business analytical and data science requirements, design the data pipelines and build them with optimum solutioning - Integration of heterogeneous sources into Data Lake and Data Warehouse - Savvy in writing complex SQL's and expanding DW with latest technology advancements - Manage live code and resolve if issue do occur - Experience in orchestrating data pipeline, code deployments and automation - Experience in productivity tools such as Jira, Confluence
Key Responsibilities :1. Develop end to end data pipelines using best in class technologies on serverless concepts 2. Experience in data life cycle management - development & testing 3. Experience in advance SQL concepts and have delivered successful projects 4. Experience in managing deployment using CI/CD and code management on likes of GIT 5. Experience in managing structured and unstructured high-volume data to solve complex analytical problems 6. Experience on productivity tools like Jira & Confluence7. Exposure on Agile way of working 8. Exposure in providing analytical solutioning on products like Tableau, Power BI, Web Reporting
Essential Requirements :1. Database - SQL, No SQL and DW Designs - Columnar/Row Level Storage 2. Data Pipelines - Python, Spark, Databricks etc 3. Cloud - AWS, GCP - preferred to have one with experience on AWS 4. Orchestration - Cron, Airflow 5. Reporting - Tableau, PowerBI, Django framework 6. Code Management - GitHub, GitLab 7. Cloud Framework - Kubernetes, Docker setups 8. Monitoring - Prometheus, Grafana, Kibana, OpsGENIE 9. Jira & Confluence 10. Sound understanding on two of three skill set. - SQL, Python & Cloud
