More  Posts
Data Engineer - Python/Spark @Service Lee Technologies Pvt.Ltd., Mumbai, Maharashtra, India
Posted in Naukri
3-6 Yrs Exp.

Position Summary :Data Engineer is responsible for development and support of Data pipelines required for Data Science and Analytical use case Key responsibilities include: - Understanding business analytical and data science requirements, design the data pipelines and build them with optimum solutioning - Integration of heterogeneous sources into Data Lake and Data Warehouse - Savvy in writing complex SQL's and expanding DW with latest technology advancements - Manage live code and resolve if issue do occur - Experience in orchestrating data pipeline, code deployments and automation - Experience in productivity tools such as Jira, Confluence


Key Responsibilities :1. Develop end to end data pipelines using best in class technologies on serverless concepts 2. Experience in data life cycle management - development & testing 3. Experience in advance SQL concepts and have delivered successful projects 4. Experience in managing deployment using CI/CD and code management on likes of GIT 5. Experience in managing structured and unstructured high-volume data to solve complex analytical problems 6. Experience on productivity tools like Jira & Confluence7. Exposure on Agile way of working 8. Exposure in providing analytical solutioning on products like Tableau, Power BI, Web Reporting


Essential Requirements :1. Database - SQL, No SQL and DW Designs - Columnar/Row Level Storage 2. Data Pipelines - Python, Spark, Databricks etc 3. Cloud - AWS, GCP - preferred to have one with experience on AWS 4. Orchestration - Cron, Airflow 5. Reporting - Tableau, PowerBI, Django framework 6. Code Management - GitHub, GitLab 7. Cloud Framework - Kubernetes, Docker setups 8. Monitoring - Prometheus, Grafana, Kibana, OpsGENIE 9. Jira & Confluence 10. Sound understanding on two of three skill set. - SQL, Python & Cloud

More  Posts
Feedback