As a Data Engineer, you will be a key player in designing, developing, and maintaining robust data solutions. Your role involves creating data pipelines, ensuring data quality, and implementing ETL (Extract, Transform, Load) processes to manage and deploy data across various systems. This role demands strong technical expertise in Python and experience with data engineering tools and practices.
Key Responsibilities
- Design & Development. Design and develop comprehensive data solutions to support data generation, collection, and processing.
- Data Pipelines. Create, maintain, and optimize data pipelines to ensure efficient and reliable data flow.
- ETL Processes. Implement ETL processes for effective data migration and deployment across systems.
- Collaboration. Work closely with cross-functional teams to understand data requirements and provide technical guidance.
- Data Quality. Ensure data quality and integrity through validation, cleansing, and optimization techniques.
- Issue Resolution. Troubleshoot and resolve data-related issues, providing technical support as needed.
- Innovation. Stay updated with industry trends and best practices to continually enhance data engineering solutions.
- Mentorship. Train and mentor junior data engineers to build team capabilities and knowledge.
Must-Have Skills
- Python. Proficiency in Python programming for developing and maintaining data solutions.
- Databricks. Experience with Databricks Unified Data Analytics Platform for data management and analysis.
- PySpark. Practical knowledge of PySpark for big data processing.
- Statistical Analysis. Strong understanding of statistical analysis and machine learning algorithms.
- Data Visualization. Experience with tools such as Tableau or Power BI for data visualization and reporting.
- Machine Learning. Hands-on experience with implementing machine learning algorithms, including regression and clustering.
- Data Munging. Solid grasp of data cleaning, transformation, and normalization techniques.
Preferred Skills
- Data Engineering Tools. Familiarity with additional data engineering tools and platforms.
- Industry Trends. Awareness of emerging technologies and best practices in data engineering.
Additional Information
- This position is based at our Bengaluru office.
- A minimum of 3 years of relevant experience in Python is required.
- Candidates should have completed 15 years of full-time education.
If you are a skilled Data Engineer with a passion for data solutions and a strong foundation in Python and data engineering tools, we encourage you to apply and be part of our dynamic team.