Join our team at Puresoftware, a leading Product and IT Services Company, where innovation meets opportunity. We're currently seeking a talented Data Engineer to join us in either a remote capacity or at our Bangalore location. If you're passionate about leveraging cutting-edge technologies to drive impactful solutions, this role is for you!
Responsibilities
-
Design and Implementation. Lead the design and implementation of highly performant data ingestion pipelines from multiple sources, utilizing tools like Apache Spark and Azure Databricks.
-
Proof of Concept. Deliver and present proofs of concept of key technology components to project stakeholders, showcasing the potential impact and feasibility of proposed solutions.
-
Framework Development. Develop scalable and reusable frameworks for ingesting and enriching datasets, ensuring efficiency and maintainability.
-
End-to-End Pipeline Integration. Integrate end-to-end data pipelines, ensuring data quality and consistency as data flows from source systems to target data repositories.
-
Event-Based Processing. Work with event-based and streaming technologies to ingest and process data in real-time, enabling timely insights and actions.
-
Collaboration. Collaborate with other project team members to support the delivery of additional project components such as API interfaces and search functionalities.
-
Tool Evaluation. Evaluate the performance and applicability of multiple tools against customer requirements, ensuring optimal technology choices for each project.
-
Agile Delivery. Work within an Agile delivery and DevOps methodology, delivering proof of concept and production implementations in iterative sprints, fostering a culture of continuous improvement and adaptation.
Qualifications
-
Data Management. Strong knowledge of Data Management principles, with 5 to 10 years of total experience in the field.
-
ETL Expertise. Direct experience in building ETL/data warehouse transformation processes, with proficiency in tools like Azure Data Factory and Apache Spark (preferably Databricks).
-
SQL Proficiency. Hands-on experience with MS SQL RDBMS and SQL Query Language, along with advanced working knowledge of SQL and relational databases.
-
Big Data Technologies. Experience using Apache Spark and associated design and development patterns, along with certifications in Microsoft Azure Big Data Architecture being advantageous.
-
Cloud Experience. Hands-on experience designing and delivering solutions using Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, and familiarity with DevOps tools like Microsoft Visual Studio Team Services and Terraform.
About Puresoftware
Puresoftware partners with global organizations across various verticals, including Financial Services, Life Sciences & Healthcare, Telecom & Semiconductors, Retail & Logistics, and Entertainment. We deliver differentiated customer experiences, accelerate cycle times, and help customers achieve business outcomes through innovative digital technologies.
Our flagship product, 'Arttha', is a rapidly growing financial platform adopted by more than 50 banks and financial institutions. We continuously invest in creating innovative products and platforms to stay ahead of the curve and create value for our customers.
Join Us
If you're ready to make an impact, drive innovation, and be part of a dynamic team, apply now to join Puresoftware as a Data Engineer. Take your career to new heights and be at the forefront of digital transformation in the industry. We look forward to welcoming you aboard!