Are you passionate about joining a high-performance team where your work has a meaningful impact on people and processes? Do you thrive on efficiency and effectiveness? If you're seeking an opportunity to accelerate your career, then PureSoftware is the place for you!
Responsibilities
- Data Ingestion. Design and implement highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks.
- Proof of Concept. Deliver and present proofs of concept for key technology components to project stakeholders.
- Framework Development. Develop scalable and re-usable frameworks for ingesting and enriching datasets.
- Data Pipeline Integration. Integrate end-to-end data pipelines to ensure data quality and consistency from source systems to target data repositories.
- Event-Based Processing. Work with event-based/streaming technologies to ingest and process data.
- Project Collaboration. Collaborate with other project team members to support the delivery of additional project components such as API interfaces and search functionalities.
- Tool Evaluation. Evaluate the performance and applicability of multiple tools against customer requirements.
- Agile Methodology. Work within an Agile delivery/DevOps methodology to deliver proof of concept and production implementations in iterative sprints.
Must-Have Skills and Experience
- Data Management. Strong knowledge of data management principles.
- Experience. 5 to 10 years of total experience in building ETL/data warehouse transformation processes.
- Data Pipelines. Direct experience in building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).
- SQL. Proficiency with MS SQL RDBMS and SQL Query Language.
- Apache Spark. Experience using Apache Spark and associated design and development patterns.
- Azure Certification. Microsoft Azure Big Data Architecture certification is an advantage.
- Azure Technologies. Hands-on experience designing and delivering solutions using Azure Storage, Azure SQL Data Warehouse, Azure Data Lake.
- DevOps Environment. Experience working in a DevOps environment with tools such as Microsoft Visual Studio Team Services, Terraform, etc.
Life at PureSoftware
- Equal Opportunity Employer. At PureSoftware, we are committed to a diverse and inclusive workplace where everyone is valued. We embrace differences and foster a culture of growth, high performance, and innovation.
- Work-Life Balance. We value work-life balance and prioritize the well-being of our employees. Your career growth and development are important to us.
- Innovative, High-Performance Work Culture. Join a team dedicated to supporting each other's growth. We encourage knowledge sharing, mentorship, and provide learning opportunities to help you succeed.
Apply Now
If you're ready to make a difference in the world of technology and help our clients navigate their next digital transformation journey, PureSoftware is the place for you. Apply now and join us in shaping the future of technology.