Join our team as a Senior Data Engineer proficient in Kafka development, tasked with constructing the strategic data exchange system between lending core systems and associated platforms. As a member of the DataGen squad within the WB Tribe Lending, your primary responsibility will involve orchestrating data delivery processes to internal lending applications, the wholesale bank data lake, and ensuring compliance with regulatory requirements.
Responsibilities
Your role is pivotal in shaping our ambitious lending data platform, facilitating high-quality, real-time data availability. Transitioning from batch processing to real-time streams, you'll empower seamless data consumption to address evolving client and regulatory demands. Collaboration is key, as you'll design and implement this exchange, fostering synergies with other squads to achieve end-to-end delivery across multiple tribes. Embracing Agile principles, self-organization, and craftsmanship, you'll play a vital role in sculpting the future of our data ecosystem.
Mandatory Skills
We seek an individual with a collaborative mindset, possessing mature problem-solving abilities and a proactive attitude. Effective communication and teamwork are essential, along with a willingness to mentor and guide fellow developers. Remaining abreast of industry trends and corporate dynamics is crucial.
Technical expertise includes
- Agile / Scrum methodology
- Extensive experience in building large-scale corporate systems
- Proficiency in Kafka, particularly within the Confluent framework
- Kafka Connect and Schema Registry
- Kafka SQL (KSQL) and Kafka Streaming API
- Data integration techniques
- Java backend development (Java 8,11)
- Oracle RDBMS and SQL (11g or higher)
- Data modeling
- Linux (bash) scripting
Nice-to-Have Skills
- CI/CD tooling: Azure DevOps, Maven, CheckMarx, Git, Ansible
- Database Change Data Capture
- Visualization tools: Grafana, Elastic, Kibana
- Oracle Data Integrator 12c
- Experience in complex corporate environments
- Background in lending and financial systems
- Proficiency in issue tracking systems like JIRA and ServiceNow
- Collaboration tools such as Confluence
- Ansible proficiency
Languages
- Proficiency in English (C2 level)
If you're passionate about shaping a future where data processing is predominantly streaming-based, unafraid of tackling complexity, and enjoy developing intricate components in Java, we encourage you to apply and be part of our dynamic team driving innovation in lending data management.