Adobe is looking Sr. Software Engineer- Distributed Query Engr in San Jose, USA.
The opportunity
Our engineering team is responsible for scalable query engine on data platform which is the foundation for the Adobe Experience Cloud.? Adobe has dozens of petabytes of data to manage and bring value to our customers.? The query engine on data platform provides state-of-the-art capabilities for data query,?advanced analytics (segmentation, sessionization, customer journey, stitching and others) and integrates into machine learning services for predictive metrics.? We use Big Data and open source technologies (such as spark, presto, iceberg, airflow) to develop various services for Adobe Solutions, Customers and Partners.
What you’ll do
- Lead the technical design, vision and implementation strategy for major systems & components of the Adobe Experience Cloud data platform mainly focused around distributed Query Service.
- Build/code/test and own critical parts of the services to run at scale
- Ability to articulate the design and code choices to cross functional and architecture teams
- Reviewing and providing feedback on features, technology, architecture, designs, and test strategies
- Mitigating risks & creative problem solving
- Developing and evolving engineering to optimize team efficiency
- Partner with other teams across Adobe for achieving common goals
What you need to succeed
- 3+ years as a Lead/Chief Architect working on enterprise software on a distributed platform
- Recognized Subject-Matter Expert in big data engineering and cloud based data warehouse
- In depth experience with No-SQL as well as RDBMS/Data warehouse
- Proficiency in spark and spark internals and able to extend spark code base for analytical needs
- Plus to be a Committer or PMC Member with the Apache Software Foundation on big data technologies: Apache Spark, Hadoop Stack, Kafka, Drill, Atlas, Iceberg
- Proficiency in data structures and algorithms in Scala/Java
- Cost consciousness around computation and memory requirements
- Strong verbal and written communication skills
- PhD/MS in Computer Science
- Strong leadership skills