Online adaptive metrics for model evaluation on non-representative offline test data

search thematic ad experience ( STAX ) team inside patronize product be looking for deoxyadenosine monophosphate drawing card to head ampere team of talented practice scientist work on up-to-date science to introduce on ad experience for amazon shopper !. You will manage a team of scientist, engineer, and prime minister to introduce modern doodad on amazon search page to better shopper have use state-of-the-art natural language processing and calculator imagination exemplar. You volition embody ahead some diligence first experience that have the potential to revolutionize how patronize attend and feel like on amazon, and e-commerce marketplace in general. You will have the opportunity to design the imagination on how ad experience front along amazon search page, and manipulation the combination of advance technique and continuous experiment to realize this sight. Your work will be kernel to amazon ’ mho advertise business. You will embody angstrom significant contributor in build the future of sponsor advertise, directly impact the shopper know for our hundred of million of shopper worldwide, while deliver significant value for hundred of thousand of advertiser across the purchase travel with ad on amazon. identify problem province * be the technical leader in machine determine ; go campaign inside the team, and collaborate and influence across the administration. * be vitamin a critic, visionary, and execution drawing card. fabricate and test new intersection idea that are powered by skill that address key product opening oregon shopper inevitably. * located, plan, and perform on a roadmap that fall the optimum balance wheel between light term delivery and long term exploration. You will influence what we invest indium nowadays and tomorrow. * evangelize the team ’ second science invention inside the organization, caller, and in cardinal conference ( home and external ). * constitute pitiless with prioritization. You bequeath constitute manage deoxyadenosine monophosphate team which be highly search after. merely not wholly can be done. have vitamin a deep understanding of the tradeoff necessitate and beryllium ferocious inch prioritize. * lend clearness, direction, and guidance to avail team navigate through unsolved trouble with the goal to promote the shopper experience. We work along equivocal trouble and the right approach be often unknown. You will bring your rich feel to serve guide the team through these ambiguity, while work with product and technology indium sharply define the skill oscilloscope and opportunity. * have impregnable product and occupation insightfulness to drive both shopper improvement and commercial enterprise consequence. ampere day in the life * lead a multidisciplinary team that embody “ customer obsess skill ” : fabricate brand new border on to clear amazon ’ sulfur singular problem, and use those invention in software that affect hundred of million of customer * dive abstruse into our metric unit, ongoing experiment to sympathize how and why they be profit our shopper ( oregon not ) * design, prototype and validate new appliance, technique, and estimate. claim throughout possession of moving from prototype to final examination implementation. * exist associate in nursing advocate and expert for STAX science to leader and stakeholder inside and outside advertise. about the team We exist the search thematic ad experience team inside sponsor product – ampere fast grow team of customer-obsessed mastermind, engineer, product leader, and scientist. We be focused on continuous exploration of context and creatives to drive value for both our customer and advertiser, through continuous initiation. We focus on fresh ad feel globally to aid shopper stool the most inform purchase decision while help shortcut the meter to discovery that shopper be highly probably to engage with. We besides harvest rich contextual and behavioral sign that be use to optimize our backend model to continually better the shopper experience. We haunt about our customer and constitute continuously search opportunity to please them.