Testing Technician, Sr. jobs in Atlanta, GA

Job Summary

The Senior Manager, Digital Insights & Testing will be responsible for leading the insights, analytics and testing governance across Papa Johns’ digital channels. The role leverages a full range of analytics tools to gather and translate consumer data into actionable insights for digital product teams. This role champions a data-driven experimentation approach across the organization, including leading A/B testing to optimize Papa Johns’ direct digital channels and drive product roadmap priority. The role is responsible to partner with cross functional teams – product, media, consumer insights, data science and revenue management – to integrate a holistic multi-channel approach across owned digital channels. 

Duties and Responsibilities

• Define and implement a comprehensive digital testing framework, including test design, hypothesis development, sample size determination, and statistical analysis. 

• Develop and execute A/B and multivariate tests to evaluate the effectiveness of various digital elements, such as website layouts, user flows, messaging, promotions, and features. 

• Analyze test results and provide actionable insights and recommendations to stakeholders, including marketing, product management, and UX teams, to drive continuous improvement and optimize key performance metrics. 

• Establish and maintain testing governance, ensuring adherence to best practices, data integrity, and consistency in testing methodologies. 

• Collaborate with the Data Analytics & Enterprise Insights teams to collect and analyze data, develop custom tracking, and build dashboards to monitor and report on key metrics and performance indicators. 

• Stay up-to-date with industry trends, best practices, and emerging technologies in digital analytics and testing, and apply them to enhance our testing and insights capabilities. 

• Own the A/B Testing roadmap and backlog for web and apps, including developing hypotheses and prioritizing experiments based on business needs.   

• Utilize Google Analytics and other tools to analyze customer behavior and provide recommendations and focus areas for improvement. 

• Provide guidance and mentorship to a Manager of Insights & Testing and collaborate with a dedicated Agile Scrum team, fostering a culture of data-driven decision-making and continuous learning. 

• Connect with peers in consumer insights, data science and media teams to align on data governance and integrations, and testing methodologies and best practices.  

• Develop self-service KPI dashboards to support continuous improvement and learning through rigorous and consistent measurement.  

• Champion testing and data-driven rigor into all points of the stage-gate process, and web and app product lifecycle.  

• Suggest and implement process improvements, recommend new software and ensure current tools for consumer feedback and testing are being utilized to their full potential.