The Andrew Faris Podcast

Creative Testing Campaigns May Be The Biggest Cost Center In Your Business


Listen Later

"Test creative until you have statistically significant results, then scale the winners based on that."

That seems like good advice on first glance. How can you disagree with methodical testing that's attentive to good statistical principles?

Because it's almost impossible to actually do without burning huge amounts of money on Meta, for one, and for two, it's unnecessary anyway, since Meta's machine learning can use better methods of forecasting your creative's performance than frequentist-style stat sig tests.

Yes, this one is getting into the weeds. Hopefully it helps clarify more of why you absolutely positively should not run auto-bid creative testing campaigns on Meta.

EPISODE HIGHLIGHTS

  • [00:00:55] Creative testing strategies for meta ads.
  • [00:05:10] Frustrations with new creative.
  • [00:07:16] Creative testing campaigns on Meta.
  • [00:11:15] Auto bidding creative tests.
  • [00:14:25] Statistical significance in ad testing.
  • [00:17:48] Ad Performance Analysis.
  • [00:19:56] The pitfalls of ad testing.
  • [00:24:41] Creative performance and optimization.
  • [00:27:17] Meta's machine learning forecasting.
  • [00:30:51] Creative testing in advertising.
  • [00:33:19] Prediction at scale
  • EPISODE SPONSOR

    Virtual assistants can be helpful. Virtual professionals can transform your business. Get connected to incredible ecommerce talent from the Philippines with More Staffing by visiting ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.morenow.co⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠.

    REFERENCED IN THIS EPISODE

    • "My Exact Creative Testing Method For Meta Ads" (Spotify, Apple)
    • My Twitter Conversation With Zach Stuck On This Topic: https://bit.ly/42JsbZ0
    • FOLLOW UP WITH ANDREW

      • Follow Andrew on Twitter: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠@andrewjfaris⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠
      • Email Andrew: [email protected]
      • Work with Andrew: ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠www.ajfgrowth.com⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠
      • EPISODE MUSIC

        • Music Intro: "⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Tell Me Mama⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠" by The Devious Means
        • Music Outro: "⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Rusty Little Scissors⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠" by The Devious Means
        • ...more
          View all episodesView all episodes
          Download on the App Store

          The Andrew Faris PodcastBy Andrew Faris

          • 5
          • 5
          • 5
          • 5
          • 5

          5

          24 ratings


          More shows like The Andrew Faris Podcast

          View all
          The Foundr Podcast with Nathan Chan by Foundr Media

          The Foundr Podcast with Nathan Chan

          571 Listeners

          Perpetual Traffic by Tier 11

          Perpetual Traffic

          759 Listeners

          Shopify Masters by Shopify

          Shopify Masters

          378 Listeners

          Marketing School - Digital Marketing and Online Marketing Tips by Eric Siu and Neil Patel

          Marketing School - Digital Marketing and Online Marketing Tips

          1,253 Listeners

          Founders by David Senra

          Founders

          2,081 Listeners

          Ecommerce Playbook: Numbers, Struggles & Growth by Common Thread Collective

          Ecommerce Playbook: Numbers, Struggles & Growth

          70 Listeners

          The Martell Method w/ Dan Martell by Dan Martell

          The Martell Method w/ Dan Martell

          569 Listeners

          The Game with Alex Hormozi by Alex Hormozi

          The Game with Alex Hormozi

          4,409 Listeners

          My First Million by Hubspot Media

          My First Million

          2,647 Listeners

          Acquisitions Anonymous - #1 for business buying, selling and operating by Bill D'Alessandro, Mills Snell, Heather Endresen, and Michael Girdley

          Acquisitions Anonymous - #1 for business buying, selling and operating

          244 Listeners

          OPERATORS by OPERATORS

          OPERATORS

          46 Listeners

          Moneywise by Hampton

          Moneywise

          650 Listeners

          Marketing Operators by Marketing Operators I Connor Rolain I Connor MacDonald I Cody Plofker

          Marketing Operators

          10 Listeners

          Tactical & Practical by Nate Lagos

          Tactical & Practical

          2 Listeners

          Scalability School by Scalability School

          Scalability School

          9 Listeners