top of page
  • Writer's pictureBenjamin

๐—˜๐˜…๐—ฝ๐—ฒ๐—ฟ๐—ถ๐—บ๐—ฒ๐—ป๐˜ ๐˜„๐—ถ๐˜๐—ต๐—ถ๐—ป ๐—ฎ๐—ป ๐—˜๐˜…๐—ฝ๐—ฒ๐—ฟ๐—ถ๐—บ๐—ฒ๐—ป๐˜

Updated: Sep 24, 2022

Abstractly, startups are a huge experiment.
The hypothesis is that this business can discover the right model to yield success.

Founders, early employees, and investors all believe that the experiment will work โ€“ but itโ€™s yet unproven over the long term.

Simultaneously, for the company to succeed, it will run many experiments to learn what works with products, clients, and processes.

"๐‘ฐ ๐’‰๐’‚๐’—๐’† ๐’๐’๐’• ๐’‡๐’‚๐’Š๐’๐’†๐’…. ๐‘ฐ'๐’—๐’† ๐’‹๐’–๐’”๐’• ๐’‡๐’๐’–๐’๐’… ๐’•๐’†๐’ ๐’•๐’‰๐’๐’–๐’”๐’‚๐’๐’… ๐’˜๐’‚๐’š๐’” ๐’•๐’‰๐’‚๐’• ๐’˜๐’๐’'๐’• ๐’˜๐’๐’“๐’Œ."

โ€“ Thomas Edison

Foster the Right Mindset

Experimentation allows you to explore incredible opportunities which could substantially benefit your business with minimal risk.

Letโ€™s break down the elements.

Growth Insights. Most people believe that only huge, complex initiatives can cause large results. However, a simple product feature can heighten user engagement and a small benefit can drastically raise employee satisfaction.

Experiments do not have to be complex. Sometimes a small change can have an outsized impact.

Valuable Time. Experimentation allows you to evaluate new markets and invest in existing clients faster to jump ahead of your competitors.

These short-term tests save you time because higher-stakes decisions require more deliberation and resources than lower-stakes decisions.

Optimized Margins. Among your current customers, some may be willing to spend more if given the chance.

Imagine a coffee shop with hundreds of customers. Almost everyone wants a cup of coffee. A few people may even be willing to purchase an expensive latte machine given the audience.

By exploring options that complement your value proposition, potentially you will increase your profit margins.

You also can test operational changes such as increasing efficiency (e.g. automation) and offering incentives (e.g. referrals) to boost profits.

Minimal Risks. Another benefit of short-term experiments is the minimal downside when done correctly.

They often require less time and expense, and in the process, you may make some amazing discoveries.

For instance, by offering valued customers the chance to try a new product early, you may get constructive feedback before going public.

How to Run an Experiment

๐˜š๐˜ต๐˜ฆ๐˜ฑ 1: ๐˜Š๐˜ญ๐˜ฆ๐˜ข๐˜ณ ๐˜–๐˜ฃ๐˜ซ๐˜ฆ๐˜ค๐˜ต๐˜ช๐˜ท๐˜ฆ

The more focused your intention, the more likely you are to achieve it. Determine success based on specific outcomes and clear metrics.

"๐‘พ๐’‰๐’‚๐’• ๐’š๐’๐’– ๐’‡๐’๐’„๐’–๐’” ๐’๐’ ๐’ƒ๐’†๐’„๐’๐’Ž๐’†๐’” ๐’‘๐’๐’˜๐’†๐’“๐’‡๐’–๐’." โ€“ Karen Young

Decide and define the ultimate outcome e.g. seeking new customers, generating more engagement, improving profit margins, etc.

๐˜š๐˜ต๐˜ฆ๐˜ฑ 2: ๐˜š๐˜ช๐˜ฎ๐˜ฑ๐˜ญ๐˜ฆ ๐˜๐˜บ๐˜ฑ๐˜ฐ๐˜ต๐˜ฉ๐˜ฆ๐˜ด๐˜ช๐˜ด

Ideally, dictate a single dimension to measure.

An easy example โ€“ will changing my headline cause more clicks?

Tests may be run across different teams: Product UX, Marketing outreach, Sales demonstrations, Operations software, etc.

๐˜š๐˜ต๐˜ฆ๐˜ฑ 3: ๐˜Š๐˜ข๐˜ฏ๐˜ฅ๐˜ช๐˜ฅ ๐˜Š๐˜ฐ๐˜ฎ๐˜ฎ๐˜ถ๐˜ฏ๐˜ช๐˜ค๐˜ข๐˜ต๐˜ช๐˜ฐ๐˜ฏ

Talk with different employees and stakeholders about your objectives and process to get valuable feedback.

As the impact increases, talk with more people via samples, focus groups, and interviews. Verify you are asking the correct target audience.*

๐˜š๐˜ต๐˜ฆ๐˜ฑ 4: ๐˜‹๐˜ฆ๐˜ด๐˜ช๐˜จ๐˜ฏ๐˜ข๐˜ต๐˜ฆ๐˜ฅ ๐˜–๐˜ธ๐˜ฏ๐˜ฆ๐˜ณ

You want one person to ultimately own an experiment.

That person may be managing a team directly, facilitating a task group, or directing both internal and external resources.

๐˜š๐˜ต๐˜ฆ๐˜ฑ 5: ๐˜œ๐˜ด๐˜ฆ๐˜ง๐˜ถ๐˜ญ ๐˜‹๐˜ข๐˜ต๐˜ข

Distinguish sentiment scores from actual user behaviors.

For example, asking people if they might buy a new product is far less meaningful than seeing verified purchases.

๐˜š๐˜ต๐˜ฆ๐˜ฑ 6: ๐˜”๐˜ฆ๐˜ข๐˜ด๐˜ถ๐˜ณ๐˜ข๐˜ฃ๐˜ญ๐˜ฆ ๐˜™๐˜ฆ๐˜ด๐˜ถ๐˜ญ๐˜ต๐˜ด

Pair the original objective with a successful outcome. Once underway, use metrics to confirm which behaviors lead to the desired outcome.

Ideally, you can compare metrics over multiple periods to eliminate seasonal trends which may impact your findings unrelated to the test.

๐˜š๐˜ต๐˜ฆ๐˜ฑ 7: ๐˜•๐˜ฆ๐˜น๐˜ต ๐˜š๐˜ต๐˜ฆ๐˜ฑ๐˜ด

With your results, you may expand the experiment, test another element, or concentrate on something else.

Even if the result is not what you expected, you still have learned where not to waste your resources, getting you closer to the right formula.

Too Much of a Good Thing

Following success, you may get so excited about experimentation that you generate a huge list of additional tests.

Thatโ€™s great youโ€™re excited - but you need to prioritize that list.

Decide which experiments to run based on impact (growth and efficiency), certainty (expected success), and cost (time and expenses).

Experimentation opens a world of possibilities to increase revenues, reach, and efficiency. Utilize testing to move forward quickly.


* When McDonaldโ€™s rolled out the Arch Deluxe burger in 1996 to target โ€œsophisticated urbanitesโ€, it spent $200M in marketing (around $360M in todayโ€™s dollars). Volunteers recruited to test the new burger were already fans of McDonaldโ€™s and were asked if they wanted to try an upscale new item. See the bias here? The target audience was the average consumer but the experiment was offered to existing champions offered a free taste.

181 views0 comments
bottom of page