To judge a studio portfolio, first work out what each piece actually is: delivered client work, a self-initiated study, a concept, or a sample. Then ask for evidence of process and outcome that matches the claim. A good portfolio is clear about this distinction. A weak one lets a beautiful image imply a result nobody can show.
Step one: classify every item
Studios show different kinds of work for good reasons, and none is dishonest in itself. Problems start when the label is missing. As you scroll, put each item in one of these groups:
| Type | What it is | What it proves |
|---|---|---|
| Delivered client work | Made for a paying client and released | Ability to meet a brief, deadline and approval process |
| Internal study or R&D | Made by the studio to explore a technique | Skill and curiosity, not client handling |
| Concept demonstration | An imagined brief, often for a well-known type of product | Style and craft, not results |
| Sample or template | A reusable example of a workflow or format | How the studio structures work |
Ask the studio to label each item if it does not. Honest studios do this readily, and some label everything on their own site. Radiance Impact’s own work page takes that approach: every item is marked as a concept demonstration, internal study or sample workflow, not client work.
Step two: ask process questions
Finished visuals hide the hard parts. These questions reveal how the work was made:
- What was the brief, and who set it?
- Which parts did the studio make, and which parts came from the client, stock libraries or other suppliers?
- What tools and techniques were used, including any AI tools? How much human direction and editing was involved?
- How many rounds of revision were there, and how were they managed?
- How long did it take, and what changed along the way?
- What went wrong, and what was done about it?
Ask to see early stages: briefs, sketches, storyboards, draft cuts, wireframes. Real projects leave a trail. A studio that can walk you through drafts and decisions is showing you how it will treat your project. If AI is part of the process, see the limitations of AI video in commercial work for what to probe.
Step three: test claims about results
Phrases such as “increased sales” or “viral campaign” are claims, and the Australian Competition and Consumer Commission says businesses must be able to prove any claim they advertise, and that rules on misleading claims cover websites, social media and testimonials. You do not need to police this on the studio’s behalf, but you can reasonably ask:
- What was measured, over what period, and compared with what?
- Who produced the numbers, and can you speak to the client?
- Was the result due to the creative work, or to media spend, timing or product changes?
- Is a testimonial from a named person with a real connection to the project?
The ACCC also notes that reviews and testimonials from people with an undisclosed connection to the business can mislead. Treat anonymous praise with the same caution.
Step four: match the work to your project
Impressive work in a different field may not predict success for yours. Check for:
- Relevant format: a brand film does not prove skill at a product page or an automation workflow.
- Relevant scale: a small, tightly controlled piece differs from a long programme with many stakeholders.
- Relevant constraints: regulated categories, bilingual delivery or tight approval chains need evidence of similar conditions.
- Consistent quality: look at the weakest items, not only the best. The spread shows you what a typical outcome looks like.
For web projects specifically, our guide to choosing a web development partner lists what to ask beyond the portfolio.
A quick scoring sheet
Score each studio from 1 to 5 on these, and write one line of evidence for each score:
- Clarity about what each portfolio item is
- Evidence of process
- Relevance to your project
- Honesty about limits and trade-offs
- Communication during your enquiry
Communication counts. How a studio replies to your questions is your first sample of how it will work with you.
Honest limits
- A portfolio shows what the studio chooses to show. It rarely shows failures or difficult clients.
- Confidentiality is a legitimate reason for not naming clients or showing process. In that case, ask for a description of the type of client and brief, and consider a short paid trial project.
- Concept work is not worse than delivered work. It simply answers a different question: can they make something excellent when unconstrained? Be clear which question you are asking.
- A reference call is worth more than any case study. Ask for one where possible.
If you want to understand the field first, what creative technology is gives a plain-language overview.
Next step
When you are ready to compare studios, bring a short brief and the questions above. Radiance Impact is happy to be assessed this way. See about Radiance Impact, browse the work page, or contact us.
Sources
- False or misleading claims, Australian Competition and Consumer Commission
- Online reviews, Australian Competition and Consumer Commission
