An Update from the Market Quality Team (average review times)

Thank you for the info, appreciate it. Thank you also for your hard work.

is there any possibility to bring back review times to good old 7 days. ?

tumbleweed

@jremick sorry to mention you, but seeing that we don’t know who is handling this now and that already it’s already been almost two weeks without an answer, you are the only one who we know…since our June 9th post, that none answered, you can see that review times for categories like HTML or PSD are even worse than before, now it’s more than 2 weeks to review!

Sorry, Odin; while I’m aware of the current review times, I’m not able to provide any updates on why or whether there are any plans to address them. I’ll raise this thread with a few more people and see if we can get an update.

Hi Any news about that update, because it’s been almost 2 months since our initial post and we still don’t have an update. In the meantime, review times for HTML templates has now reached 23+ days…

Hi folks

Sorry for the delay in following up and thanks @jremick for looping me into this conversation. As he mentioned in a previous post, responsibility for review times now lives with me and my team - a new team called Author Success (a topic worth a post in its own right - hopefully some time in the near future).

It’s been just over a year since this thread was first started and a lot has changed in that time. Many of the changes announced back then have been implemented. We’ve added new reviewers across the board, a product team dedicated to improving quality and review tooling, another product team looking at new tech, and an insights team that provides a great deal of support in the data analysis department.

However, the volume of item submissions has continued to climb in most categories, and despite all of these improvements, we’re still struggling to keep up.

So, we’ve started testing new approaches. For example, back in April, we removed pre-publication review for all of our photo authors (on Market and Elements) and replaced it with a new system we’re calling “author management” (learn more). We’ve also just announced a new approach to bringing down the stock footage queue that relies on sampling (check out the forum announcement).

As James says in the stock footage forum post, we’re not yet sure if these are approaches we’ll adopt forever or roll out to other marketplaces. For now, we’re paying close attention to the data and feedback from our reviewers and authors, iterating where possible and trying to see if we can uncover a new way that delivers a good quality outcome and a better author experience.

What does this mean for review times today? Relief for stock footage authors should come soon and we’re actively planning steps we can take in the immediate term to address some of the longer ThemeForest wait times. But, these are tricky problems to solve - there are lots of factors to consider and there’s no silver bullet. We’re committed to solving them, though, and we’re throwing a lot of people and energy at them to give us the best chance at success.

I’m sure many of you were hoping for a more definitive answer and I’m sorry I can’t provide one at this stage. We’ll continue to keep you posted here in the forums and we thank you for all for your patience while we work on this.

5 Likes

Hi @natman thanks for the reply!
Having read in another review times topic that almost 70% of Themeforest submissions are rejected, why don’t you hire more people to skim through that? We know that a good reviewer takes time to train, but maybe you can hire people with design background to help the reviewers with the process. That way some reviewers will solely check for design approval, to then send them to the experienced reviewers to check the code. That way they will act as a “first barrier”. With this, you won’t loose so much time training new reviewers (for a speedy solution) and senior reviewers won’t have to waste time with basic review things and just check the code to approve. It’s just a suggestion to help in the short term :slight_smile:

2 Likes

It’s a great suggestion @Odin_Design - thank you, we’ll definitely add it to the list of options to consider. The current review tool doesn’t allow for it in a straightforward way, but there might be a hacky workaround that we can use in the short-term to make it work. Either way, we’ll let you know how we go and thanks once again :slight_smile:

3 Likes

That’s a good idea and I would happily join the team if it ever gets implemented :slight_smile:

Hi @natman ! It has been almost three months since last time, do you have any news about this? Because we are seeing that authors are still reporting high review times (20+ days for a WP first review).

Thanks

My theme just passed 30 days in review. I think everybody is busy creating a few more Elements banners and ads.

3 Likes

@SkatDesign Remember you have submitted to biggest marketplace of world

Cheers! :tada:

Is this an irony or a joke?

Bro It is a fact, and I am a very junior in terms of author level than you so no irony or joke. Full respect!!

I have submitted themes here for 8 years now. The review times have changed from a few days to over 30 in a few months. It has nothing to do with the size of the market.

1 Like

Hi everyone,

I’m Jami, one of Envato’s Content Specialists working with Nat, and I just wanted to give a quick update.

In Nat’s last post, she mentioned that we were addressing the queue wait times by adding more reviewers and teams dedicated to improving this experience. But even with all our efforts over the last year, submission volume has continued to grow and expanding our teams in response to that growth indefinitely clearly wasn’t going to be a viable option.

We’re still looking at opportunities like siloing reviews between design and code to help filter out content quicker like @Odin_Design suggested. We’d also like to update our public requirements to help authors submit the content we’re looking for straightaway instead of learning through rejections. And we’re exploring other ways to automate the submission and review process.

The larger piece of work though is the radical new approach Nat described in her last post called Author Management. We rolled out a similar system on Photodune earlier in the year and with the launch of Elements, we see an opportunity to discover its potential for other content types as well with the expectation that it could be adopted across Envato Market.

As I’m sure everyone can understand, implementing new systems and processes (especially something so completely different from how we’ve always done it) can be quite a task. We have to consider different content types, different queue systems, team sizes, structures, and a huge number of other factors.

What this all comes down to is that you might still be seeing delays in the review queue but there’s a lot of great things being worked on right now that aim to solve a lot of these issues.

Thanks everyone for your patience and prodding! Our entire team care a great deal about the author community (we are the Author Success team after all!) so it’s great to hear this feedback and give you all an update on what we’re working on too.

2 Likes

Hi @JamiGibbs thanks for the update!

Seeing that, as you said, it’s been more than a year and you guys haven’t been able to manage the review times because the submissions keep growing, why don’t you implement something to slow down the number of hard rejections? One thought that came out of our minds is to implement some sort of quality barrier for new authors to be able to submit themes/templates and designs. For example, on some other marketplaces, you have to send proof of your design quality (like a portfolio or dribbble account) to be able to submit items for sale. This way, the number of design rejections will decrease dramatically, and reviewers can focus on code quality. If authors have to show a good level of design quality before having to send to review, this will help not only to decrease the number of hard rejections, but also manage to control that in the future submission won’t grow out of control (seeing that only people with some level of skills will be able to submit items the number becomes more manageable). This will also help prospect authors to increase their design quality level before trying to code it, that way they’ll save a ton of time. What do you guys think about this? isn’t this something that could be (fairly) easily implemented and stop from now on the low level submissions?

Thanks!

One thought that came out of our minds is to implement some sort of quality barrier for new authors to be able to submit themes/templates and designs

Really great suggestion and this is precisely something we’re looking to integrate as part of Author Management in some way.

isn’t this something that could be (fairly) easily implemented and stop from now on the low level submissions?

Possibly but not without a lot of thought on how this could work with a future review system as a whole as well as careful consideration for the author community which is what we’re digging into.

Great questions and suggestions @Odin_Design!

1 Like

Hi @JamiGibbs @jremick , Thanks for the update. I have a suggestion. 1. How about we make it invite-only community? Something like Dribbble. The author who invites another author, will be responsible for low quality items submitted. 2. Queue should favor the authors whose item sale to time ratio is better. For example, an author whose 1 year old items got sold 80 times should automatically go up in the queue than someone whose 1 year old items got sold 20 times. This way author who provide more value to the marketplace would have more items than the rest. Everyone would want to be those great authors hence quality goes up as well.

I got some info that you use same reviewers for elements. Meaning that you share those resources. That is for sure a delay spike reason.

You started to get it down and then sudenly it went up, for this to ame the submission volumes would mean that there was a big spike in those submissions.

If I throw new projects at existing themes something will suffer.

Cheers

1 Like