What is Quality Score Assessment (QSA) review?

Designhill has put a system in place which computes and displays a "Quality Score Assessment (QSA)" score on designers dashboard. The system takes into account the quality of work submitted by the designers in design contests, and their history or behavior on the site to calculate a score on a scale of 0-5.

We built the QSA review system to periodically review the quality scores of designers and ensure that the ones who deliver high quality work are rewarded.

Designers can improve their scores by creating high-quality designs and receiving high ratings and reviews from clients.

Here are some important questions regarding QSA:

• What factors does the new QSA review algorithm consider?
• Is calculation of QSA score different for Pro & Non-Pro Designers? 
• How does QSA review algorithm work for Pro Designers? 
• How does QSA review algorithm work for Non-Pro Designers? 
• What is a reviewed design?
• How often does Designhill perform a quality review?
• What happens if I FAIL in QSA review?
• What happens if I PASS in QSA review?
• What will happen if I FAIL in QSA review and there are some contests I am already participating in? 
• Is your QSA score affected if a client does not rate or share any feedback on your design entry?
• Where does your QSA score show on the site?
• What happens if my work quality doesn’t meet Designhill standards?
• Do clients have scores?
• Should I contact the Designhill support team with questions about my QSA score?
• Is my QSA score visible to other designers on the site?

 -------

What factors does the new QSA review algorithm consider?

We can't share every detail of how the new QSA algorithm works, but at a high level, it gives the most weightage to the quality of your work.

As you participate in any design contests, clients provide you feedback in multiple ways, either by rating your designs, eliminating them, making them favourite or feedback in the form comments. In short, your account will be reviewed in real time basis on the basis of the designs you submit in any contest, how well you follow the design brief, star ratings you get on your designs and much more.

If you win a contest, it will also give a boost to your QSA score!

Is calculation of QSA score different for Pro & Non-Pro Designers? 

Yes!

Our QSA review algorithm asses Pro and Non-Pro designers differently, after all the expectation from Pro designers is higher as they get many perks and benefits of being a Pro designer.  

How does QSA review algorithm work for Pro Designers? 

Pro designers need to maintain a minimum of 3.0 QSA score from their last 40 reviewed designs. If they score less than 3.0 QSA score, they fail and if they score more than or equal to 3.0 QSA score, they pass. 

How does QSA review algorithm work for Non-Pro Designers? 

Non-Pro designers need to maintain a minimum of 2.75 QSA score from their last 40 reviewed designs. If they score less than 2.75 QSA score, they fail and if they score more than or equal to 2.75 QSA score, they pass.

What is a reviewed design?

A 'reviewed design' is a design which has been submitted in a contest and has been reviewed by:

1. the customer in terms of:
   • textual feedback in terms of comments
   • star rating
   • designs eliminated
   • designer eliminated
   • favorited 
2. our system and quality assurance team in terms of:
   
   • checking the quality of the design submitted
   • how well the brief was followed 
   • copied designs
   • description added while submitting a design

How often does Designhill perform a quality review?

We adjust the QSA scores for all active designers individually. As soon as:

• any Pro designer's last 40 designs get reviewed
• any Non-Pro designer's last 40 designs get reviewed

What happens if I FAIL in QSA review?

If you fail in your QSA review, your account will be put on temporary suspension, which means you no longer will be allowed to participate in any new contest as per the warning level you are on. You can see details about different warning levels below. Your account will also put on 'Warning Level 1'.

Please note: You will be able to submit designs in any contests where you were already participating.

During this time, you need to reflect back on what went wrong and improve your skills, so that after this period of suspension, post which your temporary ban will be lifted, you score well in your future QSA reviews.

If you fail 4 times consecutively, you will be permanently banned from participating in any new contest for life. Which means: 

1. If you fail 1st time: you will be banned for 7 days and your account will be put on 'Warning Level 1'. 
2. If you fail 2nd time: you will be banned for 15 days and your account will be put on 'Warning Level 2'. 
3. If you fail 3rd time: you will be banned for 30 days and your account will be put on 'Warning Level 3'. 
4. If you fail 4th time: you will be permanently banned from participating in any contest on Designhill.

If you pass your review in between, your QSA warning counter will reset to 0 and you will be able to participate again in any contest on Designhill, as per your designer level. 

What happens if I PASS in QSA review?

If you pass in your QSA review, it means you are doing great! You may continue to participate in any new contests you like as per designer level. You need to keep up the good work and make sure you pass the new QSA review to avoid any suspensions. 

What will happen if I FAIL in QSA review and there are some contests I am already participating in? 

If you fail in your QSA review, your account will be put on temporary or permanent suspension based on the warning level you are on, BUT you will still be allowed to submit designs in any contests where you were already participating or complete any ongoing design handovers.

Is your QSA score affected if a client does not rate or share any feedback on your design entry?

No.  

We know that clients sometimes do not share any feedback on the designs they may receive in their contest. Although, we encourage them to give feedback to as many designs as they can, but sometimes due to the large amount of entries they receive in their contest, it becomes little difficult. So, if an entry is not given any feedback, this does not affect your QSA score. 

Where does your QSA score show on the site?

The QSA score appears on your Dashboard page. We will show how many designs have already been reviewed till now and whats your current score so you are well aware and take steps accordingly for your future entry submissions. 

What happens if my work quality doesn’t meet Designhill standards?

If we find that a designer's work doesn’t meet our quality standards, we take one of several actions. We may communicate with the designer to share our concerns, suspend the designer for a period of time, or revoke their right to work on Designhill.

Our Quality Assurance Team also periodically reviews design contests and if they think, your work doesn't meet Designhill's standards, they will review your entries manually, which could have impact on your QSA score.

Do clients have scores?

No.

We don't measure clients in the same way we measure QSA scores of designers. For clients, we provide other stats (how many projects they have posted, how active they have been with feedback and scoring, when were they last active etc.) to help you evaluate whether to participate in specific contests or not. 

Should I contact the Designhill support team with questions about my QSA score?

No.

This FAQ addresses all the important questions about your score. The support team won't be able to share any additional details as all the calculations are done through our algorithms and they have same knowledge as yours. 

Is my QSA score visible to other designers on the site?

No.

Our QSA process is internal. The scores are not public to any other designer.