As a trusted global transformation partner, Welocalize accelerates the global business journey by enabling brands and companies to reach, engage, and grow international audiences. Welocalize delivers multilingual content transformation services in translation, localization, and adaptation for over 250 languages with a growing network of over 77,000 in-country linguistic resources. Driving innovation in language services, Welocalize delivers high-quality training data transformation solutions for NLP-enabled machine learning by blending technology and human intelligence to collect, annotate, and evaluate all content types. Our team works across locations in North America, Europe, and Asia serving our global clients in the markets that matter to them. www.welocalize.com
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
The Assessment Program at Welocalize is seeking an experienced Assessment Specialist to join our team. The Assessment Specialist will work as part of a wider team that is responsible for the evaluation of candidates’ skills and competencies to ensure successful placements across a variety of roles for our clients. Working closely with the recruitment team, the Assessment Specialist coordinates candidate testing and oversees the review process. In addition, the Assessment Specialist will be responsible for the development and analysis of new tests based on the underlying skills and competencies of each role. Working closely with SMEs, both internal and external, the Assessment Specialist will identify best testing practices, tools, and evaluation metrics.
Responsibilities
- Assessment coordination
- Write or oversee the creation of items, review items, run and interrupt item analysis, evaluate item effectiveness
- Develop scoring and evaluation rubrics/metrics
- Create assessments with the assistance of SMEs
- Analyze role requirements and identify appropriate evaluation techniques
- Plan and conduct efficacy studies of tests and devise solutions as needed
- Train and coach others in understanding item analysis results and identifying item/test issue(s)
- Assessment report writing
- Oversee creation of data dashboards in PowerBI
- Statistical analysis
Qualifications and Education
- Bachelor’s degree (Master’s preferred) from a college or university in related fields such as, Psychometrics, Learning Measurement Evaluation, Statistics, or equivalent combination of education and experience
- 5+ years relevant experience
- Experience in test development, educational measurement, applied statistics
- Experience with Item Analysis software (SPSS, Xcalibre, Lertap, etc)
- Knowledge of Computer Adaptive Testing
- Experience with database management and PowerBI
- Analytical and problem-solving skills
- Experience in a fast-paced, client-centric environment, ability to adapt to business needs
- Ability to stay organized and communicate effectively and efficiently across global time zones
- Taking initiative to proactively assess and mitigate risks, explore new tools and industry advancements
- Native-level fluency in written and verbal English
- Knowledge or experience in linguistics/localization industry a plus