Psychometrician (NAMR)

Workera’s Skills Intelligence Platform redefines how enterprises understand, develop, and mobilize talent. We empower organizations with actionable skills data that drives innovation across talent strategies in hiring, upskilling, mobility, and mentorship. Enterprises get an objective pulse on their workforce through our configurable skills ontology and AI-powered measurement at a granular level.

We are a Silicon Valley start-up backed by New Enterprise Associates (NEA), Owl Ventures and Andrew Ng’s AI Fund. Our founders are Kian Katanforoosh, an award-winning Stanford Computer Science Lecturer who has taught AI to over 1 million people, and James Lee, former VP of Global Operations at Udacity. Our Chairman is Dr. Andrew Ng, co-founder of Coursera (NYSE: COUR), CEO of DeepLearning.AI, and founding lead of the Google Brain project.

Workera’s vision is to help humanity measurably close the skills gap to achieve its fullest potential.

We’re looking for a Psychometrician to perform and own psychometric analyses, competency modeling, standard setting, item bank maintenance, scoring, and reporting. You will collaborate closely with the assessment, learning, product, and engineering teams, to create high-validity assessments and support a high-quality user experience.

What you'll do:

• Drive assessment initiatives**.** You will work with the Assessment and Learning team to design an engaging and adaptive assessment experience for our users. You will be flexible, nimble, and comfortable working with cross-functional teams. 
• Lead evidence-based assessment development**.** You will leverage your expertise in measurement, statistics, and psychometric best practices to improve our assessments and expand our catalogue to support the needs of our clients and the industries they serve. You will apply knowledge of psychometric best practices in a fast-paced setting. 
• Collaborate with subject matter experts**.** You will work closely with internal and external SMEs to create high-quality competency models and assessments. You will skillfully facilitate efficient and productive assessment development meetings to meet deadlines and deliverables.
• Manage competency models. You will own the development and maintenance of competency models for assessments, including conducting job analysis / role delineation studies and developing content specifications in collaboration with SMEs.
• Conduct psychometric analyses. You will own selecting and implementing psychometric and statistical analyses, such as IRT item calibration and analyses of item fit, item drift, dimensionality, and distractor quality. You will also perform analyses to support and improve our CAT.
• Analyze and monitor item banks. You will be responsible for monitoring and evaluating the item banks for assessments, such as performing gap analyses, developing crosswalks between assessment versions, creating item writing assignments, and monitoring item exposure rates and statistical anomalies.
• Perform standard setting. You will own the process of developing performance level descriptors (PLDs) and setting standards for assessments.
• Support technical documentation. You will develop and maintain technical documentation of psychometric activities for assessments and dashboards for internal stakeholders.

What you'll bring:

• Comprehensive knowledge of psychometrics, particularly item response theory (IRT) and classical test theory (CTT) measurement models, including item analyses, calibration, scaling, and equating.
• Experience with computer adaptive testing (CAT) and automated test assembly methods.
• Strong programming skills in Python or R (particularly IRT packages). 
• Command of assessment and measurement best practices, such as knowledge of the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 2014) and/or NCCA standards.
• Strong communication and meeting facilitation skills, including guiding and facilitating meetings of SMEs and communicating technical information to non-technical audiences.
• Master's Degree or PhD in Psychometrics, Quantitative Psychology, Statistics, Educational Measurement, I/O Psychology, Educational Psychology, or related field.
• 2+ years of experience in psychometrics and test development.

We'd love to hear about your experience in any of the below as well:

• Computational psychometrics and machine learning. 
• Experience with SQL and Git.
• Talent assessment.
• Writing technical reports.
• Development and scoring of alternative item types.

What you'll get by working with us:

• Unlimited PTO plus a week off between Christmas and New Year’s
• Collegial atmosphere
• Innovative environment
• Full support for home offices
• A culture of life-long learning supported up to $3,000 reimbursement for professional development
• Working across cultural and geographical lines alongside our offices in different parts of the world
• Being part of a world-class technical team that’s trying to make the world more meritocratic
• Being part of a great cause to improve lives everywhere through artificial intelligence
• Opportunity to own high-impact projects

What it's like to work at Workera:

• High-velocity career growth. You will be joining an all-star team of industry experts, world-class technologists from top tech companies, and proven startup operators that have built large, successful businesses. Workera is backed by top-tier venture capital firms and most importantly, we’re solving a massive problem for enterprises and individuals, so your opportunities for growth and impact are unlimited
• A company that is solving one of the most exciting interdisciplinary problems of our era. World-changing innovations often spur from interdisciplinary research and development. Workera is, at its heart, an interdisciplinary company. To create the world’s most reliable and valid skills signal powering talent development, we hire people with a broad set of technical skills who are ready to take on the most challenging problems at the intersection of psychometrics, artificial intelligence, and software engineering – from developing valid and reliable computer adaptive tests, to recommending personalized learning plans to employees and organizations, and enabling business leaders worldwide to make the best strategic decisions for upskilling and recruiting
• Diversity. We embrace diversity and invite applications from people of all walks of life. Our team-members, like our users, transcend geography, culture, and language; what we share, collectively, is a drive to create a skills-based, more meritocratic world, and a unique ability to execute.
• A remote-friendly work environment. No matter where you reside, you’re a part of Workera. We ensure that our globally distributed employees can participate fully in our company’s activities and do their best work every day.
• Lifelong learning. As talented as our team members are, we know that everyone is a constant work-in-progress and that the best is yet to come. We support each other in our curiosity and creativity – which we pursue through thoughtful discussion, mentorship, and knowledge-sharing among a diverse set of peers and colleagues. Did someone ever tell you that world-class mentorship doesn’t exist in startups? Please send them our way!
• A culture of transparency that we carry through to messaging communication, ensuring that team members have the information they need to make good decisions.

We’re learners, dreamers, and game-changers. Join us to bring everyone the opportunity to achieve their fullest potential!

At Workera we are committed to providing an environment of mutual respect where equal employment opportunities are available to all applicants without regard to race, color, religion, sex, pregnancy (including childbirth, lactation, and related medical conditions), national origin, age, physical and mental disability, marital status, sexual orientation, gender identity, gender expression, genetic information (including characteristics and testing), military and veteran status, and any other characteristic protected by applicable law. Workera believes that diversity and inclusion among our employees are critical to our success as a company, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. Selection for employment is decided on the basis of qualifications, merit, and business need.