Amelia W. Cole, Ph.D.

AI Researcher

Redmond, Washington, United States3 yrs 11 mos experience

AI EnabledHighly Stable

Key Highlights

Expert in AI evaluation frameworks and research operations.
Proven ability to translate research into product strategy.
Experienced in teaching and mentoring early-career researchers.

Stackforce AI infers this person is a SaaS and Fintech expert specializing in AI evaluation and user experience research.

Contact

Skills

Core Skills

Ai EvaluationResearch OperationsUser ResearchMixed Methods ResearchDesign ResearchAffective Computing

Other Skills

Prompt EngineeringSemi-structured InterviewsUniversity TeachingUser InterviewsQualitative ResearchHuman Computer InteractionAgentic AutomationData AnalysisEvaluationUnmoderatedCollaborative Problem SolvingStrategic PlanningExecutive-level CommunicationArtificial Intelligence (AI)Generative AI

About

Senior Research Scientist with 8+ years of industry and academic experience specializing in AI product evaluation, mixed-methods research, and research operations at scale. Currently building division-wide AI evaluation frameworks and scalable research toolkits at Microsoft. Proven ability to translate complex research into product strategy across enterprise and startups. Experienced in cross-functional leadership, research democratization, and teaching research methods. Ph.D. in Information Science.

Experience

Microsoft

Human-AI Research Scientist

Apr 2022 – Present · 3 yrs 11 mos

Developed a division-wide AI evaluation strategy for GenAI-powered tools and created scalable evaluation toolkits that enabled researchers across the organization to independently conduct AI assessment studies on their projects, accelerating evaluation coverage.
Influenced product roadmap for Microsoft Learn’s GenAI features by leading end-to-end research across discovery, design, and evaluation phases, directly informing feature prioritization and go/no-go decisions.
Defined the evolving role and competency model for Human-AI Researchers at Microsoft, shaping how research is practiced and valued as AI transforms product development.

Prompt EngineeringSemi-structured InterviewsAI EvaluationResearch Operations

Usertesting

Senior User Experience Researcher

Apr 2021 – Dec 2021 · 8 mos · San Francisco, California, United States · Remote

Specialized in evaluating AI-driven decision-making tools in the insurance sector, producing research that informed responsible AI implementation for client organizations.
Achieved User Testing platform certification, demonstrating mastery of research delivery standards and enabling consistent high-quality outputs for enterprise clients.

User InterviewsQualitative ResearchUser ResearchAI Evaluation

The university of british columbia

User Experience Researcher

Sep 2017 – Jul 2022 · 4 yrs 10 mos · Vancouver, Canada Area · On-site

Designed and executed multiple studies on online information retrieval and learning strategies, contributing to peer-reviewed publications and advancing understanding of digital learning behaviors.
Explored information rediscovery patterns and user experience disparities in a large-scale digital library context, producing design recommendations adopted by the platform team.
Built research capacity by developing and teaching a mixed-methods research course for early-career UX researchers, training 30+ practitioners in interview, survey, and usability techniques.

University TeachingUser InterviewsUser ResearchMixed Methods Research

Simon fraser university

Design Researcher

Sep 2016 – Aug 2017 · 11 mos · Vancouver, Canada · On-site

Conducted experimental studies on stress management using brain-computer interfaces, contributing to the emerging field of affective computing and human-AI interaction.
Designed and prototyped an emotionally responsive digital agent for young learners with reading difficulties, integrating user research findings into a functioning prototype.
Co-taught a 300-level Interface Design course, mentoring 40+ students in user-centered design principles and research-informed design practices.

User InterviewsHuman Computer InteractionDesign ResearchAffective Computing