SFIA Reference: INOV Level 4/5
Competency Description
Explores emerging tools and techniques and applies research methods to evaluate novel approaches.
Learning Outcomes
- Run controlled experiments or A/B tests.
- Apply rigorous evaluation criteria for experimental features.
- Stay current with ML research and trends.
Evidence Requirements
Level 4:
- Delivered a tested innovation or model alternative.
- Documented experimental design and results. Level 5:
- Designed and ran a significant experiment to influence product direction.
- Led an internal learning session on recent ML advancements.
Suggested Learning Activities
- Reading group or conference summary write-up.
- Run an A/B test and evaluate impact.
- Lab: Implement a paper’s model on real data.
Recommended Resources
- arXiv-sanity or Papers with Code
- KnowHow: “Experiments & Learning Loops”