Skip to content
View fskamau's full-sized avatar
🎯
Focusing
🎯
Focusing

Block or report fskamau

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
fskamau/README.md

AI Evaluation & Data Specialist · Software Engineer

LLM Evaluation · Multimodal AI · Computer Vision · CUA · Automation

I evaluate AI systems, build high-quality training data, and develop automation tools for complex data workflows.


About

I work at the intersection of AI evaluation, training data, computer vision, and software engineering.

My work includes evaluating LLM and multimodal outputs, reviewing computer-use agent trajectories, comparing model responses, validating structured datasets, and performing image and video annotation for computer vision systems.

I also build software and automation around data-intensive workflows. My engineering stack includes Python, C, JavaScript, TypeScript, Node.js, SQL, MongoDB, Linux, and REST APIs, with experience developing browser automation, scrapers, bots, data-processing utilities, and validation tools.

The common thread across my work is AI data quality: identifying errors, enforcing evaluation criteria, validating outputs, and building tools that make complex workflows more reliable and repeatable.


Areas of Expertise

AI Evaluation & Training Data

LLM Evaluation Generative AI Multimodal Evaluation SxS Evaluation CUA Evaluation AI Training Data Data Annotation Quality Assurance

Evaluation of model outputs for factuality, instruction following, completeness, grounding, tool use, task completion, and overall response quality.

Computer Vision

CVAT Computer Vision Annotation Video Object Tracking Image Annotation Video Annotation Bounding Boxes Segmentation Visual QA

Annotation and quality evaluation of visual datasets, including object tracking across video sequences and structured annotation workflows.

Automation & Data Engineering

Puppeteer Web Scraping Browser Automation REST APIs Telegram API Postman ETL

Development of repeatable workflows for data collection, processing, validation, transformation, and API-driven automation.


Engineering Stack

Languages

Python C JavaScript TypeScript SQL Dart

Backend & Automation

Node.js Puppeteer REST APIs Web Scraping Browser Automation Telegram API

Data

MongoDB SQLite JSON CSV ETL

AI & Computer Vision

LLM Evaluation Multimodal AI CVAT Video Object Tracking Data Annotation Dataset QA

Systems & Development

Linux Bash Git GitHub Docker Postman

Additional Tools

Flutter Inkscape


Selected Work

Multimodal AI Evaluation Toolkit

A Python-based evaluation framework for benchmarking LLM and multimodal AI outputs across factuality, instruction following, completeness, grounding, tool use, and response quality.

The project includes structured evaluation schemas, pairwise response comparison, error classification, scoring utilities, and evaluation reporting.

Stack: Python JSON AI Evaluation Multimodal AI

Status: In development


SVD

A Python-based media downloading utility focused on practical automation and streamlined media-processing workflows.

Stack: Python Automation

View Repository


SVD Browser Extension

A browser extension extending media workflow functionality directly into the browser.

Stack: JavaScript Browser APIs Automation

View Repository


BSP

A C project exploring binary space partitioning and low-level graphical programming.

Stack: C raylib Algorithms

View Repository


Building Next

Computer Vision Annotation & Video Object Tracking

A reproducible CVAT-based project demonstrating object tracking, track continuity, occlusion handling, annotation QA, structured exports, and visualization of tracked objects.

CVAT Python OpenCV Computer Vision

Annotation QA Toolkit

A Python toolkit for detecting malformed annotations, invalid bounding boxes, missing labels, duplicate annotations, class inconsistencies, and dataset anomalies.

Python Computer Vision COCO YOLO Data Quality

Browser Automation & Data Pipeline

A TypeScript and Node.js pipeline for automated browser interaction, structured data extraction, validation, normalization, storage, and reporting.

TypeScript Node.js Puppeteer MongoDB


Current Focus

I am currently developing open-source projects around AI evaluation infrastructure, multimodal data quality, computer vision annotation, and workflow automation.

My current work focuses on:

  • Structured LLM and multimodal evaluation
  • Pairwise and side-by-side model comparison
  • Computer-use agent evaluation
  • Evaluation error taxonomies
  • Computer vision annotation quality
  • Video Object Tracking
  • Dataset validation and QA
  • Browser and API automation
  • Python-based data tooling

Professional Interests

I am interested in engineering and data roles involving:

AI Evaluation · LLM Training · AI Data Quality · Computer Vision · Multimodal AI · CUA Evaluation · Data Annotation · Automation · Python Development


AI Evaluation · Computer Vision · Automation · Software Engineering

Popular repositories Loading

  1. svd svd Public

    simple video downloader

    Python 1

  2. svd-extension svd-extension Public

    simple video downloader extension

    JavaScript 1

  3. nn.h nn.h Public

    Forked from tsoding/nn.h

    Simple stb-style header-only library for Neural Networks

    C 1

  4. closet closet Public

    A minimalist, 'scorched-earth' tab purger. Instantly kills distracting domains the millisecond they try to load. Built with Manifest V3 for Chrome, Firefox, and Edge.

    JavaScript 1

  5. bsp bsp Public

    simple Binary Space Partitioning widgets with raylib

    C 1

  6. fskamau fskamau Public

    1