SAFASTUDIOS
AI Lab

Open notes from the studio floor.

We test open-source AI projects on real work and report what holds up. We publish pieces of our own work when they are useful beyond one project. And we set build challenges anyone can take on.

Three tracks
01

Repo reports

We pick open-source AI repositories on GitHub, run them on real work and write up what holds up: what it does, what it costs to run, where it breaks and who should use it.

02

From our work

Tools, prompts and small systems from our own projects, published as public repositories when they are useful outside the project. Nothing confidential, and nothing from a client without the client's written OK.

03

Challenges

A brief, a deadline and a public starter repository. Build the thing, open a pull request, and the strongest entries are reviewed in the next report.

How a report is built

Same five questions, every time.

  1. What it is

    The problem it solves, in one paragraph, without the README's adjectives.

  2. How we tested it

    The real task we gave it, the setup and the version we ran.

  3. Cost to run

    Hosting, model calls and the hours it took to get working.

  4. Where it breaks

    The limits we hit, with the inputs that broke it.

  5. Verdict

    Use it, watch it or skip it, and for whom.

Latest

The first editions are in preparation.

The first repo reports and the first challenge go up here when they are ready, not before. Tell us which repository you want tested, or which problem deserves a challenge.

Have a repo we should test?

Send the link and the job you want it to do. If it makes the list, you get the report first.