sikuli

Debian has a sikuli package libsikuli-script-java and sikuli-ide.

The magic of Sikuli is its use of the OpenCV library under the hood (and Tesseract for OCR).

Wrote a WoW fishing bot with Sikuli a few years back - it worked pretty well.

We used Sikuli for test automation in a pretty large project with a Windows UI.

You could skip the Sikuli part and just use OpenCV and Tesseract directly.

I was a big fan of Sikuli back in the day, but I found it a bit unreliable for automation.

I'm excited to see Sikuli on the list this time around (it wasn't there last time).

That's great, we have an app that can't be tested with Selenium, Sikuli looks promising.

I used Sikuli back in 2011-12 for some random automaton tasks, and often wish I would remember to use it more.

I use Sikuli quite often, and it's basically just Python but with pictures thrown in, so it's really easy to use.

I think my favorite two examples of getting more out of my computer lever are Sikuli Script and Sublime Text multiple cursors.

With a bit of Sikuli scripting, I was posting top scores in no time!

There's also the additional drawback that it is hard to parallelize things in Sikuli (you would need heavyweight vms, and there are no obvious "breaks" in the flow).

Sikuli is freaking great, though not sure how this is news, it's been around.

Sikuli is also based on a similar idea and is written in Python.

Sikuli tries to figure out where things are by doing a visual match.