Data Mining rediscovers Artificial Intelligence

Artificial intelligence started in the 1950s with very high expectations. AI did not deliver on the expectations and fell into decades long discredit. I am seeing signs that Data Mining and Business Intelligence are bringing AI into mainstream computing. This blog posting is a personal account of my long struggle to work in artificial intelligence during different trends in computer science.

In the 1980s I was studying mathematics and physics, which I really enjoyed. I was concerned about my job prospects, there are not many math or science jobs outside of academia. Artificial intelligence seemed equally interesting but more practical, and I thought that it could provide me with a living wage. Little did I know that artificial intelligence was about to become an unmentionable phrase that you should not put on your resume if you wanted a paying job.

Highlights of the history of artificial intelligence

• In 1956 AI was founded.
• In 1957 Frank Rosenblatt invented Perceptron, the first generation of neural networks. It was based on the way the human brain works, and provided simple solutions to some simple problems.
• In 1958 John McCarthy invented LISP, the classic AI language. Mainstream programming languages have borrowed heavily from LISP and are only now catching up with LISP.
• In the 1960s AI got lots of defense funding. Especially military translation software translating from Russian to English.

AI theory made quick advances and a lot was developed early on. AI techniques worked well on small problems. It was expected that AI could learn, using machine learning, and this soon would lead to human like intelligence.

This did not work out as planned. The machine translation did not work well enough to be usable. The defense funding dried up. The approaches that had worked well for small problems did not scale to bigger domains. Artificial intelligence fell out of favor in the 1970s.

AI advances in the 1980s

When I started studying AI, it was in the middle of a renaissance and I was optimistic about recent advances:

• The discovery of new types of neural networks, after Perceptron networks had been discredited in an article by Marvin Minsky
• Commercial expert system were thriving
  
• The Japanese Fifth Generation Computer Systems project, written in the new elegant declarative Prolog language had many people in the West worried
• Advances in probability theory Bayesian Networks / Causal Network
  

In order to combat this brittleness of intelligence Doug Lenat started a large scale AI project CYC in 1984. His idea was that there is no free lunch, and in order to build an intelligent system, you have to use many different types of fine tuned logical inference; and you have to hand encode it with a lot of common sense knowledge. Cycorp spent hundreds of man years building their huge ontology. Their hope was that CYC would be able to start learning on its own, after training it for some years.

AI in the 1990s

I did not loose my patience but other people did, and AI went from the technology of the future to yesterday's news. It had become a loser that you did not want to be associated with.

During the Internet bubble when venture capital founding was abundant, I was briefly involved with an AI Internet start up company. The company did not take off; its main business was emailing discount coupons out to AOL costumers. This left me disillusioned, thinking that I just have to put on a happy face when I worked on the next web application or trading system.

AI usage today

Even though AI stopped being cool, regular people are using its use it in more and more places:

• Spam filter
• Search engines use natural language processing
• Biometric, face and fingerprint detection
  
• OCR, check reading in ATM
• Image processing in coffee machine detecting misaligned cups
  
• Fraud detection
• Movie and book recommendations
  
• Machine translation
• Speech understanding and generation in phone menu system
  

Euphemistic words for AI techniques

The rule seem to be that you can use AI techniques as long as you call it something else, e.g.:

• Business Intelligence
• Collective Intelligence
• Data Mining
• Information Retrieval
• Machine Learning
• Natural Language Processing
• Predictive Analytics
• Pattern Matching
  

AI is entering mainstream computing now

Recently I have seen signs that AI techniques are moving into mainstream computing:

• I went to a presentation for SPSS statistical modeling software, and was shocked how many people now are using data mining and machine learning techniques. I was sitting next to people working in a prison, adoption agency, marketing, disease prevention NGO.
  
• I started working on a data warehouse using SQL Server Analytic Services, and found that SSAS has a suite of machine learning tools.
• Functional and declarative techniques are spreading to mainstream programming languages.
  

Business Intelligence compared to AI

Business Intelligence is about aggregating a company's data into an understandable format and analyzing it to provide better business decisions. BI is currently the most popular field using artificial intelligence techniques. Here are a few words about how it differs from AI:

• BI is driven by vendors instead of academia
  
• BI is centered around expensive software packages with a lot of marketing
• The scope is limited, e.g. find good prospective customers for your products
  
• Everything is living in databases or data warehouses
• BI is data driven
• Reporting is a very important component of BI
  

Getting a job in AI

I recently made a big effort to steer my career towards AI. I started an open source computer vision project, ShapeLogic and put AI back on my resume. A head hunter contacted me and asked if I had any experience in Predictive Analytics. It took me 15 minutest to convince her that Predictive Analytics and AI was close enough that she could forward my resume. I got the job, my first real AI and NLP job.

The work I am doing is not dramatically different from normal software development work. I spend less time on machine learning than on getting AJAX to work with C# ASP.NET for the web GUI; or upgrade the database ORM from ADO.NET strongly typed datasets to LINQ to SQL. However, it was very gratifying to see my program started to perform a task that had been very time consuming for the company's medical staff.

Is AI regaining respect?

No, not now. There are lots of job postings for BI and data mining but barely any for artificial intelligence. AI is still not a popular word, except in video games where AI means something different. When I worked as a games developer what was called AI was just checking if your character was close to an enemy and then the enemy would start shooting in your character's direction.

After 25 long years of waiting I am very happy to see AI techniques has finally become a commodity, and I enjoy working with it even if I have to disguise this work by whatever the buzzword of the day is.

-Sami Badawi

SharpNLP vs NLTK called from C# review

C# and VB.net have fewer open source NLP libraries than languages like C++, Java, LISP and Perl. My last blog post: Open Source NLP in C# 3.5 using NLTK is about calling NLTK, which is written in Python, from IronPython embedded under C# or VB.net.

An alternative is to use SharpNLP, which is the leading open source NLP project written in C# 2.0. SharpNLP is not as big as other Open Source NLP projects. This blog posting is a short comparison of SharpNLP and NLTK embedded in C#.

Documentation

NLTK has excellent documentation, including an introductory online book on NLP and Python programming.

For SharpNLP the source code is the documentation. There is also a short introductory article by SharpNLP's author Richard J. Northedge.

Ease of learning

NLTK is very easy to work with under Python, but integrating it as embedded IronPython under C# took me a few days. It is still a lot simpler to get Python and C# to work together than Python and C++.

SharpNLP's lack of documentation makes it harder to use; but it is very simple to install.

Ease of use

NLTK it is great to work with in the Python interpreter.

SharpNLP simplifies life by not having to deal with the embedding of IronPython under C# and the mismatching between the 2 languages.

Machine learning and statistical models

NLTK comes with a variety of machine learning and statistical models: decision trees, naive Bayesian, and maximum entropy. They are very easy to train and validate, but do not preform well for large data sets.

SharpNLP is focused on maximum entropy modeling.

Tokenizer quality

NLTK has a very simple RegEx based tokenizer that works well in most cases.

SharpNLP has a more advanced maximum entropy based tokenizer that can split "don't" into "do | n't". On the other hand it sometimes makes errors and splits a normal word into 2 words.

Development community

NLTK has an active development community, with an active mailing list.

SharpNLP was last release was in December 2006. It is a port of the Java based OpenNLP, and can read models from OpenNLP. SharpNLP has a low volume mailing list.

Code quality

NLTK lets you write programs that read from web pages, clean HTML out of text and do machine learning in a few lines of code.

SharpNLP is written in C# 2.0 using generics. It is a port from OpenNLP and maintains a Java flavor, but it is still very readable and pleasant to work with.

License

NLTK's license is Apache License, Version 2.0, which should fit most people's need.

SharpNLP's license is LGPL 2.1. This is a versatile license, but maybe a little harder to work with when the project is not active.

Applications

NLTK comes with a theorem prover for reasoning about semantic content of text.

SharpNLP comes with an name, organization, time, date and percentage finder.
It is very simple to add an advanced GUI, using WPF or WinForms.

Conclusion

Both packages comes with a lot of functionality. They both have weaknesses, but they are definitely usable. I have both SharpNLP and embedded NLTK in my NLP toolbox.

-Sami Badawi

Open Source NLP in C# 3.5 using NLTK

I am working on natural language processing algorithms in a C# 3.5 environment. I did not find any open source NLP packages for C# or VB.NET.
NLTK is a great open source NLP package written in Python. It comes with an online book. I decided to try to embed IronPython under C# and run NLTK from there. Here are a few thoughts about the experience.

Problems with embedding IronPython and NLTK

• Some libraries that NLTK uses are not installed in IronPython, e.g. zlib and numpy, you can mainly patch this up
  
• You need a good understanding of how embedded IronPython works
• The connection between Python and C# is not seamless
• Sending data between Python and C# takes work
• NLTK is pretty slow at starting up
• Doing large scale machine learning in NLTK is slow

C# and IronPython

IronPython is a very good implementation of Python, but in C# 3.5 there is still a mismatch between C# and Python; this becomes an issue when you are dealing with a library as big as NLTK.
The integration between IronPython and C# is going to improve with C# 4.0. How much remains to be seen.

To embed or not to embed

When is embedding IronPython and NLTK inside C# a good idea?

Separate processes for NLTK under CPython and C#

If your C# tasks and your NLP tasks are not interacting too much, it might be simpler to have a C# program call a NLP CPython program as an external process. E.g. you want to analyze the content of a Word document. You would open the Word document in C# create a Python process pipe the text into it and read the result back in JSON or XML and display it in ASP, WPF or WinForms.

Small NLP tasks

There is a learning curve for both NLTK and embedded IronPython, that slows down you down when you start work.

Medium sized NLP projects

The setup cost is not an issue so embedding IronPython and NLTK could work very well here.

Big NLP projects

The setup cost is not an issue, but at some point the mismatch between Python and C#, will start to outweigh the advantages you get.

Prototyping in NLTK

Start writing your application in NLTK either under CPython or IronPython. This should improve development time substantially. You might find that your prototype is good enough and you do not need to port it to C#; or you will have a working program that you can port to C#.

References

• Post about running NLTK from IronPython
• Chapter 15 of IronPython in Action is about embedding IronPython in C# or VB.NET
• Source code examples from IronPython in Action
  
• Here is a short intro to embedding IronPython by Michael Foord
• I tried loading Jeff Hardy's IronPython.Zlib.dll using Assembly.LoadFile, that did not work but I could add it with clr.AddReference from the embedded Python code

-Sami Badawi

Computer vision C++ libraries review

I am trying to create an easy to use, minimalistic C++ cross-platform computer vision system, with a non-restrictive license. My biggest challenge was to chose the best libraries and to get them to work together; this took some investigation and experimenting. This posting is a brief description of my findings.

This is what ShapeLogic C++ currently looks like:


Windows


Linux

In order to construct ShapeLogic C++, I had to make choices within the following categories:

• Computer vision and image processing libraries
• GUI libraries
  
• Unit test systems
• Build systems
• Compilers under Windows
  
• C++ IDEs under UNIX
  

ImageJ, the Java open source image processing tool, is the inspiration for the first part of my work: it is very simple to learn, use and program in. This is a follow up to my last posting: Computer Vision C++ vs Java. The result of my work is released as an open source project ShapeLogic C++, under the MIT license.

Computer vision and image processing libraries

The candidates I considered were:

• GIL, Generic Image Library
  
• OpenCV
• VXL

GIL, Generic Image Library

GIL, Generic Image Library by Adobe.

Pros

• Very non intrusive, only based on header files
  
• Puts a wrapper around most image format
• You can write a algorithm once and it will work for most image types
• Part of Boost since 1.35
  

Cons

• Does not come with a lot of image processing algorithms
  

OpenCV

OpenCV, Open Computer Vision by Intel.

Pros

• Very simple
• Works with both C and C++
• Very broad range of algorithms
• Complex algorithms: face detection, convexity defects
• Very popular
  

Cons

• You have to use OpenCV's IplImage
• IplImage byte order is BGR instead of the normal RGB
  

VXL, Vision X Library

VXL a combination of 2 big older vision libraries TargetJR and IUE

Pros

• Well tested technology
  
• Simpler build process using cmake
  
• Uses modern programming techniques: classes, template and STL
  
• It has a lot of functionality
  
• Simple to get started with

Cons

• It is not using normal STL, but in order to work on different compiler it had to make its own version with different names.
• Class structure is somewhat complex.
  

Choice computer vision library for ShapeLogic C++
OpenCV for existing image processing and vision algorithms. GIL for writing new algorithms.

Cross platform GUI

The candidates I considered were:

• GIMP plugin
• GTK+, GIMP toolkit
• FLTK
• HighGui from OpenCV
• PhotoShop plugin
• wxWidget

Run ShapeLogic as a GIMP plugin

Pros

• GIMP is the main cross platform OSS image editing programs.
  
• It is in wide use.
  
• Has a lot of powerful features including scripting functionality in Scheme and Python.
  
• From a user perspective this would be an excellent choice.

Cons

• GIMP is GPL, but you could have a wrapper around plugins in order to access them as GIMP plugins.
• The plugin works with tiles, which gives good performance, but does not fit well with either the way OpenCV or GIL are processing images.

GTK+, GIMP Toolkit

Pros

• GTK+ is a great looking and very powerful framework that works on: Windows, Linux, Mac, a.o.

Cons

• It is written in C and has a homegrown object system, which is not type safe.

GTKMM C++ wrapper around GTK+

Pros

• CTKMM is a great looking and very powerful framework, that works on: Windows, Linux, Mac, a.o.
  
• It feels natural to program in for a C++ programmer.

Cons

• The class hierarchy is somewhat deep since it is built on top of GTK.

FLTK, Fast light toolkit

Pros

• FLTK is very lightweight.
  
• Very clean C++, you actually have a main().
  
• Native C++ build on top of X11 or Windows.
• Fluid, a simple GUI builder
  

Cons

• Not as many widgets.
  
• Dated look.

HighGui from OpenCV

Pros

• Very lightweight.
  
• There is some functionality for displaying images, video and an event handler for mouse events.

Cons

• Does not come with a menu system.

Run ShapeLogic as a PhotoShop plugin

Pros

• PhotoShop is the main image editing programs.
  
• It is in wide use, has a lot of powerful features including macros.
  
• From a user perspective this would be an excellent choice.

Cons

• The PhotoShop SDK is not freely available, you have to apply to get it.
• The plugin does not fit well with either the way OpenCV or GIL are processing images.

wxWidgets

Pros

• wxWidgets is a full featured GUI toolkit, built on top of native toolkits: Win32, Mac OS X, GTK+, X11, Motif, WinCE and more.
• Looks good and modern.
  
• Big community.
• Several GUI builders.
  

Cons

• The programming style is close to Windows MFC programming.
  
• There are many layers.

Choice
This was a hard choice and I went back and forth between FLTK and wxWidgets, but went with FLTK. All the GUI code is separate from the image processing code, so if I wanted to change from FLTK to another toolkit later it should not be too dramatic.

C++ unit test frameworks

There are a lot of different choices and no clear leader. Some of the candidates were:

• Boost.test
• CppUnit
  
• Google C++ Testing Framework
  

Boost.test

Pros

• Boost.test is part of the Boost library.
  
• Powerful with a lot of options.
  

Cons

• You have to manually set up test suites.
  
• It is somewhat heavy.
  
• The documentation is extensive but not easy to read.
  

CppUnit

Pros

• CppUnit is following a standard unit testing convention XUnit.
• Integration with Eclipse CDT.
  

Cons

• You have to manually set up test suites.
  
• It is an extra library to install.

Google C++ Testing Frameworks

Pros

• Google test is following a standard unit testing convention XUnit.
  
• Strong focus on simplicity.
• Documentation is short and easy to read.
  

Cons

• It is an extra library to install.

Choice of C++ unit test framework for ShapeLogic C++

I spent quite a bit of time reading the Boost Test documentation, finally I tried Google C++ Testing Framework and got it working very fast.

Build system

The candidates I considered were:

• Boost build
  
• Make

Boost build

Pros

• Boost build is part of Boost.
  
• Clean design, made as a Make replacement.
• Works on most platforms and with most compilers.
• The scripts are pretty short.
  

Cons

• There is a learning curve.
  

Make

Pros

• Make is the standard for build on C++.
• Widely used.
• Works with Eclipse, MSVC, NetBeans.
• Short scripts.
  

Cons

• It has gotten messy over time.
  
• Shell script dependency.
  
• There is too much magic for my taste.
  

Choice of build system for ShapeLogic C++

I chose to go with Boost Build because it has a cleaner design, but Make looks very competitive when looking over the pros and cons.

Compilers under Windows

In order to compile Boost you need a pretty modern and standard compliant compiler. The candidates that I looked at are:

• Cygwin GCC
  
• MinGW GCC
• MSVC Microsoft Visual C++
  

Cygwin GCC

Pros

• Cygwin GCC is close to GCC under UNIX
  

Cons

• Uses emulation of UNIX system call.
  
• You can only use it to build GPL compatible application.
  

MinGW GCC

Pros

• MingGW integrates well with Eclipse CDT.
• Works more natively with Windows.
• Most libraries build fine with MinGW.
  

Cons

• It was supposed to be able to build FLTK, but I tried a few times and could not get it to work.
• In order to run Make files you also have to install MSYS, which is a minimal shell.
  

MSVC, Microsoft Visual C++

Pros

• MSVC is a high quality compiler.
  
• Most used compiler under Windows.
  
• There is a free Express version.
  

Cons

• There seems to be some restrictions of the Express version that I did not quite understand.
  

Choice of compiler under Windows for ShapeLogic C++

MSVC.

C++ IDEs under UNIX

The candidates I considered were:

• Eclipse 3.4
  
• Emacs / Xemacs
• NetBeans 6.1
  

Eclipse 3.4

Pros

• Eclipse 3.4 CDT has a good debugger.
• Easy to jump from classes to files defining the classes.
  

Cons

• Not nearly as good as Eclipse for Java.
• Unstable under Linux AMD64.

Emacs

Pros

• Emacs is powerful tools that runs in a terminal.
• Takes up less resources.
• Not dependent on Java.
  

Cons

• The Java bases IDE have more features.
• Demands more knowledge to use.
  

NetBeans 6.1

Pros

• NetBeans 6.1 seem a little lighter than Eclipse.

Cons

• It is made to work with Make files, and ShapeLogic C++ is using Boost Build / Bjam.
  

Choice of IDE under UNIX for ShapeLogic C++

Eclipse.

Summary of libraries and tools used

• Boost the C++ library
• Generic Image Library for writing new image processing code
• OpenCV for existing computer vision algorithms
• FLTK, Fast Light Toolkit lightweight cross platform GUI
• Google C++ Testing Framework
• Boost.build v2 for command line based build system

Status of ShapeLogic C++

ShapeLogic C++ 0.4 is the first alpha release. It can do some useful work, but it still mainly an example application.

Currently has

• Comes with some image processing operation
• Comes with 3 brushes
• It is pretty simple to program an image processing algorithm
  

Missing

• Drawing is currently slow and there is only one pen size
• None of the ShapeLogic Java algorithms have been ported yet
• Documentation is poor

Hardest problems

• Learning how FLTK works
• Building a cross platform C++ build script covering several libraries

None of these problems will effect ShapeLogic users.

Porting computer vision code from Java to C++

Before I started porting ShapeLogic from Java, I thought that C++ was moving towards becoming a legacy language. What I have learned from this work is that C++ has advanced substantially since 2002, when I last used it professionally. C++ still seems competitive, at least in computer vision, and according to my old video game colleagues also in games, where I though that C# might have taken a lead by now. Both C++ and Java have substantial advantages.

C++

• OpenCV has a lot of vision algorithms, e.g. face recognition
• C++ is faster than Java
  
• Better for video processing
  
• Programs are shorter
• Generic programming working on primitive types
  
• You can make build script that build under both Windows and UNIX

Java / ImageJ

• ImageJ has more open source algorithms for medical image processing
  
• Better support for medical image files formats under ImageJ
• IDEs are better under Java
• Build process is simpler than C++
  
• Simpler language
• Better support for parallel processing
• A lot easier to dynamically load plugins
  

The next step is to port my framework for declarative programming -- it is based on lazy streams -- and port the Color Particle Analyzer. C++ / Boost have good support for functional programming techniques: Boost.Bind and Boost.Lambda, and the Phoenix library has just been accepted into Boost. When complete, I will do another posting about how it went.

-Sami Badawi
http://www.shapelogic.org

Computer Vision C++ vs Java review

In 2007 I created an open source computer vision project, ShapeLogic, built in Java to work with ImageJ. This setup has been very easy to work with and very productive. Bjarne Stroustrup the creator of C++ gave an interview about the new features in the C++0x standard and TR1. C++ now has a lot of innovating programming constructs e.g. template meta programming, lambda functions, concepts and traits. When I found out that "axiom" is going to be a keyword in C++ my inner mathematician demanded that I take a second look at C++ in connection with computer vision.

This post is a review of my personal past experience with computer vision in C++ and Java. I did my masters thesis in computer vision in the early 90ies, but I ended up working in other fields: video games, Internet and finance, which only left a little time to do vision in my free time. While both C++ and Java were good choices for professional vision programmers, several of the approaches I chose caused me to run out of steam. I also tried to do computer vision with functional, declarative and hybrid languages e.g. Oz, Scheme and Scala but will not cover that here.

Borland C++ early 90ies

C++ did not have STL or any other standard library so I used Borland's OWL library for images and for the application. I used C++ templates, classes with multiple inheritance, RTTI just to set up basic container functionality. There were a few books that has some free C or C++ source code for image processing and vision, but they did not spawn a user community. I did not really get to do anything interesting.

JAI, Java Advanced Imaging late 90ies

I was very excited when Java came around, this was the language to cure all programming ailments. Now they had added a library that could be used for vision and a lot of big companies were sponsoring JAI. It turned out to be a very complex framework with a deep class hierarchy, I spent a lot of time reading the manual trying to find out how to get access to image pixels. I gave up using it and the framework never gained much popularity.

VXL, C++, STL, Boost, Python, GCC, Linux around 2000

Open source software, OSS had started to become prominent. There were 2 OSS libraries:

• OpenCV (Open Computer Vision), wich was still in alpha.
• VXL (Vision X Library) wich was a merge of 2 big non OSS libs TargetJR and IUE.

VXL finally got into beta and I tried to combine it with Python for more high level processing.

Tools needed for build and GUI

• VXL does builds using CMake to create Make files
• Boost uses BJam to do builds
  
• Python bindings using Pyste from Boost
• VXL used FLTK and OpenGL as a GUI

Problems encountered

• It was hard to get the different build systems, CMake, Bjam and Make, to work together
  
• GCC 3.1 and 3.2 core dumped when compiling certain Boost classes
• Python bindings worked for simple C++ classes, but not for the nested template classes in VXL
  
• It was hard to debug the template programs
  
• Emacs was not really as easy to use as Visual Studio
  
• Bad drivers for OpenGL on Linux
  

I actually got some examples set up, but spent more time fighting with the tool stack than doing vision work.

ImageJ in Java around 2004

A colleague showed me a visualization tool he had worked on and said that he did it in around 1 month. I barely believed him, but tried the underlying framework, ImageJ. To my big surprise I was up and running and doing real work in a few hours. ImageJ just got things right. It was built using pure Java by one man, Wayne Rasband. It is very easy to work with and very modular, so a lot of people have made plugins and there is a vibrant development community. When I started working on ShapeLogic that was the best choice.

OpenCV, GIL Generic Image Library, Boost and Eclipse in C++ 2008

In the light of advance in the C++ language and tools, I have decided to try it again.
C++ image libraries choices

• OpenCV, Open Computer Vision
  
• Openframeworks built on top of OpenCV
  
• GIL Generic Image Library
• VXL

I chose to start with OpenCV made by Intel and GIL made by Adobe but a part of Boost since 1.35.

C++ IDE tried

• Eclipse 3.4
  
• NetBeans 6.1
  

Eclipse worked better for me, it has its own build system so you do not have to mess with Make files.

C++ cross platform GUIs

• FLTK Fast Light Toolkit
• wxWidgets
• HighGui from OpenCV

Not sure which one will be best for my purpose.

First attempt
I tried Boost, OpenCV and GIL and got them up and running under both Linux and Windows in a few hours. Eclipse CDT C++ IDE works great.

Porting ShapeLogic algorithms to C++ version

My plan is to port some algorithms from ShapeLogic from Java to C++. ShapeLogic is a toolkit for declarative programming, specialized for vision. In principle you should be able to make a list of rules for categorizing say the shape of a particle in a particle analyzer. You put them in a database or a flat file and the same rules should work for C++ and Java version of ShapeLogic. In practice this might not work out.

Advantages of C++ and Java

This is a loose first assessment.
Constructs used in ShapeLogic that are missing or less convenient in C++

• Uniform cross platform GUI
• Dynamic cross platform libraries
• HashTable
• Reflection
• Garbage collection
• Antlr for parsing logic language
  

Advantages of C++ over Java in vision

• Substantially higher speed
  
• Better handling of video
• Used more frequently for computer vision programming
  
• Good tracking and face recognition algorithms in OpenCV
  

For me, Java has been very good for doing medical image processing algorithms. I have heard conflicting evidence about whether it is feasible for doing computer vision on video using Java. Video handling in Java has been bad up to now, this is supposed to be fixed with the new JavaFX. Shadow Monsters is a computer vision based art piece taking video footage of silhouette of the viewer and adding monsters to them, I saw it on display at Museum of Modern Art. It was programmed using Processing, which is a Java based image processing tool for artists. I discussed the issue with a computer programmer / artist who said that he had tried to do a motion algorithm in Processing and had to port it to C++ based Openframeworks since Java was too slow. After being discouraged by my prior attempts to do vision in C++, I am very happy to see the dramatic developments in C++ and see if it is suitable for a simple port of ShapeLogic algorithms. The result of this C++ port will be covered in 2 postings:

• Computer vision C++ libraries review
• Declarative framework and Particle Analyzer Java to C++ port
  

-Sami Badawi
http://www.shapelogic.org

ShapeLogic 1.2 with color particle analyzer released

Here are the release notes for ShapeLogic 1.2

Changes

• Particle analyzer working directly on color and gray scale images without manual user intervention
• Both particle counter and particle analyzer now take parameters and print reports about each particle's color, area, standard deviation to result table
• Color replacer replaces one color within a tolerance with another color. Parameter input dialog with preview check box
• Organize plugins and macros under ShapeLogic? and ShapeLogicOld? menus, until 1.1 they where all placed under shapelogic menu
• ShapeLogic still has beta development status

The particle analyzer in ShapeLogic v 1.2 has gone through limited
testing and seems to work well. There is still a bug in the edge
tracer.

Using particle analyzer as a ImageJ plugin

The particle analyzer was tested on the particle sample images from ImageJ embryos.jpg

To run it from ImageJ select "Color Particle Analyzer" in the ShapeLogic? menu:

First a particle count dialog is displayed:

Here is the result of running the non-customized particle analyzer on it. This is written to a result table that can be exported to Excel:

The categories for the particles are only examples, it is easy to setup different rules for categorizing particles. In ShapeLogic? 1.3 there will be custom rules to recognize specific cells.

ShapeLogic? 1.2 also contains the second version of a color particle counter. It also prints a smaller report of the particle's properties.

Plans for next release

The next release, ShapeLogic v 1.3, will be a more mature particle analyzer which will come with custom rules to recognize specific cells.

Seeking particle images

In order to create these rules, I am looking for images of particles on a relatively uniform background. Please let me know if you have sample images that I could work from, preferably standard images like the embryo sample image that comes with ImageJ.

Possible future plans for particle analyzer

• Create rule for recognizing cells using neural networks or machine learning techniques
  
• Be able to handle a background that is not uniform, and cell organelles
• Incorporate reasoning under uncertainty using the lazy stream library
  
• Find overlapping particles and distinguish them as separate

Download ShapeLogic 1.2

-Sami Badawi
http://www.shapelogic.org

ShapeLogic 1.1 with particle counter released

Here are the release notes for ShapeLogic 1.1

Changes

• Particle counter working directly on color and gray scale images without manual user intervention
• Particle counter finds average color, standard deviation, area and location for each particle
• Framework to build more advanced particle counters and particle analyzers
• Color clustering using K-mean algorithm
• Background color finder
• Extend all the image processing algorithms in ShapeLogic to work in both ImageJ and in plain Java
• Better support for NetBeans
• ShapeLogic still has beta development status
• 29000 lines of Java code
• 440 unit test that all works on local machine

The particle counter in ShapeLogic v 1.1 has gone through limited testing, and seems to work well though tweaking the parameters is still a bit clumsy. Users looking for a mature particle counter should probably wait for ShapeLogic v 1.2.

Test on sample images from ImageJ

The particle counter was tested on the particle images from ImageJ:

embryos.jpg. The un-tweaked particle counter in ShapeLogic 1.1 found

particle count = 9

embryos.jpg contains 6 particles and a few shadows.

After changing the parameter setting it found

particle count = 5

which is the correct value since ShapeLogic 1.1 cannot split overlapping particles.

Direction

This is the first use of ShapeLogic in medical image processing. The next few releases should also be focused on the particle counter, making it more robust and automatic. This is the plan for ShapeLogic 1.2:

• More testing and tweaking of particle counter
• Make it easier to set parameters for particle counter in a macro or a configuration file
• Print report about each particle's color, area, standard deviation to a file
• Different implementations of particle counters
• Vectorize particles by tracing the edge
• Filter particles based geometric properties of the edge using the same techniques as letter matcher
  

Download ShapeLogic 1.1

-Sami Badawi
http://www.shapelogic.org