chapados.org

When Tiger was released back in 2005, Spotlight search technology was all the rage. Several articles appeared showing off the technology and explaining the details. For most people, being able to easily find their files was all they cared about. Others thought it was too slow and immediately disabled it.

If you're a geek like me, you probably got excited when Amit Singh explained how to use the undocumented fsevents API to monitor spotlight events directly. However, although spotlight in Tiger monitors basic file activity, it ignored xattrs (extended attributes). This matters, because extended attributes have major potential to store arbitrary metadata on files. Ever wanted to be able to tag your files? Maybe you've used one of the existing Finder-comment hacks, or a more elegant solution like Tagbot. Perhaps you've experimented with spotmeta, a project started by Ben Summers that made extended attributes searchable through spotlight. In Tiger, this was difficult, since the fs_event system did not monitor changes to extended attributes. A quick look through the bsd kernel source code shows that this has changed in Leopard:

(from xnu/bsd/sys/fsevents.h)

// Event types that you can ask to listen for
#define FSE_INVALID             -1
#define FSE_CREATE_FILE          0
#define FSE_DELETE               1
#define FSE_STAT_CHANGED         2
#define FSE_RENAME               3
#define FSE_CONTENT_MODIFIED     4
#define FSE_EXCHANGE             5
#define FSE_FINDER_INFO_CHANGED  6
#define FSE_CREATE_DIR           7
#define FSE_CHOWN                8
#define FSE_XATTR_MODIFIED       9
#define FSE_XATTR_REMOVED       10

#define FSE_MAX_EVENTS          11
#define FSE_ALL_EVENTS         998

#define FSE_EVENTS_DROPPED     999

Leopard adds the FSE_XATTR_MODIFIED (9) and FSE_XATTR_REMOVED (10) events, making it possible to monitor changes to extended attributes. This might seem like no big deal. However, this opens the door to building custom metadata solutions and integrating them directly into the operating system. I haven't installed Leopard yet, so I'm not sure if Apple is utilizing this underlying technology for anything in Leopard. I checked the online Spotlight metadata attributes, and there is nothing obvious to suggest that Spotlight is making custom extended attributes easily searchable through the MDQuery API. Apple has a habit of adding features to the kernel in preparation for use in later versions of the OS (cough*autofs). This little gem of a feature could bring a project like spotmeta back to life, or inspire a new round of xattr-based metadata solutions. Stay tuned for more information on this topci after I have time to install Leopard.

(07-dec-2007 update: fixed a few typos)

1. You're working on a grant or paper with collaborators and your filenames look like this (no, I'm not making this up):

   endo07_gaz_D2edits_26oct_2pm_kih_26Oct_700pm_rick_27Oct.doc

2. The filename would actually be longer, except that then it would exceed the 255 character limit, so you just make it more cryptic instead. Soon you end up with files named:

   e07gD2e26o14k26o19r27o.doc

Version control software is not "for programmers only". If you're working on a collaborative writing project, please, pretty please, stop pretending that good version control tools do not exist and learn how to use one of them. While you're at it, ditch word and use a real text editor that supports syntax highlighting and integrates with your version control system. Then you can write with markdown + LaTeX using Pandoc and save yourself and your collaborators from lots of headaches.