…you won. Whatever induced you to unleash some triple threat virus attacking my eyes, throat, and stomach I’ll never know. But I gave up my last day of PyCon to lay low. And I’ll be heading back to the East Coast with my tail between my legs and an urgent need to schedule a doctor’s appointment.

Ned Batchelder’s PyCon 2012 talk on Pragmatic Unicode made the trip really worthwhile. First, it was excellently delivered with good humor. Second, it was very usefully pragmatic. I really learned something.

So I’m authoring this during one of the session breaks at PyCon. Good to be here but I seem to have caught some bug that has me running at half speed. Probably really need to spend a day or two in bed, but we shall muddle through.

Friday keynotes, Stormy Peters and Paul Graham, were entertaining, especially Graham. Talks I’ve attended have been good if not spectacular.

Definitely worth the trip so far!

Flew Virgin Airways on Tuesday. Have to say the experience didn’t match the hype. The plane had lots of shiny and rounded accents, but other than that, just about like every other airline. Maybe a little more legroom in Coach.

Was amused when the in-flight entertainment and food ordering system crashed. Then it went through a Linux reboot. I might have been the only person who enjoyed reading the boot log as it flew by.

Good on PandoDaily for generating an executive summary of the announcements at the latest Apple event. As an Apple customer, I’m intrigued by the new iPad, although it’s not a game changer. (Didn’t really expect it to be). I’ll wait to see what the reviews are on battery life versus 4G LTE are. LTE seems to me the only real discriminator.

I’m still tempted by the Apple TV, especially since it’s fairly cheap (1st world talking here). 1080p was one of my prior showstoppers, but that’s been fixed.

Still waiting for my 15 inch display, 8 GB RAM, 500 GB SSD MacBook Air-alike.

Link parkin’: Always enjoy Ted Leung’s conference trip reports. He just attended the O’Reilly Strata Conference (West Coast). I’m considering the East Coast version if it happens and Leung’s review of the event is promising.

Sergeant Phil Esterhaus: Hey, let’s be careful out there. —Hill Street Blues

Encountered a moment of intense fear but good old fashioned human kindness today.

Part of my commute involves the Rosslyn Metro. For those, not familiar with the subway system in our nation’s capital, a number of the stations are deeply underground. They have exceedingly tall escalators. We’re talking 3, 4, 5 stories deep. Rosslyn must be pretty close to the worst of the bunch. It’s a minor miracle that, given the number of daily commuters and how many rush headlong down those stairs, there aren’t many spectacular injuries (that I know of).

Well today a poor lady in front of me was the victim of the anti-miracle. We were both walking down at a reasonable pace, I was about two steps behind, and we were halfway down the escalator. She must have hit a stair edge, or slipped a heel or something.

And she started tumbling down the escalator. As I watched in horror she must have flipped over one or two times, before stopping, flat on her face, about 1/4 of the way down. Keep in mind the escalator is still moving, there are still people coming down, and she’s not really moving.

Along with a few other good samaritans, we catch up with the poor lady, get her to her feet before the end of the escalator, and help her move a few steps beyond the end. One person went back up to get the station manager and another called out to 911. As I’m giving her support, she was clearly dazed, confused and probably in shock. After a few minutes we got her over to a wall where she could lean for a spell and finally sit down. It wasn’t until then that she pulled up her pants leg and showed the horrific cuts from the escalator, and bruise that was already exploding. I would not be surprised if she hadn’t broken her leg.

Three or four of us stayed with her until station officials arrived. We gave our names and contact info and waited to see if any further assistance was needed. Luckily the EMT pros showed up in a short manner, with a stretcher, started immobilizing her leg, and took over the situation. We went our separate ways but it was an odd way to start the day.

Like Sgt. Esterhaus says “Hey, let’s be careful out there.” And let’s look out for one another.

As a newbie to following the Premiership, I realized that the stakes were high. But man, Andre Villas-Boas didn’t get much leash in managing Chelsea. AVB was sacked this weekend meaning he barely made it 3/4 of a season.

Surprising contrast with Arsenal, where Arsene Wenger’s head was on the chopping block after their early season beatdown by ManU. Now the Gunners are challenging for third position in the tables.

I still remember vividly sitting in the bedroom of our little Chicago condo and going “Holy shit!”, “Oh my god!”, and “Wow!” as I watched the worst incident in NBA history erupt. Woke up my wife from her regular evening nap on the couch.

Oft referred to as The Malice at the Palace, on a mundane Friday evening, the middle of the road Indiana Pacers and Detroit Pacers got into a brawl and then ignited a riot. In the immediate post-game reactions and dissection, the most poignant moments came from Bill Walton, a guy who loves basketball and the NBA. The sadness and dejection in his voice told the whole story. Thankfully, there were no serious injuries, but it was definitely a disturbing event.

I’m not yet into Grantland’s long form sports journalism, but I’m planning to make some time for Jonathan Abrams The Malice at the Place: An oral history of the scariest moment in NBA history

Hat tip Dan Fogarty at SportsGrid

As a graduate from a PLDI (Programming Language Design and Implementation) research group, I’m always suspicious when a brand spanking new language gets a lot of buzz. There are so many barriers against, nay even ways to measure, success that most of the newcomers wind up being also rans.

But the new language julia has some nice features, yet seems eminently pragmatic. Plus people who have good taste seem enthusiastic about its arrival.

Then again, Go was the bee’s knees not too long ago and it hasn’t taken over the world.

Given that I started and abandoned a transliteration of processing to Python, I’m interested in how others might approach the challenge. I just found out about the pyprocessing project. They’ve taken the path of using OpenGL, through pyglet, which I thought about but couldn’t figure out how the bit blitting capabilities of processing would work. That’s not saying much, since I have exceedingly minimal knowledge of OpenGL.

I’ll have to take pyprocessing out for a test drive. I hope the project succeeds. If it works well the toolkit would be a nice complement to Python’s emerging heavy duty data processing capabilities: cf. Numpy, SciPy, and pandas.

Last night, Randy Wittman, interim coach of the Washington Wizards, benched the execrable JaVale McGee and Nick Young for the second half of a game against Milwaukee. While I hope Wittman is only an interim coach, I have to give him props for the move.

“I’m done with young guys (as an excuse), Wittman added. “ If they don’t want to play the right way, young guys aren’t going to play. It does us no good. They’re not going to learn anything when they want to play the way they want to play. All they’re developing are bad habits.”

Hat tip Comcast Sports Net Washington

Even better, both players were benched for the start of tonight’s game against the Orlando Magic.

Luv, Luv, LUV, Walter Jon Williams near history science fiction work (prior MPR mentions). So all I really needed to get out of Williams’ Big Idea entry for John Scalzi’s writer self-promotion series, was that Williams’ new book The Fourth Wall is on store shelves. Even better this is a continuation of the Dagmar Shaw series. Our intrepid Alternative Reality Game designer is making a return appearance in what looks like an exploration of the future of entertainment and media.

Check out WJW’s pitch if you need more convincing. Me? I’m going straight to Amazon after I finish this post.

Luke Wroblewski does a great job with Data Monday pieces. His most recent was: Data Monday: Amazon Prime. While I don’t think I increased my spending (rate and/or magnitude) at the levels highlighted by his data links, I definitely will buy “higher priced” items. Often for me, when you add in the alternative‘s shipping costs Amazon comes out ahead.

And 2 day shipping just soothes that instant gratification itch so well.

Interesting though that Prime might not actually be a big win for Amazon.

As a self-proclaimed Mad Data Scientist (Apprentice 3rd Class), I’ve learned at least two lessons, maybe more. First, you will wait. When you get upwards of 32 Gb of data, it’s almost impossible to just read through the data in a reasonable amount of time on commodity hardware. You’ve left the land of interactivity son, live with it.

As a result of that first lesson, one gets in the habit of timing everything. If it takes a while for a task to run, you want to know how long, just in case you have to run it again. You want to know how that runtime is growing with data growth. Better be at least linear, preferably sub-linear. And if not, well you’ve got a problem.

Of course, Nathan Marz captures the issues much better than me, backed by much more real-world experience. At the end of the day, it all comes down to creating data views that go as fast as possible.

Consider the source, an author with a forthcoming book on Bell Labs, but Jon Gertner has an interesting opinion piece on innovation in today’s New York Times:

“So how can we explain how one relatively small group of scientists and engineers, working at Bell Labs in New Jersey over a relatively short span of time, came out with such an astonishing cluster of new technologies and ideas? They invented the future, which is what we now happen to call the present. And it was not by chance or serendipity. They knew something. But what?”

Looking back at the iconic computing industrial R&D labs (Bell Labs, IBM Watson Labs, Xerox PARC), I’ve become more interested in how researchers weathered the bumps, rather than the frequent organizational hagiographies. Having seen the insides of industrial R&D, it couldn’t have been all milk and honey at the core. For every great breakthrough, were there two, three, five battles with management to keep the project going? How many promising junior folks just didn’t pan out or got chewed up and spit out? Along with the great collaborations, were there backstabbing rivalries?

Mostly, I’m interested in how these organizations developed and sustained a culture of innovation, no matter how brief. I forget who it was but a senior researcher in computing floated the notion that the field can only have one or two of these organizations extant and thriving at any given time. Outside of the raw numbers game of high quality researcher, I’m wondering if there isn’t some other fundamental limitation.

PostgreSQL’s table functions are a pretty handy feature:

Table functions are functions that produce a set of rows, made up of either base (scalar) data types, or composite (multi-column) data types. They are used like a table, view, or subselect in the FROM clause of a query. Columns returned by table functions may be included in SELECT, JOIN, or WHERE clauses in the same manner as a table, view, or subselect column.

Especially when combined with the embedded procedural languages one can fold a lot of external functionality into typical SQL idioms. Of course I’m sort of partial to the fact that PostgreSQL supports Python as a procedural language straight out of the box.

Feeling like it’s time to change up my listening habits on the iPhone. Right now, I only listen to about 4-5 playlists on a regular basis. There might be another 10 (and that’s being generous) that I listen to occasionally. Finding good mixes on the Amazon MP3 or iTunes Music stores is getting more difficult.If I can get up to speed on iTunes’ Smart Playlists, I’ll dump many of my regular playlists off of the iPhone. Then I’d really like to dial into some house, DnB, and other electronic music podcasts and downloads. Thanks to Tweetbot, I’m seeing a number of podcast retweets in my Twitter stream.

For example, DJ Mark Farina recently wiped out his SoundCloud page and then uploaded a boat load of material. I’ve probably downloaded a bunch in previous incarnations but maybe these are cleaner or higher resolution. Almost definitely a few I haven’t downloaded.

Time to get some inflow from the magnificently wider world.

I know it’s not fair, but I’m sort of pining for a NetNewsWire update. Black Pixel just had a release back in October. But when the product changed hands, Brent Simmons and Daniel Pasco got me all hyped up. Unfortunately, Black Pixel aren’t the prolific bloggers compared to Brent Simmons’ output.

Update. That’s what I get for posting late when tired. Title changed to NetNewsWire from MarsEdit, another fine application which has definitely been regularly updated by its publisher.

Maybe I’m doing something wrong, but I find I’m fighting PostGIS’s query planner way too often. The problem is that I have a table with a lot of records, the planner incorrectly thinks a geospatial filter will eliminate a lot of the rows, and then decides to do an index scan across the entire table. This happens even when I pair the geo filter with a highly selective date range query. Seems like a known problem with GIST indexes.

Reworking the query to use a subselect, wrapping the geo select around the date filtered select, seems to do the trick. But when you’re working against the system either you’re doing something the system wasn’t designed to do, or you don’t understand the system. Or both.

More investigation needed.

Even though I’m pulling a big quote, David Galbraith’s I Used to Love Trains, is worth reading in its entirety.

So why isn’t the same true of the road network? That requires massive infrastructure and in France the road network is possibly the most free-market driven infrastructure in the world with private toll freeways operated by companies in places like Dubai. The French road network is ironically far more capitalist than America’s. But it isn’t the nature of the ownership of the infrastructure but the nature of the network itself that determines its character. Railways can only pack a very few number of trains on at one time and there are few exits or stops. Roads have many vehicles like little packets of transport. The road network is like a packet switched one, like the Internet whereas the rail Network is like the legacy, fixed line, monopolistic telephone system.

Galbraith is someone else I’ve been following for quite a while. He’s done quite a bit of interesting stuff in the past. Some of the projects have been quite successful so he speaks with some authority on technology. Galbraith doesn’t post all that frequently. So each one should be savored.

Foo. An exceedingly high profile work event has popped up. Luckily it’s located in Menlo Park, CA but of course it’s scheduled for March 7th and 8th. That’s right, dead on top of the 4 tutorials I planned to attend at PyCon 2012.

The downside is that I can’t mainline my PyCon experience like I wanted to. And I was really looking forward to catching up with Allen Downey, a contemporary of mine at UC Berkeley.

The upside is that my flight should now be reimbursed, I get a couple of nights in a hotel, and I can probably expense a rental car. Plus two vacation days I was planning to take go back in the bank. Yeah me!

Maybe I’ll make up for it at SciPy 2012. There’s some fine folks I’d like to visit in Austin, TX.

Kudos to the PyCon arrangements team though. I was refunded my tutorial payments with no hassle and the reversal cleared my credit card a day or two ago.

I had the pleasure this past weekend of attending the 2012 BEYA Stem Global Competitiveness Conference in Philadelphia. The event was a much bigger deal than I expected, punctuated for me by conversations with some really high achievers. I also really enjoy visiting The City of Brotherly Love. My accommodations at the Philadelphia Downtown Marriott were quite acceptable, except for one crucial technology element.

Internet access (wired or wireless, everywhere, even in the lobby) cost $12.95 per day. WTF!!

I scoff at you Philadelphia Downtown Marriott and your outrageously overpriced Internet access. Thanks to Starbucks, Cosi, and 3G on my iPhone, I partook of none of your price gouging product. It was a touch inconvenient, but that’s a few less shekels in your coffers. Shame on you!

Just more incentive to get a pay as you go MiFi.

Just a few random thoughts on my iPhone 4 even though it too is getting a little long in the tooth. First, the dang thing is pretty doggone beautiful. Probably like many folks, I got suckered into buying an ugly case before I walked out of the AT&T store, on the pretense of protecting it from a fall. Recently I just took the dang case off and decided to live with the consequences. The iPhone 4 is a sweet looking device and deserves to go unadorned.

Second, the device has gotten me down to typically transporting one laptop and often no laptop. For a while I was lugging my personal MacBook along with my work machine. I was under the delusion that there was enough personal stuff needing doing that I had to have my own machine at all times. Turns out all I really needed to do was 1) check e-mail and occasionally respond, 2) check bank accounts, and 3) keep up with my feeds in NetNewsWire. Well the iPhone takes care of that, gives me the web, provides my GPS navigation, and even let’s me keep up with my posting.

People bitch about not getting jetpacks but hell, you got a ParcTab. Beats flying around looking like a dork.

Despite my extolling the endurance of my late 2008 White MacBook, it looks like Apple is going to deny it an update for the next version of OS X. Dubbed Mountain Lion, Ars Technica is reporting the list of supported machines. And my Trusty Old MacBook doesn’t make the cut.

C’est la vie. Hopefully they’ll provide a few updates for Lion and I can keep productively using the old laptop. At least until I get my hands on my dream 15 inch Air-like PowerBook.

Just for the heck of it, I was considering getting some cards from MOO to hand out when I attended PyCon. I’ve got spiffy cards from work but this is a personal trip. Looks like a few other folks had the same idea, MOO caught wind of the trend, and now they’re running a PyCon special on MOOcards. Nice touch delivering directly to the conference for pickup.

Previously I had posted about tire kicking Tastypie, a toolkit for creating RESTful APIs in Django. Well after a few kicks I think I can recommend it as a good solution for exposing data repositories as Web services. I’m currently using it strictly for read-only access to a relatively simple, but large, database, but getting going was insanely easy. And tastypie turns your Django models into full on REST resources, not a poor RPC over HTTP knockoff.

What really won me over is that I ran into a problem where the default behavior led to a SELECT COUNT(*) from a very large table. That’s a no-no in PostgreSQL. Overriding one method to do some raw SQL into a summary table solved the issue.

Bonus, works very nicely with GeoDjango’s geospatial extensions, which also surprised me with it’s ease of use. Helps that the geobjects have “convert to JSON methods” that just do the right thing. Worked straight out of the box.

Link parkin‘: Neato prints by Niege Borges that deconstruct dances from various popular movies and television shows. Includes illustration for one of my guilty pleasures, Chicago and one of my all time favorites (top 5 no less) Pulp Fiction.

Seriously considering buying one or two to put in my office as conversation starters.

I’m anointing myself as a “Mad Data Scientist, Apprentice 3rd Class, Autodidact” based upon hacking activities at work and at home. One of the things that’s starting to interest me is constructing teams of people to do investigations into massive data sets. Herewith a couple of interesting links related to the topic:

Kurt Schrader, Building a Data Science Team at a Startup - An Engineering Perspective

“A data science team seems to end up having people from a much more diverse set of backgrounds than a normal engineering team does, and because of that you’re going to need to figure out how to fit the data science team into your organization. One thing that we’ve eventually come around to is to throw our normal engineering practices out of the window and to start working towards having the data science team work with whatever tools they need in order to move as quickly as possible in their own way.”

DJ Patil, Building Data Science Teams

“All the top data scientists share an innate sense of curiosity. Their curiosity is broad, and extends well beyond their day-to-day activities. They are interested in understanding many different areas of the company, business, industry, and technology. As a result, they are often able to bring disparate areas together in a novel way. For example, I’ve seen data scientists look at sales processes and realize that by using data in new ways they can make the sales team far more efficient. I’ve seen data scientists apply novel DNA sequencing techniques to find patterns of fraud.”

Really, I had no idea about this MacBook Pro redesign rumor when I posted about my lust for a 15” MacBook Air. Unclear what the processor, RAM, and storage specs would be but I have to imagine anything with “Pro” in the name should be able to sport 8 Gb RAM.

I’m guessing that as a first iteration on blending Air and Pro this’ll wind up being a premium product. Hopefully it only cost an arm or leg, not both.

For the longest time I’ve been really irritated by an old iTunes on iOS misfeature. If a playlist or track name was really long, there was no way to scroll it and see the cut off portion.

Imagine my surprise this past Friday, when I just happen to press on a playlist name for an extended period of time and up pops a black balloon with the full name. Don’t know when Apple fixed it, but irritant removed. Good on ya, Cupertino.

Previously I had posted about Sleepy.Mongoose, a module for making “RESTful” services out of MongoDB. Turns out Sleepy.Mongoose is really more RPC over HTTP then REST. Plus it seems to be a bit neglected. I gave it a test drive at work and wasn’t feeling very comfortable. So I’m giving Sleepy.Mongoose a pass.

I’m planning to use Django for some backstage Web administration tools, so thought I’d see if there’s anything good for that framework. Ran across Tastypie and looks like it has potential. Especially since there’s a clear example of how to wrap a non-Django ORM data sources. Along with continued maintenance and an active community. Kicking the tires this weekend.

Link parkin‘ Piston just in case Tastypie falls through.

ArsTechnica is reporting that Apple’s venerable white MacBook has reached the end of the line. They’ve informed their educational channels there aren’t any more to be had. It’s not even clear if Apple had been manufacturing the product at all recently.

Longtime followers (follower?) will note that the vast majority of this blog has been written on one of those MacBooks, from the second post up to this very one you’re reading. The laptop has been one of the better product purchases I’ve ever made. In fact, if you have pretty basic computing demands, it’s still a good value now, three and a half years later on. I’d honestly recommend picking up one on eBay if it’s in good condition.

Thanks to This Old MacBook, I can wait patiently for the 15” MacBook Air sporting 8 Gb of RAM and an affordable 500 Gb SSD. Right along with a Unicorn!

Finished up my PyCon 2012 registration by adding a heap of tutorials:

• Bayesian statistics made (as) simple (as possible)
• Data analysis in Python with pandas
• Social Network Analysis with Python
• Making Interactive Maps for the Web

I would have preferred Raymond Hettinger’s Advanced Python 1 instead of Social Network Analysis, just to break up the data intensive run, but it was sold out. Maybe sometime in the future.

That’s gonna make for a pretty packed and intense schedule when you factor in the talks on Friday, Saturday, and Sunday. Not to mention I’m essentially taking red-eye flights on each end. But the goal is to mainline the Python experience and come back firing on all hacking cylinders. We’ll see if I survive.

Figures of course. Flip Saunders dismissed. Andray Blatche on the disabled list. The Wizards play better. Not great just better.

But they are no longer threatening for the worst win percentage in league history. What’s that about small victories?

Of course now they’re just down to three stooges. Nick Young is on a one year contract so I’m not too worried about him. I won’t stop holding my breath about Ernie Grunfeld until after the trade deadline. Sure I’d like to see him move Blatche and/or Young, but I’m scared of what might come back. Another Rashard Lewis? Tyrus Thomas? Saw his act when he was first drafted by the Bulls. Hey, Mike Bibby isn’t getting any run in New York! That worked out well last time.

And I was just about to say I could live with Javale McGee until the world was regaled with this lovely reminder of his talents:

Looking to clean up my desktop, I recently purchased some new MacBook related hardware.

• A Henge Dock to park my old MacBook. They’ve got great marketing materials which sold me, but at the end of the day this feels a bit like a glorified cable organizer. Took a little more effort than I expected to get my machine integrated, and the Ethernet port on my laptop seems misaligned. However, the Henge Dock’s vertical orientation of the computer did help me clear some desk space. Still need to live with it for a bit. I wouldn’t discourage anyone from buying one, just know what you’re getting into. Having said all that, I don’t intend to send it back.
• An Apple Magic Trackpad. As expected, very elegantly designed and “just works”. Need to get the hang of clicking, selecting, and dragging with it though.
• A Microsoft Wireless Desktop 2000 kit. The various Apple keyboards just didn’t feel right. I really wanted to go wireless so the full sized USB Apple version was right out. The Apple wireless keyboard is small and light, but cramped. So I went cheap just to get started, and picked up this Microsoft bundle. Seems to be working out fine and the included software correctly remaps the keys to make them Apple compatible.

Superbowl XLVI is today. I have to say I’ve become increasingly disinterested in the event. The actual game is appointment television, but the two week buildup, the pregame, the partying, the halftime show, etc. etc. do nothing for me. I’ve taken to tuning in as close to kickoff as possible, even missing up to the first five minutes of the game. Only got burned on Devin Hester’s opening kickoff return, ’natch.

I’d like to think it’s age and maturity. Could just be familiarity and cynicism.

Okay, with the right people I can be interested in partying, but I’m just sayin’.

Still working to schedule my three large scale tech events this year. PyCon is close to set, but now I need conferences two and three.

Don’t know how I missed this, but O’Reilly and Cloudera combined Hadoop World and Strata. It’s going to be in New York, in October. Perfect topic, timing, and location. We’ll have to see what the registration costs are and of course New York isn’t exactly the cheapest city to visit.

Meanwhile, SciPy 2012 will be in July in Austin. Downsides? Another Python conference and Texas in July. Upsides? Another Python conference and it’s Austin, Texas. With friends in the area, it’s very tempting.

And I’d still like to squeeze in a David Beazley Chicago Python course.

Link parkin’: Kristina Chodorow’s Sleepy.Mongoose Python module turns a MongoDB server into a Web based REST server. Might make for a really convenient, fast, lightweight object store.

Jeremy Zawodny on the Meet Magit screencast:

“Having seen the video, I find that I most often refer to the Magit Cheatsheet and the Magit User Manual. If you’re an emacs and git user, you probably owe it to yourself to spend 15-20 minutes watching the video and trying out magit. I think you’ll quickly realize how useful it is.”

That would be me sir. I’ve been using magit regularly but in the most naive of fashions. So I will be following your suggestion posthaste.