What A Drone Can See From 17,500 Feet

Courtesy Of PBS - NOVA

A new camera developed by the Pentagon's research arm was highlighted in a recent special on PBS' "Nova" in an episode called "Rise of the Drones." It's a camera system so detailed it can discern specific movements and even what a subject is wearing.

The Defense Advanced Research Projects Agency's (DARPA's) Autonomous Real-Time Ground Ubiquitous Surveillance Imaging System (ARGUS) has 1.8 billion pixels (1.8 gigapixels), making it the world' highest resolution camera. The sensors on the camera are so precise, PBS stated it is the equivalent to the capabilities of 100 Predator drones in a medium city.

In the clip from PBS, it is said this is the first time the government has allowed information to be shared about these capabilities.

"It is important for the public to know that some of these capabilities exist," Yiannis Antonaides with contractor BAE Systems said in the clip, but noted the sensor itself cannot be revealed. "Because we are not allowed to expose some of the pieces that make up this sensor, so you get to look a pretty plastic curtains."

The technology allows the user to open up a specific windows of interest in the camera's view while still keeping up an image of the larger picture (sort of like split screen). 

Antonaides explained that the colored boxes in the image show that the sensor recognized moving objects. "You can see individuals crossing the street. You can see individuals walking in parking lots. There's actually enough resolution to see the people waving their arms or walking around or what kind of clothes they wear," he said. PBS noted that ARGUS can actually see much more details than just attire. It can see objects as small as six inches. At 2:23 in the clip, 

Antonaides points out that from 17,500 feet, a white object in the field of view is a bird flying. PBS pointed out that DARPA put a time crunch on creating the camera, which lead Antonaides to look into technology that you probably have in your purse or pocket at this very moment. Taking similar imaging systems used in smartphones and putting 368 together, is essentially how Antonaides and other engineers at BAE Systems created ARGUS. It is this "mosaic" of cameras that allows the system to zoom in on specific sections in extreme detail. As for data, the system stores up to 1 million terabytes a day. Putting this into perspective, PBS notes this is equal to 5,000 hours of HD footage.

"You can go back and say 'I would like to know what happened at this particular location three days, two hours, four minutes ago' and it would actually show you what happened as if you were watching it live," Antonaides said.

It is still classified information whether ARGUS has been used in the field yet.

"If we had our choice, we would like ARGUS to be over the same area 24 hours a day, seven days a week. That's not very achievable with manned platforms. This is where UAVs come in and they're absolutely the perfect platform," Antonaides said.

DARPA's New 1.8 GigaPixel Surveillance Drone

DARPA and the US Army have taken the wraps off ARGUS-IS, a 1.8-gigapixel video surveillance platform that can resolve details as small as six inches from an altitude of 20,000 feet (6km). ARGUS is by far the highest-resolution surveillance platform in the world, and probably the highest-resolution camera in the world, period.

ARGUS, which would be attached to some kind of unmanned UAV (such as the Predator) and flown at an altitude of around 20,000 feet, can observe an area of 25 square kilometers (10sqmi) at any one time. If ARGUS was hovering over New York City, it could observe half of Manhattan. Two ARGUS-equipped drones, and the US could keep an eye on the entirety of Manhattan, 24/7.

It is the definition of “observe” in this case that will blow your mind, though. With an imaging unit that totals 1.8 billion pixels, ARGUS captures video (12 fps) that is detailed enough to pick out birds flying through the sky, or a lost toddler wandering around. These 1.8 gigapixels are provided via 368 smaller sensors, which DARPA/BAE says are just 5-megapixel smartphone camera sensors. These 368 sensors are focused on the ground via four image-stabilized telescopic lenses.

The end result, as you can see in the (awesome) video above, is a mosaic that can be arbitrarily zoomed. In the video, a BAE engineer zooms in from 17,500 feet to show a man standing in a parking lot doing some exercises. A white speck is a bird flying around. You can’t quite make out facial features or license plates (phew), but I wonder if that would be possible if ARGUS was used at a lower altitude (during a riot, say).

ARGUS’s insane resolution is only half of the story, though. It isn’t all that hard to strap a bunch of sensors together, after all. The hard bit, according to the Lawrence Livermore National Laboratory (LLNL), is the processing of all that image data. 1.8 billion pixels, at 12 fps, generates on the order of 600 gigabits per second. This equates to around 6 petabytes — or 6,000 terabytes — of video data per day. From what we can gather, some of the processing is done within ARGUS (or the drone that carries it), but most of the processing is done on the ground, in near-real-time, using a beefy supercomputer. We’re not entirely sure how such massive amounts of data are transmitted wirelessly, unless DARPA is waiting for its 100Gbps wireless tech to come to fruition.

The software, called Persistics after the concept of persistent ISR — intelligence, surveillance, and reconnaissance — is tasked with identifying objects on the ground, and then tracking them indefinitely. As you can see in the video, Persistics draws a colored box around humans, cars, and other objects of interest. These objects are then tracked by the software — and as you can imagine, tracking thousands of moving objects across a 10-square-mile zone is a fairly intensive task. The end user can view up to 65 tracking windows at one time.

ARGUS-IS, surveying Quantico, Virginia. Click to see a much larger version.

According to the video, which is from the PBS Nova TV show, the ARGUS system in its entirety produces one million terabytes per day — all of which is stored by the Army for future use. We’re a bit skeptical about PBS’s crazy figure (a million terabytes is an exabyte), but in theory most of that data is actually meta data — the coordinates and other identifying features of the thousands (millions?) of objects being tracked by ARGUS.

The original goal was to deploy ARGUS in Afghanistan, but that never came to pass. It isn’t entirely clear what ARGUS’s future is; it was meant to be mounted on Boeing’s high-altitude A160 Hummingbird helicopter (pictured right), but the chopper has since been scrapped. If ARGUS is to be deployed, it will most likely be strapped to the underbelly of a Predator drone. Where it will be used, however, with the war in Afghanistan apparently winding down, is another question entirely. Its efficacy in a military setting would be unsurpassed, but it’s easy to imagine how ARGUS could be used here at home in the US, too.

Now read: Stop worrying, and embrace RFID

For the lore nerds out there: Argos was a 100-eyed giant from Greek mythology. His role was to act as Io’s guardian — a good, if typecast role, for someone with 100 eyes.

Via: "Extreme Tech"