Intelligent Media Processing Laboratory – Ongoing Research Projects

Hi ECE Students — I welcome all of you to participate in one or more of my research projects.  In order to contribute you should be motivated to learn and explore.  Some of my projects have funding for student research salaries — job openings will be posted and announced.

My projects include:

  • Convolutional neural networks (deep learning)
    • Character-based tweet classification
    • Computer vision for robotic applications
    • Image colorspace analysis
    • Retrieval of “similar” images from among a collection
  • Video compression
    • New and improved algorithms for video compression
    • Interaction between image/video compression and computer vision
  • Digital chip design/computer engineering
    • Use of High Level Synthesis for modeling, implementation and verification of circuits for compressed video

I am also willing to supervise research in other areas where I have expertise, including embedded systems, digital signal processing, digital music, adaptive filtering, active noise cancellation, probability and statistics and digital communication.

If you have interest please contact me at pearlstl@tcnj.edu.  I look forward to your joining our team!

 

Video Compression, Information Theory, and the Central “Intelligence” Agency

A few weeks ago, in ELC 470 class, I spoke in vague terms about a compression hoax that I investigated as part of a due-diligence effort, while employed at ATI Technologies (ATI subsequently merged with AMD, the company that makes the chips in your PC).  A friend of mine will soon be joining Intel in Portland, and this prompted me to see if I could dig up more information on this topic (it involved Intel’s video “home” group in Portland).  It turns out that this was the early-ish part in the history of an elaborate scam that wound up getting millions from the CIA, and reportedly nearly had civilian planes shot down!  My report on the company strongly suggested that there was a hoax being perpetrated, but at the time I didn’t have enough information to prove it beyond doubt.  The hucksters skillfully avoiding saying too much, and never returned requests for compression samples to analyze.

A partner at ATI who joined me in the due diligence investigation reported back enthusiastically on the promise of the technology.  The positive response that this hoax received from highly intelligent people was pretty amazing and scary, considering that there had been a number of fairly well-publicized video compression scams during the previous decade.

I don’t really know how the compression scam morphed into the intelligence scam, but my vague recollection is that the compression scam was pre-9/11.  So the advent of 9/11 probably gave the scammers an opportunity to deftly weasel away from the Intel racket (which would likely have blown up shortly), and start fresh with the CIA.

Here’s some info from an article in “The Register”:

A long and highly entertaining Playboy article explains that in 2003, 50-year-old Dennis Montgomery was chief technology officer at Reno, Nevada-based eTreppid Technologies. The firm began as a video compression developer, but Montgomery took it in new and bizarre directions.

He reportedly convinced the CIA that he had software that could detect and decrypt “barcodes” in broadcasts by Al Jazeera, the Qatari news station.

The Company was apparently impressed enough to set up its own secure room at the firm to do what Montgomery called “noise filtering”. He somehow produced “reams of data” consisting of geographic coordinates and flight numbers.

In December 2003, it’s claimed CIA director George Tenet was sufficiently sold on Montgomery’s data to ground transatlantic flights, deploy heavily armed police on the streets of Manhattan and evacuate 5,000 people from the Metropolitan Museum of Art.

Homeland Security secretary Tom Ridge told the press the terror alert was the result of “credible sources – about near-term attacks that could either rival or exceed what we experienced on September 11”.

And more is detailed in a book:

https://books.google.com/books?id=P7zaAgAAQBAJ&pg=PA48&lpg=PA48&dq=etreppid+pay+any+price&source=bl&ots=W0XWZj083E&sig=ZaZAnjo9gKWEsr4NKPYcvWGI4sc&hl=en&sa=X&ei=G0gMVZHKHIuzggSI1ILwAw&ved=0CB8Q6AEwAA (Links to an external site.)

 

Another interesting article at:

http://www.nytimes.com/2011/02/20/us/politics/20data.html?_r=0 (Links to an external site.)

The C.I.A. never did an assessment to determine how a ruse had turned into a full-blown international incident, officials said, nor was anyone held accountable. In fact, agency officials who oversaw the technology directorate — including Donald Kerr, who helped persuade George J. Tenet, then the director of central intelligence, that the software was credible — were promoted, former officials said. “Nobody was blamed,” a former C.I.A. official said. “They acted like it never happened.”

Hello TCNJ!

I am delighted to be joining the distinguished academic community at The College of New Jersey.  In the 2014 Fall Term I am teaching:

  • ELC 383 – Electronics II
  • ELC 411 – Embedded Systems

and in the 2015 Spring Term I am teaching:

  • ENG 312 – Digital Circuits and Microprocessors
  • ELC 470 – Digital Video Processing and Compression

I am the director of the newly established TCNJ Intelligent Media Processing Laboratory (IMPL), which will involve research in the following areas:

  • Computer Vision
  • Processing of stereo and multi-view video
  • Digital video picture quality enhancement
  • Audio/video synchronization
  • Recovery of missing information from image sequences
  • Adaptive audio processing
  • Video compression

Please feel free to contact me about the possibility of joining my research program — opportunities for summer support under the Mentored Undergraduate Student Experience (MUSE) program and/or course credit via the research track are available.