Insights

Facial Recognition: How We Got Here

The tides turned swiftly with the onset of the pandemic in early 2020, forcing us to reevaluate our product roadmap amidst the uncertainties that businesses across the globe faced.

Colin Leatherbarrow - Managing Director of Grosvenor Technology

Colin Leatherbarrow


President

In early 2020, GT Clocks was immersed in engineering a robust product roadmap centered on our cutting-edge time clock – the GT8. Positioned as a flagship design, this timeclock aimed to be a powerhouse of features, ensuring top-notch security and performance. The success of our initial GT10 Android 6 device propelled us into significant HCM opportunities, especially in the thriving North American market.

Simultaneously, we were laying the groundwork for GT Connect, an innovative SaaS Cloud-based clock management platform designed to encompass middleware, PII/Biometric data compliance, and seamless data distribution.

At that time, our biometric roadmap was in a steady state, fingerprint technology provided by recognized industry leaders such as HiD’s Lumidigm and Suprema SF range were fully integrated into our timeclock solutions, along with advanced on clock capability for 1:N identification into the tens of thousands. Tried and tested technology, ideal for the HCM industry and adopted as the Defacto solution for biometric identification or verification needs for HCM applications.

However, the tides turned swiftly with the onset of the pandemic in early 2020, forcing us to reevaluate our product roadmap amidst the uncertainties that businesses across the globe faced.

A notable shift during the pandemic was the emphasis on touchless operation, particularly impacting the use of fingerprint technology. This prompted us to revisit facial recognition technology, previously considered less in demand in the HCM market.

Our challenge was clear – develop a facial recognition solution that seamlessly integrated with our existing devices, offered swift and user-friendly operation, ensured the utmost security in handling facial data, and, of course, remained cost-effective.

Roll on Facial Recognition

GT Clocks had, in fact, evaluated facial recognition prior to this, but conversations with our existing customers led us to believe there was insufficient demand in the HCM market. Fingerprint technology was regarded as mature, reliable, and an accepted solution for both identification and verification applications.

And whilst it is fair to say facial recognition has been around for some time in the market, it is also fair to say it was mainly used in high-end security applications. Entering a secure facility is one thing, but clocking in 100 people starting a shift where every second is either their time or your money is entirely another.

So that was the challenge we faced, and I wish I had known back then what we have learned as a company since that day.

To set the scene, we already had many thousands of devices in the field, so whatever solution we developed needed to operate where possible with our existing solutions. The operation had to be as fast and easy to use as the established solutions, and importantly, it had to be secure as we were capturing and processing people’s facial data. Finally, and most technically challengingly, it had to be cost-effective, as the incremental cost of the technology could not move the overall solution outside of the market price for a timeclock.

After a round of rapid prototyping, we made the strategic decision to leverage the onboard cameras in our GT8 and GT10 clocks. Through the development of sophisticated algorithms, we achieved facial recognition capabilities, enabling both verification (Card or Pin + Face) and identification (Face only).

Beyond the core solution, we incorporated features like Mask Detection and thermal screening, directly addressing the unique demands arising from the pandemic. The choice of Visible Light and IR Cameras in the GT8 proved to be a good one, especially in diverse lighting conditions.

On a bench, we rapidly developed a demonstrable prototype that was performant and user-friendly, able to recognize a face and match 1:10,000 faces in around a second on our GT8 Clock. So far, so good! Then, the real work started translating that to the real world, making it work for our partners in the many environments it needed to.

It became very quickly apparent that the environment and lighting were key factors, and luckily, the technology choice we had made of Visible Light and IR Cameras in the GT8 turned out to be the right one. Our GT8 device is equipped with a combined Visible and IR capable camera, augmented with both LED (white) and IR illumination, both of which significantly improve the solution in poor lighting environments.

But technology only takes us so far, and whilst we continue to develop facial recognition software updates and features such as temperature screening, the reality is that the installation and environment really do count. Also key here is the customer’s perception of what face recognition can do – can it recognize the face of someone wearing a large mask, glasses, and a hat, for example? The simple answer is no. This is impossible if there is not enough information (or, put another way, points of minutia available for the algorithm to work effectively). It may be possible to verify where it’s a one-to-one match, but generally not suitable for identification.

It’s not just about the technology, as much as it is about effectively communicating the real-world capabilities of facial recognition technology and, importantly, how it can be successfully implemented in differing environmental conditions.

Successful implementation involved addressing various considerations, from compliance and terminal placement to user spacing, lighting conditions, enrollment processes, and even clock cleaning. Despite the challenges, our facial recognition solution emerged as a powerful and reliable tool, efficiently processing staff in a touchless manner while safeguarding end-user information.

GT Clocks, along with our customers, has learned a huge amount about successfully implementing face recognition, and here are a few of the considerations to think about:

What to consider when implementing a face recognition solution?

  1. Compliance and Attestation: Ensuring compliance and attestation for the use of facial data in time tracking is our top priority, both legally and practically. We’ve developed on-clock applications and Cloud-based middleware to securely collect and process facial data. This not only facilitates the clear attestation of the biometric owner but also includes an automatic data destruction feature if the attestation expires or is revoked.
  2. Optimal Terminal Placement: Mounting the terminal at a specific height and considering the surrounding environment may sound straightforward, but it’s crucial. In cases where two faces are in the camera view, the system needs to intelligently decide which one to use. After all, it’s just a machine!
  3. User-Friendly Space: Providing users with ample space to interact with the device without interruptions from others is key. Placing the terminal in a narrow, busy space poses challenges and affects the user experience.
  4. Importance of Lighting: Lighting plays a critical role. Consistent lighting enhances performance. Avoid pointing the face recognition device at strong or flashing light sources, and steer clear of strong backlighting, which reduces contrast and, consequently, the algorithm’s precision. The optimal solution involves consistent front-facing lighting.
  5. Effective Enrollment Process: The enrollment process is a linchpin, following the fundamental computer principle: garbage in, garbage out. Staff should be aware that the quality of face presentation during enrollment directly impacts their future experience with the clock. We’ve provided a simple guide for this purpose.
  6. Accommodating Height Differences: Recognizing significant differences in user height is vital. Depending on the diversity of users, more than one clock or alternative verification mechanisms may be necessary.
  7. Clock Maintenance: Clock cleanliness is often underestimated but critical. Smudges and smears on the device’s front glass can compromise the camera’s effectiveness. Sometimes, it’s the simple things that make a significant difference!

Having said all the above, we continue to actively improve the technology and have a busy schedule of planned updates to face recognition over the coming months. Our philosophy is to continually leverage customer feedback and advancing technology to mistake-proof the solution and improve customer experience, and we continue to invest in making that a reality.

Why adopt facial recognition?

Time is money, and time theft (aka time clock fraud, payroll fraud, and ‘buddy punching’) is still prevalent in many workplaces. A recent report suggested that, globally, businesses lose around four-and-a-half hours per employee per week to the practice. In many jobs, that will equate to 10-15% of total working hours – reduced productivity most organizations cannot afford to wear. Other sources put the figure at 2.2% of total payroll costs. The use of facial recognition has evolved significantly and is now extremely reliable and an obvious, simple-sounding solution to tackling buddy punching. To discover our range of HCM solutions, click here.