BETA
This is a BETA experience. You may opt-out by clicking here

More From Forbes

Edit Story

Leveraging Technology To Combat Illegal Content Online

This article is more than 4 years old.

Holly Lawrence is a former police officer now serving as the Head of Trust & Safety at SmugMug, Inc., the parent company of SmugMug and Flickr. She is the first former officer that I have encountered in the technology industry. But my guess is that she will not be the last as the rising prevalence of digital and social media in our lives and its unfortunate overlap with the more nefarious elements of our society make the path from law enforcement to tech a necessary one. 

Lawrence spent 14 years working as a police officer in Sunnyvale, California. She told me that she didn’t give tech much of a thought at the time. She figured reading email and remembering her passwords would be the extent of her interactions with technology. But her experience investigating abuse and interviewing sex offenders, victims, and bystanders led to a specialization in online child exploitation that eventually landed her a job at Yahoo! and then SmugMug. 

After its acquisition of Flickr, SmugMug became the worlds’ largest purpose-built, photographer-focused community helping people store, share, and sell their photos and videos. While most people think of photo storage and sharing sites as benign business or family vacation repositories, the truth is that with hundreds of millions of accounts and tens of billions of photos, there is an urgent need to monitor for less desirable and sometimes offensive content on the site. 

That job falls to Lawrence and her Trust & Safety team. Their task is to ensure that SmugMug and Flickr remain safe environments where users can have meaningful experiences and interactions. This job requires collaboration with user interface teams, engineering, legal, customer support, and other departments at SmugMug to create and maintain sound policy and procedures. Trust & Safety team members also develop relationships with community members to closely monitor their issues and concerns. 

This attention to explicit online content is not unique to SmugMug. The explosion in smartphone use, social media, and cloud storage have all contributed to an alarming increase in child pornography and other illegal content online. Unfortunately, Lawrence says that online policing and legislation have not kept pace with this torrid growth in offenders. 

To combat this proliferation of offensive imagery, including spam, harassment, impersonation, fraud, non-consensual intimate images, and child pornography, Lawrence and others that share similar responsibilities rely on technology. It’s impossible for humans to monitor every single photo uploaded to the Web, so machine learning, AI and other emerging tech can help do the job. But these technologies must also be trained, a delicate and time-consuming process. 

At SmugMug, Lawrence also relies on users as part of their investigation efforts. When the Trust & Safety team does identify abusive images or issues, they move quickly to remove them and use the experience as the foundation for developing best practices that prevent recurrences. 

One of the hardest parts of Lawrence’s job is dealing with child sexual abuse material (CSAM). Her goal is to eradicate it completely from SmugMug + Flickr, but it can seem like a never-ending battle. When the team does discover CSAM, they report the offender who uploaded it and work with law enforcement units around the world.

 

It’s this human part of the policing process that has secondary implications. Viewing troubling images and videos of children, violence, or abuse is extremely difficult and subjects the Trust & Safety team to a form of trauma sometimes compared to Post Traumatic Stress Disorder (PTSD). 

To help manage this, the team works with a therapist. They are also open with one another about how best to be resilient in the face of this pressure. For Lawrence, that means maintaining a positive outlook, building strong support systems in and out of the workplace, and finding small victories in what can sometimes feel like an insurmountable problem. 

They also work closely with the National Center for Missing & Exploited Children (NCMEC) whose mission is to help find missing children, reduce child exploitation, and prevent child victimization. Unfortunately, this can be exceedingly difficult as many children and their images appear online again, but Lawrence is committed to continually beat back this tide. In 2018 alone, she said more than 18 million CyberTips around child exploitation were generated industry-wide. 

Lawrence said her experience in law enforcement prepared her for her work in the prevention of online child exploitation. She has drawn upon her investigative skills not only to root out bad actors online, but also to work with others, in and outside the industry, to move the child safety industry forward. 

Her law enforcement past also helps her handle some of the legal aspects of her job. She points to the hot button issue of data and user privacy. Lawrence says SmugMug values its community and the rights of users to keep their information private. But she knows balancing these rights with issues like uncovering child exploitation is necessary. Her past helps her understand how to follow the law in these disclosures. 

Lawrence is invigorated by her ability to have a direct and positive impact on countless children and families by finding and removing offending images, sometimes even helping to remove them from an abusive situation. She is proud of her teams’ work in identifying issues so that authorities can intervene, and at-risk children can be delivered from potential further abuse. 

That ability and the purpose behind her work helps her remain positive and inspired by her job. She reminds me that as a mother of four children, the work is personal for her. Keeping this imagery off online platforms like SmugMug + Flickr protects children and ensures a better experience for all users. 

Ultimately, Lawrence believes as the industry continues to become more effective at detecting and surfacing CSAM, she and her team will have an even larger positive impact on the lives of the most vulnerable. 

Follow me on Twitter