Engineering Blog

Engineering

Learn from our challenges and triumphs as our talented engineering team offers insights for discussion and sharing.

Growing A/V for a Start Up Pt 1

When I first joined LiveRamp as a “You Can Do IT” Support Technician, I didn’t have a lot of in-depth knowledge of Audio/Visual Systems and how to build, support or diagnose effectively. I originally came from a computer hardware and software background with a focus on customer service and troubleshooting methodology. A lot of ...

Upgrading Cloudera Hadoop

Why Upgrade?

LiveRamp has relied heavily on MapReduce for our big-data computation since 2009.  However, the Hadoop ecosystem has grown and matured dramatically over the past 5 years, and one of the big changes has been the shift from MapReduce-centric MRv1 to MRv2 -- Hadoop YARN. YARN separates the resource allocation layer of a Hadoop cluster ...

A review of Backbone.js Patterns and Best Practices

"Philosophically, Backbone is an attempt to discover the minimal set of data-structuring (models and collections) and user interface (views and URLs) primitives that are generally useful when building web applications with JavaScript."   The quote above is taken from the Backbone project page. As it mentions, Backbone is an extremely useful JavaScript library that allows you ...

Transitive Elimination

At LiveRamp, we maintain a large identity graph that groups identifiers such as hashed emails into connected components where each component represents all of the identifiers that correspond to a single person and the ID for that person.   This graph changes over time as we add and remove edges connecting identifiers. For data onboarding, we ...