Tommy + MapR Technologies

Big Data / Hadoop Distributor

Home Companies MapR Technologies

MapR Technologies

Big Data / Hadoop Distributor

Principal Engineer, DevOps

2015 - 2018

Relationship:Employee

Seniority:Individual Contributor

Project(s):DevOps Portal + CICDDevOps DojoSpyglass

Languages, Disciplines + Tech

DevOpsMentorshipObservabilityScalaTypescriptDevOps Portal + CICDElasticSearchHadoopK8s (Kubernetes)OpenTSDBSpark

Company Overview

MapR Technologies was one of the top 3 Hadoop Distribution and Service companies (the other two being Cloudera and Hortonworks). It was an exciting organization to work for with an excellent product offering. In my time there I saw it evolve significantly in terms of size, product value, adoption of software craftsmanship best practices, and market opportunity.

I was awarded two “MapR Star Awards” from our leadership team, and I owe that in part to a great group of colleagues, who helped me champion self-service devops as a discipline (as opposed to a separate team that added more friction than value).

I was a key participant in the Employee Advisory Group, helping steer culture from the grassroots while building directional consensus among peers in leadership roles as well as my superiors

Key Results

Unified 5 disparate DevOps tools into single portal reducing context switching by 80%
Trained 8+ engineers in Scala and functional programming with Coursera certifications
Implemented comprehensive observability across Hadoop stack monitoring 100+ metrics
Automated multi-cloud testing across GCP, AWS, and on-prem reducing test setup time by 80%
Improved team collaboration resulting in DevOps Portal used by 8 teams

Let's Talk About It...

Role: Principal Engineer, DevOps

2015 - 2018EmployeeIndividual Contributor

After establishing a great working relationship with my manager at Lookout, he reached out to see if I'd be interested in taking on a bigger role doing DevOps at MapR Technologies and after going back and forth, I decided to move to San Jose and join him. After a few years and multiple successes, we parted ways, but remain friends to this day.

Project: DevOps Portal + CICD

A portal bringing together version control, automated test definitions and statuses, quality metrics, jira tickets, CICD jobs, and supportinginfrastructure definitions and status into a single place to aid in release management and devops practices.

Behind the scenes, pipelines made with K8s (Kubernetes), Mesos, Github and Jenkins automatically provisioned environments, deployed our software and ran extensive tests on it, including complex multi-cloud platform scale tests across Google Cloud and AWS as well as on prem with bare metal and Open Stack

Key Results

Unified 5 disparate DevOps tools into single portal reducing context switching by 80%
Automated multi-cloud testing across GCP, AWS, and on-prem reducing test setup time by 80%

Language(s):

Discipline(s):

Technologies(s):

Project: DevOps Dojo

I initiated and led "Scala Dojo" ,partnering with QA / Devs interested in adoption of Functional Programming, leading to certifications from Coursera and improved team morale and interest.

That broadened and continued on as "DevOps Dojo", which was a recurring collaboration initiative that produced theDevOps Portal + CICD by engaging across teams and disciplines to ascertain true priority pain points and solutions that scaled across multiple teams, so that we could address those via CI/CD and our DevOps practices.

Key Results

Trained 8+ engineers in Scala and functional programming with Coursera certifications
Improved team collaboration resulting in DevOps Portal used by 8 teams

Language(s):

Discipline(s):

Technologies(s):

Project: Spyglass

Observability was introduced to MapR via the Spyglass Project, which sought to obtain metrics from workloads as well as application specific metrics across all the tools and infrastructure of the MapR Hadoop Stack.

My responsibilities included automating the build and deployment of the full hadoop stack under development, automated test authoring and execution, mentoringjunior teammates to do the same, collaborating with dev teams to ensure they plugged into our CI/CD and Test framework nicely, andtroubleshooting problems that arose.

Introduced Scrum process and Jira to the team
Acted as scrum master in early days of project
Developed automation to manage ESXI environments for CI/CD, involving heterogeneous MapR cluster installation, configuration and testing

Key Results

Implemented comprehensive observability across Hadoop stack monitoring 100+ metrics
Decreased bug detection time from weeks to hours with automated healthchecks

Language(s):

Discipline(s):

Technologies(s):

Book a Chat w/ Calendly! LinkedIn