Spark

Tommy + the technology of Spark

Spark Examples

Below are some of my projects involving Spark, grouped by company. Click to read more about the relevant projects and chat with me to follow up on any topic you'd like to hear more about!

MapR Technologies

Big Data / Hadoop Distributor

Principal Engineer, DevOps

2015 - 2018

Project: DevOps Portal + CICD

A portal bringing together version control, automated test definitions and statuses, quality metrics, jira tickets, CICD jobs, and supportinginfrastructure definitions and status into a single place to aid in release management and devops practices.

Behind the scenes, pipelines made with K8s (Kubernetes), Mesos, Github and Jenkins automatically provisioned environments, deployed our software and ran extensive tests on it, including complex multi-cloud platform scale tests across Google Cloud and AWS as well as on prem with bare metal and Open Stack