Scala/Spark Engineer

in San Francisco, CA

Scala/Spark Engineer Job

Job Description Job Attributes+

  • Job ID


  • Req #


  • Organization


  • Job Category


  • Job Location

    San Francisco, CA 94105, US

  • Job Type

    Contract to Perm

  • Remote


Blackstone Technology Group, an award-winning technology consulting and talent agency is seeking a Scala/Spark Engineer to join our team at our client s site in San Francisco, California.

Senior Software Engineer: Back-end focused

Looking for driven individuals to join our team of passionate engineers in creating our next generation of risk management products. The client believes that data and cloud is changing the nature of financial risk management.

In this role:

You will join the early stage of projects and participate in defining the platform for the next generation products

You will build API and processing pipeline for multi-tenant, high-volume, and real-time system on Spark and Hadoop platform

You will transform complex analytical models into scalable, production-ready solutions

You will continuously integrate and ship code into the cloud environment

You will develop applications from ground up using a modern technology stack such as Scala, Spark, Postgres, Angular 2, Play, and NoSQL

You will participate in defining the architecture of modern tools and runtime for operating your code such as AWS, Docker, Puppet, and Terraform

You will work directly with Product Owners to deliver products in a collaborative and agile environment

Who you are:

You are passionate to be part of cutting edge projects and are motivated by delivering world-class products with great architecture on an aggressive schedule

You are not intimidated by challenges; thrives even under pressure; is passionate about your craft; and hyper focused on delivering exceptional results

You love to learn new technologies and mentor junior engineers to raise the bar on your team

You use, or are passionate about learning, functional programming, AWS, Docker, Spark, Alluxio, Scala, Akka, Kafka, Cassandra, ElasticSearch, Hadoop, Yarn, and Mesos and anything else that will help you solve big, messy problems

Basic Qualifications:

Bachelors or higher in Computer Science, Mathematics, or other relevant field

Expert level knowledge of JVM and OOP

2+ years of experience in Scala or other functional languages

Experience in Hadoop stack: HDFS, Spark, NoSQL

Experience in designing API and documenting through Open API/Swagger

Experience in Unix/Linux including basic commands and scripting

Strong knowledge of source control systems and best practices (Git, Merging, Branching, Pull Requests, etc.)

Strong knowledge and understanding of algorithm optimization and distributed systems

Solid understanding of continuous integration, deployment and monitoring

Excellent communication skills

Additional Qualifications

Designing mission-critical system using AWS, Docker, microservices architecture

Knowledge of Statistics

Experience in Fintech

Our Stack

The client believes in using the right tool for the right job, and we are eager to use the best that the open source world has to offer. We practice agile development with fast iterations, continuous integration, automated testing and build process.

Scala, SBT, Play, Swagger

Angular 2, Typescript

Spark, HDFS, Yarn, Postgres, Cassandra, Redshift

Node, Wepback and NPM

ScalaTest, Karma/Jasmine for Unit Testing

Robot and Selenium for Integration Testing


Puppet, Terraform, Packer

AWS, Docker

Blackstone is a global IT services and solutions firm that implements digital transformation solutions across commercial industry verticals and the US Federal Government. Blackstone was founded in 1998, and has offices in San Francisco, Denver, Houston, Colorado Springs, and Washington, DC. We specialize in IT staffing and place both technical and creative talent across a variety of industries and sectors.

EOE of Minorities/Females/Veterans/Disabilities

Additional Information

Who We Are

<p><b>ABOUT US
<br></b>Founded in 1998, Blackstone Talent Group is one of three divisions of Blackstone Technology Group. The other two divisions are Blackstone Federal, a premier engineering + transformation agency that serves the federal government, and Trellis Energy, the largest transaction management software firm fully dedicated to serving the natural gas industry.

Blackstone Technology Group is a privately-held global IT services, solutions and resourcing firm. Headquartered in San Francisco, Blackstone now has more than 300+ employees across five offices nationwide. Blackstone Technology Group’s mission is to help clients adapt to the demands of a digital world, and has garnered an impressive track record of delivering successful results to a client list that includes Fortune 100 businesses and US federal, state and local government.

</p><p><b>WHAT WE DO
<br></b>We provide contract, permanent and managed resource services to our clients. We source for commercial businesses and non-profits, as well as government clients requiring security clearances from public trust through multiple levels of top secret. Some of our skill specialties are IT, IT Operations, Engineering, Accounting and Finance, and Executive Search.</p><p><b>HOW WE DO IT<br></b>Our team never stops building connections with talent. And our network of fully-vetted, ready-to-work professionals allows us to provide exceptional speed and accuracy in our resource delivery that is unmatched in the industry. With a relationship-first engagement approach, we most often become a trusted partner with our clients and operate as an extension of their organizations.</p>

Saved Jobs