Scala/Spark Engineer Job
Job Description Job Attributes+
San Francisco, CA 94105, US
Contract to Perm
Blackstone Technology Group, an award-winning technology consulting and talent agency is seeking a Scala/Spark Engineer to join our team at our client s site in San Francisco, California.
Senior Software Engineer: Back-end focused
Looking for driven individuals to join our team of passionate engineers in creating our next generation of risk management products. The client believes that data and cloud is changing the nature of financial risk management.
In this role:
You will join the early stage of projects and participate in defining the platform for the next generation products
You will build API and processing pipeline for multi-tenant, high-volume, and real-time system on Spark and Hadoop platform
You will transform complex analytical models into scalable, production-ready solutions
You will continuously integrate and ship code into the cloud environment
You will develop applications from ground up using a modern technology stack such as Scala, Spark, Postgres, Angular 2, Play, and NoSQL
You will participate in defining the architecture of modern tools and runtime for operating your code such as AWS, Docker, Puppet, and Terraform
You will work directly with Product Owners to deliver products in a collaborative and agile environment
Who you are:
You are passionate to be part of cutting edge projects and are motivated by delivering world-class products with great architecture on an aggressive schedule
You are not intimidated by challenges; thrives even under pressure; is passionate about your craft; and hyper focused on delivering exceptional results
You love to learn new technologies and mentor junior engineers to raise the bar on your team
You use, or are passionate about learning, functional programming, AWS, Docker, Spark, Alluxio, Scala, Akka, Kafka, Cassandra, ElasticSearch, Hadoop, Yarn, and Mesos and anything else that will help you solve big, messy problems
Bachelors or higher in Computer Science, Mathematics, or other relevant field
Expert level knowledge of JVM and OOP
2+ years of experience in Scala or other functional languages
Experience in Hadoop stack: HDFS, Spark, NoSQL
Experience in designing API and documenting through Open API/Swagger
Experience in Unix/Linux including basic commands and scripting
Strong knowledge of source control systems and best practices (Git, Merging, Branching, Pull Requests, etc.)
Strong knowledge and understanding of algorithm optimization and distributed systems
Solid understanding of continuous integration, deployment and monitoring
Excellent communication skills
Designing mission-critical system using AWS, Docker, microservices architecture
Knowledge of Statistics
Experience in Fintech
The client believes in using the right tool for the right job, and we are eager to use the best that the open source world has to offer. We practice agile development with fast iterations, continuous integration, automated testing and build process.
Scala, SBT, Play, Swagger
Angular 2, Typescript
Spark, HDFS, Yarn, Postgres, Cassandra, Redshift
Node, Wepback and NPM
ScalaTest, Karma/Jasmine for Unit Testing
Robot and Selenium for Integration Testing
Puppet, Terraform, Packer
Blackstone is a global IT services and solutions firm that implements digital transformation solutions across commercial industry verticals and the US Federal Government. Blackstone was founded in 1998, and has offices in San Francisco, Denver, Houston, Colorado Springs, and Washington, DC. We specialize in IT staffing and place both technical and creative talent across a variety of industries and sectors.
EOE of Minorities/Females/Veterans/Disabilities
Who We Are
<br></b>Founded in 1998, Blackstone Talent Group is one of three divisions of Blackstone Technology Group. The other two divisions are Blackstone Federal, a premier engineering + transformation agency that serves the federal government, and Trellis Energy, the largest transaction management software firm fully dedicated to serving the natural gas industry.
Blackstone Technology Group is a privately-held global IT services, solutions and resourcing firm. Headquartered in San Francisco, Blackstone now has more than 300+ employees across five offices nationwide. Blackstone Technology Group’s mission is to help clients adapt to the demands of a digital world, and has garnered an impressive track record of delivering successful results to a client list that includes Fortune 100 businesses and US federal, state and local government.
</p><p><b>WHAT WE DO
<br></b>We provide contract, permanent and managed resource services to our clients. We source for commercial businesses and non-profits, as well as government clients requiring security clearances from public trust through multiple levels of top secret. Some of our skill specialties are IT, IT Operations, Engineering, Accounting and Finance, and Executive Search.</p><p><b>HOW WE DO IT<br></b>Our team never stops building connections with talent. And our network of fully-vetted, ready-to-work professionals allows us to provide exceptional speed and accuracy in our resource delivery that is unmatched in the industry. With a relationship-first engagement approach, we most often become a trusted partner with our clients and operate as an extension of their organizations.</p>