Data Engineer Lead

san francisco, California

A technology company is currently seeking a Data Engineer Lead to join their team in San Francisco. This company applies state-of-the-art machine learning techniques to real-world problems in finance.They are a leader in their industry and worked at the frontier of applying machine learning to investment management. They are a multi-billion dollar asset manager and have ambitious goals for the future. 

Responsibilities: 

  • Create systems to manage external data feeds to ensure timeliness, availability, reliability, and correctness
  • Build standardized data interfaces that allow querying across diverse data sets while enforcing safeguards
  • Build high availability systems to supply data to both analytical and live trading systems
  • Implement data versioning standards to support research workflows
  • Develop algorithms to address data abnormality, corruption, and gaps
  • Design back-end data storage architectures
  • Manage data cleaning, post-processing, synchronization, and backups

Skills 

  • Must have a Bachelor's degree in Computer Science or related field
  • 5+ years of experience as a team lead  
  • Experience designing large-scale data infrastructure and service-oriented architecture
  • Experience delivering data to heterogeneous applications using modern tools
  • Experience developing in a Linux environment with a focus on scalability, concurrency, and correctness
  • Experience using programming languages - Python, Go, C/C++, and Java
  • Experience working on machine learning problems

Job category:

Job keywords:

Address
Files must be less than 2 MB.
Allowed file types: doc docx pdf.

Vertical Tabs