Senior Data Engineer Job at Sportradar, New York, NY

K0IwTW9VeEorczZHQXljVTVqK0pWY21u
  • Sportradar
  • New York, NY

Job Description

Company Description

We’re the world’s leading sports technology company, at the intersection between sports, media, and betting. More than 1,700 sports federations, media outlets, betting operators, and consumer platforms across 120 countries rely on our know-how and technology to boost their business.

Job Description

OVERVIEW:

Design, build, and implement generalized large-scale, sophisticated data pipelines using Nifi for downstream analytics and data science for our Sport Performance products. Design and develop scalable Nifi ingestion pipelines within AWS cloud services to consume real-time and batch data from external sources. Design and create data models for use throughout the ETL system. Utilize Kafka to efficiently and to effectively store data to move throughout the data pipeline and for downstream data science and analytics usage.

*Position permits telecommuting from anywhere in the U.S.

 

THE CHALLENGE:

  • Ensure the seamless integration of AWS-based tools for data storage, processing, and analytics.
  • Responsible for ETL development and warehousing using Python and Java.
  • Create data pipeline triggers and filters within ETL (extract, transform, and load) process to ensure appropriate optimization of data flowing through system and resource usage.
  • Implement monitoring and error handling for all new parts of the data pipeline to ensure observability and alerting is available.
  • Establish rigorous unit testing across the data pipeline to ensure robustness of the system.
  • Design and create data models for use throughout the ETL system.
  • Utilize Kafka to efficiently and to effectively store data to move throughout the data pipeline and for downstream data science and analytics usage.
  • Design data architecture and data models for both internal and external representations of data.
  • Build the data transforms within the data pipeline to convert data from external to internal representations.
  • Conduct data analytics and debugging bad data by writing SQL queries.
  • Build automated cleaning of data to remove bad or unusable data from downstream consumers with logging to understand the frequency and depth of the underlying issues.
  • Collaborate with other engineering teams to adopt standard methodologies, drive scalability, and increase consistency across systems.
  • Maintain awareness of company standards and technology guidance; use JIRA, an Agile project management tool, to ensure efficient data development; collaborate with peers to align projects with overall direction.
  • Follow best practices across Data Engineering to ensure scalable, consistent data architecture and system.
  • Utilize Java language to build data processors in Nifi framework.
  • Utilize Docker to ensure a consistent, repeatable, and isolated environment for software development and testing.
  • Work in a self-driven, independent fashion to meet Sport driven deadlines.

 

ABOUT YOU:

  • Master’s degree in computer science, computer engineering, or closely related field
  • 1 year experience as a data engineer or related occupation
  • Must possess 1 year of experience with:
    • Python, Java, Kafka, AWS, and Docker
    • ETL Development and Warehousing
    • Analytics and debugging using SQL
    • Agile development environment
    • Designing data architecture

OUR OFFER:

  • A collaborative environment with colleagues from all over the world (Engineering offices in Europe, Asia and US) including various social events and teambuilding .  
  • Flexibility to manage your workday and tasks with autonomy
  • A balance of structure and autonomy to tackle your daily tasks. 
  • Vibrant and inclusive community , including Women in Tech and Pride groups which welcome all participants. 
  • Global Employee Assistance Programme
  • Calm and Reulay app (leading well-being apps designed to support focus, quality rest, mindfulness, and long-term mental resilience). 
  • Online training videos
  • Flexible working hours

OUR RECRUITMENT PROCESS:

  • Initial Screening: A quick chat with our Talent Acquisition Partner to understand your background and expectations.  
  • One Interviews: Meet with the Hiring Manager to dive into your experience/background, also discuss team fit.  
  • Finals Steps: Receive feedback and, if successful, an offer!  

 

Additional Information

 

Pay Rate: $123,656/year

Additional Information

Sportradar intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors including but not limited to experience, qualifications, and location. Base pay is just one component of the Total Rewards that Sportradar provides to compensate and recognize employees for their work. Sportradar offers best-in-class benefits such as a comprehensive benefits package, performance bonus program, equity stock purchase and 401k contribution. Please consult with your recruiter to learn more as all benefits are subject to eligibility requirements.

At Sportradar, we celebrate our diverse group of hardworking employees. Sportradar is committed to ensuring equal access to its programs, facilities, and employment opportunities. All qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. We encourage you to apply even if you only meet most of the requirements (but not 100% of the listed criteria) – we believe skills evolve over time. If you’re willing to learn and grow with us, we invite you to join our team!

Job Tags

Remote job, Full time, Flexible hours,

Similar Jobs

Yexgo

Virtual Data Entry Assistant (100% Remote) Job at Yexgo

 ...Microsoft Office SuiteExcellent organizational and time management skillsAbility to work...  ...are offered from early morning to night and no experience is required.You will have ample opportunity for growthPart-time offered - pick the days you wish to work... 

Rinker Materials

Wet Cast Worker- Precast Plant Startup Job at Rinker Materials

 ...are looking for a WET CAST WORKER Precast Plant Startup to join our Doswell, VA plant. As...  ...critical in helping set up and maintain operations as the plant begins production. Your work...  .... Familiarity with hand tools and power tools. Ability to work outdoors or in... 

Rooted Talent Solutions

Customer service representative Job at Rooted Talent Solutions

 ...Job Title: Customer Service Representative (Remote, Independent Contractor...  ...in offering flexible, remote work opportunities that fit your lifestyle...  ...all from the comfort of your home. Position Overview: We...  ...ll assist customers by phone, chat, or emailresolving issues,... 

SWBR Architecture, Engineering & Landscape Architecture, D.P...

Interior Designer Job at SWBR Architecture, Engineering & Landscape Architecture, D.P...

 ...Job Description Job Description About Us SWBR is a nationally recognized design firm with expertise in architecture, interior design, structural engineering, landscape architecture, graphic design, planning and civil engineering. Since our founding in 1969, the... 

Career Group

Administrative Assistant Job at Career Group

 ...Job Title: Administrative Assistant Location: Peninsula, CA (Hybrid: 4 days onsite / 1 remote) Salary: $90k$120k base + paid overtime and bonus A premier private equity firm on the Peninsula is seeking a polished and highly capable Administrative Assistant...