Skip to main content

NOW HIRING: Senior Backend Engineer


Company: Scrapinghub
Website: https://scrapinghub.com
Headquarters: Ballincollig, Cork, Ireland


Scrapinghub is looking for a Senior Backend Engineer to develop and grow a new web crawling and extraction SaaS.

The new SaaS will include our recently released AutoExtract which provides an API for automated e-commerce and article extraction from web pages using Machine Learning. AutoExtract is a distributed application written in Java, Scala and Python; components communicate via Apache Kafka and HTTP, and orchestrated using Kubernetes.

You will be designing and implementing distributed systems: large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc. - this is going to be a challenging journey for any backend engineer!

As a Senior Backend Engineer, you will have a large impact on the system we’re building, the new SaaS is still in the early stages of development.


Job Responsibilities:
  • Work on the core platform: develop and troubleshoot Kafka-based distributed application, write and change components implemented in Java, Scala and Python.
  • Work on new features, including design and implementation. You should be able to own and be responsible for the complete lifecycle of your features and code.
  • Solve distributed systems problems, such as scalability, transparency, failure handling, security, multi-tenancy.

Requirements
  • 3+ years of experience building large scale data processing systems or high load services
  • Strong background in algorithms and data structures.
  • Strong track record in at least two of these technologies: Java, Scala, Python, C++. 3+ years of experience with at least one of them.
  • Experience working with Linux and Docker.
  • Good communication skills in English.
  • Computer Science or other engineering degree.

Bonus points for:
  • Kubernetes experience
  • Apache Kafka experience
  • Experience building event-driven architectures
  • Understanding of web browser internals
  • Good knowledge of at least one RDBMS.
  • Knowledge of today’s cloud provider offerings: GCP, Amazon AWS, etc.
  • Web data extraction experience: web crawling, web scraping.
  • Experience with web data processing tasks: finding similar items, mining data streams, link analysis, etc.
  • History of open source contributions

Benefits

As a new Shubber, you will:
  • Become part of a self-motivated, progressive, multi-cultural team.
  • Have the freedom and flexibility to work from where you do your best work.
  • Attend conferences and meet with team members from across the globe.
  • Work with cutting-edge open source technologies and tools.
  • Receive paid time off
  • Enrol in Scrapinghub's Share Option Programme

CLICK HERE TO APPLY


Source: Remotely Awesome Jobs, Stack Overflow, Scrapinghub

Comments

Popular posts from this blog

OFFICE HELP THROUGH THE SERVICES OF A VIRTUAL ASSISTANT IN MANAGING YOUR BUSINESS ONLINE

Written By: Rosanna D. Webb Image Source: mompreneur360 Virtual Assistants (VA’s) began to be popular to  small companies run by entrepreneurs  who are managing their business all by themselves that seeks office help. The lower cost apart from the multi-tasking flexibility of VA’s makes them an ideal option to become partners for business success. The skill sets and capabilities of these proficient VA’s ranges from executing clerical jobs up to handling the business enterprise online. They have got exceptional competencies from nearly every facet of the business. The anticipation on VA’s regarding office help may be higher compared to a typical office personnel due to the fact that they are primarily employed of their expertise and not merely from their qualifications or working experience which often are the common grounds for the majority of businesses in employing their staff. The most prevalent query that you’re going to face regarding VA’s is, “What t...

Establishing a Professional Image While Working from Home as a Freelancer

  Written By: Rosanna Webb As a freelancer working from home, maintaining a professional image can sometimes feel challenging. With the absence of a traditional office environment, it’s crucial to establish a professional persona that conveys competence, reliability, and credibility to clients and colleagues.  Having built a freelancing career myself, I’ve learned the key strategies for creating and maintaining a professional image from home . I’ll share insights and tips to help you present yourself professionally, even when your workspace is your living room. The Importance of a Professional Image Creating a professional image as a freelancer is essential for several reasons : Client Perception : A professional image helps build trust and confidence with clients. It reflects your commitment to your work and reassures clients that they’re dealing with a reliable professional. Credibility : A polished professional image enhances your credibility and positions you as an expert ...

SETTING UP YOUR OWN WEBSITE IN WORDPRESS AT NO COST

Written By: Rosanna D. Webb Image Source: Wikihow WordPress  is a smart way to obtain your personal website without any cost. Setting up in this platform is ideal for bloggers or writers and businesses that would like to test how a website works. It is a Content Management System (CMS) which is a good option for business websites even though it is designed for blogging. As this is commonly used by bloggers, it can also be used by establishments and small businesses to position their business online. Also, it offers diverse features to choose from to produce a stunning website. Theme As soon as you completed creating your account in WordPress , you will then have access to a variety of paid and    free themes  to personalize your site. There’s no need for you to seek the services of a graphic designer for the website’s structure. You can actually select layouts based on your personal preferences which you believe is great for your business’ image. This is...