Web Crawling Engineer (Hybrid) İş İlanı
İşveren Hakkında
- İstanbul(Asya)
- Bilişim, Yazılım, Araştırma Hizmetleri, Danışmanlık, Pazarlama Danışmanlığı
GENEL NİTELİKLER
As a Web Crawling Engineer, you will write code directing our web crawler to capture and archive a diverse set of customer websites. Crawl Engineers are responsible for maintaining existing custom web crawler code, updating legacy code, and solving new incidents and errors. You must collaborate and coordinate with team members to solve capture issues and feature requests.
- Daily operation and fulfillment of time-sensitive requests from customers
- Create new custom web crawler code and update existing code to the latest technology to ensure efficient, high fidelity collection of web content
- Debugging incidents of failed crawls and implement resolutions
- Write quality code, read and comprehend other people’s code
- Clear, continuous, and timely communication of issues with engineers, and managers
- Actively participate in the growth of the company by providing feedback on tools and processes available to you
- Bachelor’s Degree of Science, related field or equivalent
- Experience running large scale web scrapes
- Solid Python knowledge
- Experience in Python, Javascript, HTML or other programming/scripting languages
- Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, mapreduce, SQL, BeautifulSoup, etc).
