BI Developer - IT

Job description / Role

Our client is seeking an experienced Competition Intelligence Developer to join their Business Intelligence team in Dubai.

What You Will Be Doing?
- Develop new web crawlers and related functionality (pipelines, database)
- Maintain running web crawlers
- Wrangle, cleanse and transform huge amount of semi-structured and structured data
- Analyze data quality of the web crawlers, plan and execute corrective actions when needed
- Assist in the analysis related to the competitive data from the crawlers
- Assist in building dashboards with the competitive data
- Research new internet technologies to innovate existing solutions

Ideally candidates will have a sound understanding of: http requests (request/responses, headers, cookies, methods [GET/POST]), html-parsing, Linux, Internet traffic anonymization. Tools priority 1: scrapy framework (https://scrapy.org/), xpath/css selectors, Virtualenv, MySLQ db, CLI/Terminal, GIT, Proxy, Firewalls , JSON, XML. Tools priority 2: pandas, requests, beautifulsoup, Jupyter notebook, Amazon Redshift data warehouse, excel/google drive, MicroStrategy, AWS Cloud. Technically very proficient with a good analytical mind. Must be used to working autonomously with little supervision. Results oriented and driven with excellent communication skills.

Salary is very competitive on market rates with excellent benefits and a relocation package for overseas candidates and, as in Dubai, it is also tax free.

Requirements

- Minimum of 5 years of technical experience
- Experience with Linux, Python, MySQL Database, SQL, relational and non-relational data structures
- Full stack Python application framework
- Http requests (request/responses, headers, cookies, methods [GET/POST])
- Html-parsing
- Scrapy framework
- Ability to manipulate and visualize data using Excel and a web based professional data visualization tool
- Ability to work in a high demanding environment without supervision
- Must be analytical and results driven
- Excellent communication skills

Desired Experience
- Bachelor’s degree from top university in Computer Science or related field is a plus
- Knowledge of networking, security aspects and anonymization of traffic requests
- Confident with Version Control system such as GIT
- Xpath and CSS Selectors
- Virtualenv
- CLI/Terminal
- pandas
- beautifulsoup
- Jupyter notebook
- JSON, XML
- Proxy, firewalls
- Amazon Redshift data warehouse
- MicroStrategy
- AWS cloud

About the Company

We’re a small but fun team of incredibly passionate recruiters, who truly believe we can improve the recruitment landscape, celebrate Sunday mornings and help companies find talent at a reasonable cost. We’re a cross between an internal recruitment team and an external ‘traditional’ agency model.

We don’t follow the norm, we’re like modern day crusaders for recruitment agencies. At Jade we believe the most significant innovation is moving away from fixed fee model towards an unbundled format.

Recruitment has evolved, especially with the advent of social media, so we get why companies don’t want to pay 15% for introducing someone they could find directly on LinkedIn. What sets us apart in this already overcrowded market is our novel outlook on staffing – as a client you basically have the option to select the areas of recruitment you need and only pay for those elements. As a candidate, you simply register on our site and we promise to get in touch with you. (refer terms)

Jade offers recruitment solution at a reasonable cost across the deserts, we mainly cover – UAE, Saudi Arabia, Oman, Qatar, Bahrain and Kuwait.